2021-10-08T19:07:16.617 INFO:root:teuthology version: 1.1.0-6f40c4ca 2021-10-08T19:07:16.619 DEBUG:teuthology.run:Teuthology command: teuthology --description orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} --name sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi --verbose --archive /home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428713 --owner scheduled_sage@teuthology -- /home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428713/orig.config.yaml 2021-10-08T19:07:16.653 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-10-08T19:07:16.711 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428713 branch: master description: orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} email: null first_in_suite: false job_id: '6428713' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: '8.2' overrides: admin_socket: branch: master ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: cephadm-package install: ceph: sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf extra_packages: - cephadm selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: qa-nvme-loop sha1: 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 owner: scheduled_sage@teuthology priority: 75 repo: https://github.com/ceph/ceph roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf sleep_before_teardown: 0 suite: orch:cephadm suite_branch: qa-nvme-loop suite_path: /home/teuthworker/src/github.com_liewegas_ceph_6d1d7181c8e91145ded12e11fc2a9c8ce31671f6/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 targets: smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcjjPwgGdODVSYBIFkWog0zHT78m4PGquCLBV9FlUE/i9cxTK2mJ8CMIzJTZ+WK5TS897Lwmhl5p77Ac9sx5xgTOOwsSRmTTQ73YjYXBX+2J0PO5qKnW2rQHvIgBPIyH4V8Y1aiO88AOX2DHChfdkrZdO6UlIDwoxRK6Q3WUFoMcfvDTvDcGggB5cYLfKMUpokfihhfhK69w6LDuss0VKRBMWxV5XVDOl5y2axnTs3OQjtQ9+XueeIBAi9v+vKIwS5L3Dhvs8/fmRawa10op3U9oesO+g07gpD0CycaGeMHqsNfvIMWuQ2hD51aaEKsQT6RG/aroJplMi1yMwEh5wxUQKDL7ZRMCP4JJ08PUcAFZVLF5RDnNiPoY8lQ3AbJGQ1xctrZjZ9gVMSqchczWjU5Hsp4/n1ih1dGozS79qlZv2wX8zQ/RNYa1RsOczyB24zKSCNLZ8BA+/xLO3pvUq1Z5H4Ww7kktjcdb3kitDFkIrX2SbCih8U3knZNmRfp08= smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCysJYFLlpt9jZVp/eHtZgQUbharKe0gEXe5kjU9nwx7KWx3aShOnICiebbloywOT/ynMqXuQ7hvpspiugJ2giliQObYsMrwomIwNOiR7/pJWMtdyqK22T81/9xiSYNpCW+li/G4/gfsAHCvCJxeYW/TKYbnwuoNudUfd7GTA6XCtUh0JdhAMyUT20EYurQNXhUlWzQ5Aa2KiobwKJJ981lF73aRr52KvXo/jbkOt/lcHwiEUCw5KL0OkFrjf9maptsVQ1xGKXMBMaFwUUq1Lbnb0pNn6/fXOFpwpD+bBmmzme3UKblLKtVvDqQH/A+/jBJR7lmpCJ9xweLJCyKJaeJ/lAnsViCn3rOHGf7QaoMIZDnSVpM4hsLKbLCeIfYi/v8liOFPvY4cHzQ4icJQH9g1GPo3jvNPBfNoqciBJje77mPsITnc2EJ7h5sKnIjmMSEhSJvmRKpoqWyIoS6dgBCrH1ImXhsXCTPR9m+S+Z/SpJsnkKEuU4BC4HOaS2+VAs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:3.0 - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology_branch: master teuthology_sha1: 6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b timestamp: 2021-10-08_18:44:18 tube: smithi user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.18925 2021-10-08T19:07:16.712 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_6d1d7181c8e91145ded12e11fc2a9c8ce31671f6/qa; will attempt to use it 2021-10-08T19:07:16.713 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_6d1d7181c8e91145ded12e11fc2a9c8ce31671f6/qa/tasks 2021-10-08T19:07:16.713 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-10-08T19:07:16.715 INFO:teuthology.task.internal:Checking packages... 2021-10-08T19:07:16.734 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '103b6cc3554193fcd0852d9c647cef19e99920cf' 2021-10-08T19:07:16.735 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-10-08T19:07:16.735 INFO:teuthology.packaging:ref: None 2021-10-08T19:07:16.736 INFO:teuthology.packaging:tag: None 2021-10-08T19:07:16.736 INFO:teuthology.packaging:branch: master 2021-10-08T19:07:16.736 INFO:teuthology.packaging:sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:07:16.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=master 2021-10-08T19:07:16.985 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-8109.gd66a7ec3 2021-10-08T19:07:16.986 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-10-08T19:07:16.996 INFO:teuthology.task.internal:no buildpackages task found 2021-10-08T19:07:16.997 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-10-08T19:07:17.037 INFO:teuthology.task.internal:Saving configuration 2021-10-08T19:07:17.050 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-10-08T19:07:17.065 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-08T19:07:17.086 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-08 19:02:02.390245', 'locked_by': 'scheduled_sage@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFhYq/QQ04BKcu7P5JUSiPsi8EU1Md4kJOAM2GVW/WiaqC8SbF+x9YsOlEvHVj5XLs/GswHQIBuj7zJ5om1240='} 2021-10-08T19:07:17.107 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-08 19:02:02.390267', 'locked_by': 'scheduled_sage@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIGfEppTcFgOotaAwP3StygN8ygO+21ixWOmizVgVlD8QwmXmJr5Q57vafUBHyPpUqLpfNetxN7LXg3/Tk/Bnew='} 2021-10-08T19:07:17.107 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-10-08T19:07:17.119 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2021-10-08T19:07:17.119 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-10-08T19:07:17.119 INFO:teuthology.run_tasks:Running task console_log... 2021-10-08T19:07:17.204 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2e8056de18>, signals=[15]) 2021-10-08T19:07:17.205 INFO:teuthology.run_tasks:Running task internal.connect... 2021-10-08T19:07:17.216 INFO:teuthology.task.internal:Opening connections... 2021-10-08T19:07:17.217 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2021-10-08T19:07:17.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:07:17.336 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2021-10-08T19:07:17.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:07:17.406 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-10-08T19:07:17.418 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2021-10-08T19:07:17.441 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2021-10-08T19:07:17.442 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2021-10-08T19:07:17.499 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Linux" 2021-10-08T19:07:17.499 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8 (Core)" 2021-10-08T19:07:17.500 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2021-10-08T19:07:17.500 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2021-10-08T19:07:17.500 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2021-10-08T19:07:17.501 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2021-10-08T19:07:17.501 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-10-08T19:07:17.501 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2021-10-08T19:07:17.501 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-08T19:07:17.502 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.centos.org/" 2021-10-08T19:07:17.502 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-08T19:07:17.502 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:07:17.502 INFO:teuthology.orchestra.run.smithi157.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-08T19:07:17.502 INFO:teuthology.orchestra.run.smithi157.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-08T19:07:17.503 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-10-08T19:07:17.503 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-10-08T19:07:17.503 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:07:17.504 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2021-10-08T19:07:17.527 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2021-10-08T19:07:17.543 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2021-10-08T19:07:17.543 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2021-10-08T19:07:17.597 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Linux" 2021-10-08T19:07:17.597 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8 (Core)" 2021-10-08T19:07:17.598 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2021-10-08T19:07:17.598 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2021-10-08T19:07:17.598 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2021-10-08T19:07:17.598 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2021-10-08T19:07:17.599 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-10-08T19:07:17.599 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2021-10-08T19:07:17.600 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-08T19:07:17.600 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.centos.org/" 2021-10-08T19:07:17.600 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-08T19:07:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:07:17.601 INFO:teuthology.orchestra.run.smithi196.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-08T19:07:17.601 INFO:teuthology.orchestra.run.smithi196.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-08T19:07:17.601 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-10-08T19:07:17.602 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-10-08T19:07:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:07:17.602 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2021-10-08T19:07:17.647 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-10-08T19:07:17.663 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-10-08T19:07:17.679 INFO:teuthology.task.internal:Checking for old test directory... 2021-10-08T19:07:17.680 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2021-10-08T19:07:17.683 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2021-10-08T19:07:17.696 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-10-08T19:07:17.708 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-10-08T19:07:17.708 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2021-10-08T19:07:17.737 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2021-10-08T19:07:17.760 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-10-08T19:07:17.825 INFO:teuthology.run_tasks:Running task kernel... 2021-10-08T19:07:17.843 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-10-08T19:07:17.844 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'ceph.rgw.foo.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}, 'ceph.iscsi.iscsi.a': {'kdb': True, 'sha1': 'distro'}} 2021-10-08T19:07:17.845 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-10-08T19:07:17.845 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2021-10-08T19:07:17.864 INFO:teuthology.orchestra.run.smithi157.stdout:4.18.0-305.12.1.el8_4.x86_64 2021-10-08T19:07:17.864 INFO:teuthology.task.kernel:Running kernel on smithi157: 4.18.0-305.12.1.el8_4.x86_64 2021-10-08T19:07:17.864 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum install -y kernel 2021-10-08T19:07:20.323 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - AppStream 35 MB/s | 9.3 MB 00:00 2021-10-08T19:07:21.878 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - Base 51 MB/s | 7.5 MB 00:00 2021-10-08T19:07:22.977 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - Extras 135 kB/s | 10 kB 00:00 2021-10-08T19:07:23.121 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - PowerTools 26 MB/s | 2.4 MB 00:00 2021-10-08T19:07:25.064 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 2.3 kB/s | 3.5 kB 00:01 2021-10-08T19:07:25.831 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 15 MB/s | 10 MB 00:00 2021-10-08T19:07:27.933 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2021-10-08T19:07:29.343 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-10-08T19:07:29.344 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-4.18.0-305.12.1.el8_4.x86_64 is already installed. 2021-10-08T19:07:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:07:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:07:29.594 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:07:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:07:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:07:29.595 INFO:teuthology.orchestra.run.smithi157.stdout: kernel x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 5.9 M 2021-10-08T19:07:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2021-10-08T19:07:29.595 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-core x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 36 M 2021-10-08T19:07:29.596 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 28 M 2021-10-08T19:07:29.596 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:07:29.596 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:07:29.596 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:07:29.596 INFO:teuthology.orchestra.run.smithi157.stdout:Install 3 Packages 2021-10-08T19:07:29.597 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:07:29.597 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 70 M 2021-10-08T19:07:29.598 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 88 M 2021-10-08T19:07:29.598 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:07:30.123 INFO:teuthology.orchestra.run.smithi157.stdout:(1/3): kernel-4.18.0-305.19.1.el8_4.x86_64.rpm 11 MB/s | 5.9 MB 00:00 2021-10-08T19:07:30.382 INFO:teuthology.orchestra.run.smithi157.stdout:(2/3): kernel-core-4.18.0-305.19.1.el8_4.x86_64 46 MB/s | 36 MB 00:00 2021-10-08T19:07:30.722 INFO:teuthology.orchestra.run.smithi157.stdout:(3/3): kernel-modules-4.18.0-305.19.1.el8_4.x86 25 MB/s | 28 MB 00:01 2021-10-08T19:07:30.725 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:07:30.726 INFO:teuthology.orchestra.run.smithi157.stdout:Total 62 MB/s | 70 MB 00:01 2021-10-08T19:07:30.838 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:07:31.147 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:07:31.147 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:07:32.351 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:07:32.387 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:07:34.808 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:07:35.380 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:07:38.297 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:07:38.670 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:07:41.649 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:07:41.881 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:08:01.731 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:08:02.056 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:08:02.057 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:08:02.057 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-core-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:08:02.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:08:02.426 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:08:02.426 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:08:02.427 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:02.427 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-core-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:02.427 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:02.427 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:08:02.428 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:08:02.567 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q kernel --last | head -n 1 2021-10-08T19:08:02.725 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Fri 08 Oct 2021 07:07:41 PM UTC 2021-10-08T19:08:02.727 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:02.727 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.12.1.el8_4.x86_64 Expected: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:02.728 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2021-10-08T19:08:02.747 INFO:teuthology.orchestra.run.smithi196.stdout:4.18.0-305.12.1.el8_4.x86_64 2021-10-08T19:08:02.748 INFO:teuthology.task.kernel:Running kernel on smithi196: 4.18.0-305.12.1.el8_4.x86_64 2021-10-08T19:08:02.749 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum install -y kernel 2021-10-08T19:08:05.241 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - AppStream 45 MB/s | 9.3 MB 00:00 2021-10-08T19:08:06.819 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - Base 50 MB/s | 7.5 MB 00:00 2021-10-08T19:08:07.892 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - Extras 139 kB/s | 10 kB 00:00 2021-10-08T19:08:08.048 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - PowerTools 24 MB/s | 2.4 MB 00:00 2021-10-08T19:08:10.396 INFO:teuthology.orchestra.run.smithi196.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2021-10-08T19:08:11.412 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 11 MB/s | 10 MB 00:00 2021-10-08T19:08:13.616 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 4.0 MB/s | 24 kB 00:00 2021-10-08T19:08:15.062 INFO:teuthology.orchestra.run.smithi196.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-10-08T19:08:15.062 INFO:teuthology.orchestra.run.smithi196.stdout:Package kernel-4.18.0-305.12.1.el8_4.x86_64 is already installed. 2021-10-08T19:08:15.310 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:08:15.311 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:08:15.312 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:08:15.312 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:08:15.312 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:08:15.312 INFO:teuthology.orchestra.run.smithi196.stdout: kernel x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 5.9 M 2021-10-08T19:08:15.313 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2021-10-08T19:08:15.313 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-core x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 36 M 2021-10-08T19:08:15.313 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-modules x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 28 M 2021-10-08T19:08:15.313 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:08:15.314 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:08:15.314 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:08:15.314 INFO:teuthology.orchestra.run.smithi196.stdout:Install 3 Packages 2021-10-08T19:08:15.314 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:08:15.314 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 70 M 2021-10-08T19:08:15.315 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 88 M 2021-10-08T19:08:15.315 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:08:15.639 INFO:teuthology.orchestra.run.smithi196.stdout:(1/3): kernel-4.18.0-305.19.1.el8_4.x86_64.rpm 18 MB/s | 5.9 MB 00:00 2021-10-08T19:08:16.043 INFO:teuthology.orchestra.run.smithi196.stdout:(2/3): kernel-modules-4.18.0-305.19.1.el8_4.x86 38 MB/s | 28 MB 00:00 2021-10-08T19:08:16.535 INFO:teuthology.orchestra.run.smithi196.stdout:(3/3): kernel-core-4.18.0-305.19.1.el8_4.x86_64 29 MB/s | 36 MB 00:01 2021-10-08T19:08:16.538 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:08:16.539 INFO:teuthology.orchestra.run.smithi196.stdout:Total 57 MB/s | 70 MB 00:01 2021-10-08T19:08:16.652 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:08:16.963 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:08:16.963 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:08:18.136 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:08:18.163 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:08:20.514 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:08:21.082 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:08:23.946 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:08:24.304 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:08:27.277 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:08:27.496 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:08:47.098 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:08:47.411 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:08:47.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-08T19:08:47.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-core-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-08T19:08:47.842 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-08T19:08:47.843 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:08:47.843 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:08:47.843 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:47.843 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-core-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:47.844 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:47.844 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:08:47.844 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:08:47.965 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q kernel --last | head -n 1 2021-10-08T19:08:48.162 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Fri 08 Oct 2021 07:08:27 PM UTC 2021-10-08T19:08:48.162 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:48.163 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.12.1.el8_4.x86_64 Expected: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:48.163 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-10-08T19:08:48.163 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-08T19:08:48.164 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-08T19:08:48.165 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-10-08T19:08:48.166 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2021-10-08T19:08:48.167 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q kernel --last | head -n 1 2021-10-08T19:08:48.301 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Fri 08 Oct 2021 07:07:41 PM UTC 2021-10-08T19:08:48.303 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:48.303 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -qi grub2-tools 2021-10-08T19:08:48.333 INFO:teuthology.orchestra.run.smithi157.stdout:Name : grub2-tools 2021-10-08T19:08:48.334 INFO:teuthology.orchestra.run.smithi157.stdout:Epoch : 1 2021-10-08T19:08:48.334 INFO:teuthology.orchestra.run.smithi157.stdout:Version : 2.02 2021-10-08T19:08:48.334 INFO:teuthology.orchestra.run.smithi157.stdout:Release : 81.el8 2021-10-08T19:08:48.335 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: x86_64 2021-10-08T19:08:48.335 INFO:teuthology.orchestra.run.smithi157.stdout:Install Date: Wed 11 Aug 2021 09:47:13 PM UTC 2021-10-08T19:08:48.335 INFO:teuthology.orchestra.run.smithi157.stdout:Group : System Environment/Base 2021-10-08T19:08:48.336 INFO:teuthology.orchestra.run.smithi157.stdout:Size : 9192705 2021-10-08T19:08:48.336 INFO:teuthology.orchestra.run.smithi157.stdout:License : GPLv3+ 2021-10-08T19:08:48.336 INFO:teuthology.orchestra.run.smithi157.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-10-08T19:08:48.337 INFO:teuthology.orchestra.run.smithi157.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-10-08T19:08:48.337 INFO:teuthology.orchestra.run.smithi157.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-10-08T19:08:48.337 INFO:teuthology.orchestra.run.smithi157.stdout:Build Host : kbuilder.bsys.centos.org 2021-10-08T19:08:48.337 INFO:teuthology.orchestra.run.smithi157.stdout:Relocations : (not relocatable) 2021-10-08T19:08:48.337 INFO:teuthology.orchestra.run.smithi157.stdout:Packager : CentOS BuildSystem 2021-10-08T19:08:48.338 INFO:teuthology.orchestra.run.smithi157.stdout:Vendor : CentOS 2021-10-08T19:08:48.338 INFO:teuthology.orchestra.run.smithi157.stdout:URL : http://www.gnu.org/software/grub/ 2021-10-08T19:08:48.338 INFO:teuthology.orchestra.run.smithi157.stdout:Summary : Support tools for GRUB. 2021-10-08T19:08:48.338 INFO:teuthology.orchestra.run.smithi157.stdout:Description : 2021-10-08T19:08:48.339 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:08:48.339 INFO:teuthology.orchestra.run.smithi157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-10-08T19:08:48.339 INFO:teuthology.orchestra.run.smithi157.stdout:customizable bootloader with modular architecture. It supports a rich 2021-10-08T19:08:48.339 INFO:teuthology.orchestra.run.smithi157.stdout:variety of kernel formats, file systems, computer architectures and 2021-10-08T19:08:48.340 INFO:teuthology.orchestra.run.smithi157.stdout:hardware devices. 2021-10-08T19:08:48.340 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:08:48.340 INFO:teuthology.orchestra.run.smithi157.stdout:This subpackage provides tools for support of all platforms. 2021-10-08T19:08:48.341 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-10-08T19:08:48.342 INFO:teuthology.task.kernel:Updating grub on smithi157 to boot 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:48.342 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-10-08T19:08:49.031 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2021-10-08T19:08:50.852 INFO:teuthology.orchestra.run.smithi157.stderr:done 2021-10-08T19:08:50.854 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2021-10-08T19:08:50.883 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.faq0FaX98Y 2021-10-08T19:08:50.884 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.faq0FaX98Y 2021-10-08T19:08:50.956 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.faq0FaX98Y 2021-10-08T19:08:51.101 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.faq0FaX98Y is 4KB 2021-10-08T19:08:51.150 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.faq0FaX98Y 2021-10-08T19:08:51.166 DEBUG:teuthology.orchestra.run.smithi157:> sudo /bin/ls /boot/loader/entries || true 2021-10-08T19:08:51.232 INFO:teuthology.orchestra.run.smithi157.stdout:d578f9996ed248e7a61be64fca30ef97-0-rescue.conf 2021-10-08T19:08:51.232 INFO:teuthology.orchestra.run.smithi157.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-193.el8.x86_64.conf 2021-10-08T19:08:51.232 INFO:teuthology.orchestra.run.smithi157.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-305.12.1.el8_4.x86_64.conf 2021-10-08T19:08:51.234 INFO:teuthology.orchestra.run.smithi157.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-305.19.1.el8_4.x86_64.conf 2021-10-08T19:08:51.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-set-default d578f9996ed248e7a61be64fca30ef97-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:51.383 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2021-10-08T19:08:51.386 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-10-08T19:08:51.387 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=None, version=distro) 2021-10-08T19:08:51.387 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q kernel --last | head -n 1 2021-10-08T19:08:51.519 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Fri 08 Oct 2021 07:08:27 PM UTC 2021-10-08T19:08:51.520 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:51.521 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -qi grub2-tools 2021-10-08T19:08:51.552 INFO:teuthology.orchestra.run.smithi196.stdout:Name : grub2-tools 2021-10-08T19:08:51.553 INFO:teuthology.orchestra.run.smithi196.stdout:Epoch : 1 2021-10-08T19:08:51.553 INFO:teuthology.orchestra.run.smithi196.stdout:Version : 2.02 2021-10-08T19:08:51.553 INFO:teuthology.orchestra.run.smithi196.stdout:Release : 81.el8 2021-10-08T19:08:51.553 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: x86_64 2021-10-08T19:08:51.554 INFO:teuthology.orchestra.run.smithi196.stdout:Install Date: Wed 11 Aug 2021 09:47:13 PM UTC 2021-10-08T19:08:51.554 INFO:teuthology.orchestra.run.smithi196.stdout:Group : System Environment/Base 2021-10-08T19:08:51.554 INFO:teuthology.orchestra.run.smithi196.stdout:Size : 9192705 2021-10-08T19:08:51.554 INFO:teuthology.orchestra.run.smithi196.stdout:License : GPLv3+ 2021-10-08T19:08:51.554 INFO:teuthology.orchestra.run.smithi196.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-10-08T19:08:51.555 INFO:teuthology.orchestra.run.smithi196.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-10-08T19:08:51.555 INFO:teuthology.orchestra.run.smithi196.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-10-08T19:08:51.555 INFO:teuthology.orchestra.run.smithi196.stdout:Build Host : kbuilder.bsys.centos.org 2021-10-08T19:08:51.555 INFO:teuthology.orchestra.run.smithi196.stdout:Relocations : (not relocatable) 2021-10-08T19:08:51.556 INFO:teuthology.orchestra.run.smithi196.stdout:Packager : CentOS BuildSystem 2021-10-08T19:08:51.556 INFO:teuthology.orchestra.run.smithi196.stdout:Vendor : CentOS 2021-10-08T19:08:51.556 INFO:teuthology.orchestra.run.smithi196.stdout:URL : http://www.gnu.org/software/grub/ 2021-10-08T19:08:51.556 INFO:teuthology.orchestra.run.smithi196.stdout:Summary : Support tools for GRUB. 2021-10-08T19:08:51.556 INFO:teuthology.orchestra.run.smithi196.stdout:Description : 2021-10-08T19:08:51.557 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:08:51.557 INFO:teuthology.orchestra.run.smithi196.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-10-08T19:08:51.557 INFO:teuthology.orchestra.run.smithi196.stdout:customizable bootloader with modular architecture. It supports a rich 2021-10-08T19:08:51.557 INFO:teuthology.orchestra.run.smithi196.stdout:variety of kernel formats, file systems, computer architectures and 2021-10-08T19:08:51.558 INFO:teuthology.orchestra.run.smithi196.stdout:hardware devices. 2021-10-08T19:08:51.558 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:08:51.558 INFO:teuthology.orchestra.run.smithi196.stdout:This subpackage provides tools for support of all platforms. 2021-10-08T19:08:51.561 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-10-08T19:08:51.561 INFO:teuthology.task.kernel:Updating grub on smithi196 to boot 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:51.561 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-10-08T19:08:53.021 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2021-10-08T19:08:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:done 2021-10-08T19:08:54.977 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2021-10-08T19:08:55.025 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.ruTQX5iPfK 2021-10-08T19:08:55.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ruTQX5iPfK 2021-10-08T19:08:55.055 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.ruTQX5iPfK 2021-10-08T19:08:55.204 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.ruTQX5iPfK is 4KB 2021-10-08T19:08:55.258 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.ruTQX5iPfK 2021-10-08T19:08:55.273 DEBUG:teuthology.orchestra.run.smithi196:> sudo /bin/ls /boot/loader/entries || true 2021-10-08T19:08:55.342 INFO:teuthology.orchestra.run.smithi196.stdout:d578f9996ed248e7a61be64fca30ef97-0-rescue.conf 2021-10-08T19:08:55.343 INFO:teuthology.orchestra.run.smithi196.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-193.el8.x86_64.conf 2021-10-08T19:08:55.343 INFO:teuthology.orchestra.run.smithi196.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-305.12.1.el8_4.x86_64.conf 2021-10-08T19:08:55.343 INFO:teuthology.orchestra.run.smithi196.stdout:d578f9996ed248e7a61be64fca30ef97-4.18.0-305.19.1.el8_4.x86_64.conf 2021-10-08T19:08:55.344 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-set-default d578f9996ed248e7a61be64fca30ef97-4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:08:55.509 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2021-10-08T19:09:25.548 INFO:teuthology.misc:Re-opening connections... 2021-10-08T19:09:25.550 INFO:teuthology.misc:trying to connect to ubuntu@smithi157.front.sepia.ceph.com 2021-10-08T19:09:25.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2021-10-08T19:09:25.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:09:44.011 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2021-10-08T19:09:44.012 INFO:teuthology.misc:trying to connect to ubuntu@smithi196.front.sepia.ceph.com 2021-10-08T19:09:44.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2021-10-08T19:09:44.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:10:44.075 DEBUG:teuthology.orchestra.remote:timed out 2021-10-08T19:10:44.077 DEBUG:teuthology.misc:waited 78.52719163894653 2021-10-08T19:10:45.078 INFO:teuthology.misc:trying to connect to ubuntu@smithi157.front.sepia.ceph.com 2021-10-08T19:10:45.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2021-10-08T19:10:45.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:10:45.778 DEBUG:teuthology.orchestra.run.smithi157:> true 2021-10-08T19:10:46.137 DEBUG:teuthology.misc:waited 80.58725786209106 2021-10-08T19:10:47.137 INFO:teuthology.misc:trying to connect to ubuntu@smithi196.front.sepia.ceph.com 2021-10-08T19:10:47.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2021-10-08T19:10:47.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:10:47.511 DEBUG:teuthology.orchestra.run.smithi196:> true 2021-10-08T19:10:47.809 DEBUG:teuthology.misc:waited 82.25973773002625 2021-10-08T19:10:48.810 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-10-08T19:10:48.810 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-305.19.1.el8_4.x86_64"... 2021-10-08T19:10:48.811 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2021-10-08T19:10:48.829 INFO:teuthology.orchestra.run.smithi157.stdout:4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:10:48.829 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.19.1.el8_4.x86_64 vs 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:10:48.830 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-08T19:10:48.830 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-10-08T19:10:48.830 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-10-08T19:10:48.831 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-305.19.1.el8_4.x86_64"... 2021-10-08T19:10:48.832 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2021-10-08T19:10:48.849 INFO:teuthology.orchestra.run.smithi196.stdout:4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:10:48.850 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.19.1.el8_4.x86_64 vs 4.18.0-305.19.1.el8_4.x86_64 2021-10-08T19:10:48.850 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-08T19:10:48.851 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-10-08T19:10:49.852 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-10-08T19:10:49.853 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-08T19:10:49.944 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2021-10-08T19:10:49.972 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-10-08T19:10:49.973 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-08T19:10:50.064 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2021-10-08T19:10:50.084 INFO:teuthology.run_tasks:Running task internal.base... 2021-10-08T19:10:50.093 INFO:teuthology.task.internal:Creating test directory... 2021-10-08T19:10:50.094 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-08T19:10:50.097 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-08T19:10:50.113 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-10-08T19:10:50.129 INFO:teuthology.run_tasks:Running task internal.archive... 2021-10-08T19:10:50.162 INFO:teuthology.task.internal:Creating archive directory... 2021-10-08T19:10:50.163 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-08T19:10:50.166 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-08T19:10:50.196 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-10-08T19:10:50.205 INFO:teuthology.task.internal:Enabling coredump saving... 2021-10-08T19:10:50.205 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-08T19:10:50.233 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-08T19:10:50.259 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:10:50.270 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:10:50.279 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:10:50.289 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:10:50.290 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-10-08T19:10:50.299 INFO:teuthology.task.internal:Configuring sudo... 2021-10-08T19:10:50.300 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-08T19:10:50.303 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-08T19:10:50.336 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-10-08T19:10:50.346 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-10-08T19:10:50.347 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-08T19:10:50.368 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-08T19:10:50.391 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:10:50.459 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:10:50.512 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:10:50.588 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:10:50.634 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:10:50.635 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-08T19:10:50.703 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:10:50.741 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:10:50.796 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:10:50.873 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:10:50.917 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:10:50.918 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-08T19:10:50.987 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2021-10-08T19:10:50.991 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2021-10-08T19:10:51.074 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-10-08T19:10:51.084 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-10-08T19:10:51.398 INFO:teuthology.run_tasks:Running task internal.timer... 2021-10-08T19:10:51.410 INFO:teuthology.task.internal:Starting timer... 2021-10-08T19:10:51.411 INFO:teuthology.run_tasks:Running task pcp... 2021-10-08T19:10:51.464 INFO:teuthology.run_tasks:Running task selinux... 2021-10-08T19:10:51.490 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-10-08T19:10:51.491 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2021-10-08T19:10:51.555 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: [ OK ] 2021-10-08T19:10:51.557 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2021-10-08T19:10:51.663 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: [ OK ] 2021-10-08T19:10:51.664 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-10-08T19:10:51.665 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2021-10-08T19:10:51.687 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2021-10-08T19:10:51.687 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2021-10-08T19:10:51.709 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2021-10-08T19:10:51.710 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi157.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2021-10-08T19:10:51.711 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-10-08T19:10:51.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-08T19:10:51.751 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-10-08T19:10:51.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-08T19:10:51.776 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-10-08T19:10:51.776 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2021-10-08T19:10:51.848 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2021-10-08T19:10:51.872 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-10-08T19:10:51.882 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-10-08T19:10:51.882 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-10-08T19:10:51.901 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-10-08T19:10:51.903 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi157.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-10-08T19:10:52.265 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-10-08T19:10:53.077 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-10-08T19:10:55.990 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-10-08T19:10:56.025 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:56 +0000 (0:00:00.051) 0:00:00.051 ******** 2021-10-08T19:10:56.040 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:56 +0000 (0:00:00.014) 0:00:00.066 ******** 2021-10-08T19:10:57.513 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-08T19:10:57.515 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] 2021-10-08T19:10:57.562 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:01.522) 0:00:01.588 ******** 2021-10-08T19:10:57.845 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:10:57.867 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:57 +0000 (0:00:00.305) 0:00:01.893 ******** 2021-10-08T19:10:58.190 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-08T19:10:58.192 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] 2021-10-08T19:10:58.243 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.376) 0:00:02.269 ******** 2021-10-08T19:10:58.281 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-10-08T19:10:58.284 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-08T19:10:58.314 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.069) 0:00:02.338 ******** 2021-10-08T19:10:58.386 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:10:58.412 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.099) 0:00:02.438 ******** 2021-10-08T19:10:58.452 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-10-08T19:10:58.454 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:10:58.476 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.064) 0:00:02.502 ******** 2021-10-08T19:10:58.684 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-10-08T19:10:58.687 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:10:58.714 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.237) 0:00:02.740 ******** 2021-10-08T19:10:58.764 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-10-08T19:10:58.771 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-08T19:10:58.788 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.073) 0:00:02.814 ******** 2021-10-08T19:10:58.867 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:10:58.888 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:58 +0000 (0:00:00.100) 0:00:02.914 ******** 2021-10-08T19:10:59.072 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-10-08T19:10:59.074 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:10:59.095 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:59 +0000 (0:00:00.205) 0:00:03.120 ******** 2021-10-08T19:10:59.641 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-10-08T19:10:59.642 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633720258.7602952-5104-233259503717741/source", "state": "file", "uid": 0} 2021-10-08T19:10:59.672 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:59 +0000 (0:00:00.577) 0:00:03.698 ******** 2021-10-08T19:10:59.703 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633720259.1388335-5176-116923616306956/source", "state": "file", "uid": 0} 2021-10-08T19:10:59.727 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:10:59 +0000 (0:00:00.054) 0:00:03.752 ******** 2021-10-08T19:11:00.098 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2021-10-08T19:11:00.100 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1 2021-10-08T19:11:00.101 INFO:teuthology.task.ansible.out:cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P 2021-10-08T19:11:00.103 INFO:teuthology.task.ansible.out:2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-10-08T19:11:00.184 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-10-08T19:11:00.185 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-08T19:11:00.199 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Friday 08 October 2021 19:11:00 +0000 (0:00:00.472) 0:00:04.225 ******** 2021-10-08T19:11:00.718 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] 2021-10-08T19:11:00.740 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] 2021-10-08T19:11:00.764 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Friday 08 October 2021 19:11:00 +0000 (0:00:00.563) 0:00:04.788 ******** 2021-10-08T19:11:00.789 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-08T19:11:00.811 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-08T19:11:00.816 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-08T19:11:00.977 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:00 +0000 (0:00:00.214) 0:00:05.003 ******** 2021-10-08T19:11:00.997 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:00 +0000 (0:00:00.020) 0:00:05.023 ******** 2021-10-08T19:11:01.593 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi157.front.sepia.ceph.com] 2021-10-08T19:11:01.624 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] 2021-10-08T19:11:01.653 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-10-08T19:11:01.655 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:01 +0000 (0:00:00.656) 0:00:05.679 ******** 2021-10-08T19:11:01.700 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:01 +0000 (0:00:00.047) 0:00:05.726 ******** 2021-10-08T19:11:02.423 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.292255", "end": "2021-10-08 19:11:02.403591", "rc": 0, "start": "2021-10-08 19:11:02.111336", "stderr": "", "stderr_lines": [], "stdout": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "stdout_lines": ["ee931718ec906fcbc1b8afc120f625a06f1ece1a"]} 2021-10-08T19:11:02.446 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.745) 0:00:06.472 ******** 2021-10-08T19:11:02.509 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.344216", "end": "2021-10-08 19:11:02.483749", "rc": 0, "start": "2021-10-08 19:11:02.139533", "stderr": "", "stderr_lines": [], "stdout": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "stdout_lines": ["ee931718ec906fcbc1b8afc120f625a06f1ece1a"]} 2021-10-08T19:11:02.533 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.085) 0:00:06.558 ******** 2021-10-08T19:11:02.654 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-10-08T19:11:02.656 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010382", "end": "2021-10-08 19:11:02.631517", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:11:02.621135", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-10-08T19:11:02.678 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.146) 0:00:06.704 ******** 2021-10-08T19:11:02.738 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014502", "end": "2021-10-08 19:11:02.720458", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:11:02.705956", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-10-08T19:11:02.764 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.085) 0:00:06.789 ******** 2021-10-08T19:11:02.770 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-10-08T19:11:02.772 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:02.807 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.037) 0:00:06.827 ******** 2021-10-08T19:11:02.856 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:02.888 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.087) 0:00:06.914 ******** 2021-10-08T19:11:02.898 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:02.933 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:02 +0000 (0:00:00.044) 0:00:06.959 ******** 2021-10-08T19:11:02.935 INFO:teuthology.task.ansible.out: 2021-10-08T19:11:02.995 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:03.017 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.084) 0:00:07.043 ******** 2021-10-08T19:11:03.028 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:03.051 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.033) 0:00:07.077 ******** 2021-10-08T19:11:03.098 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:03.121 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.069) 0:00:07.146 ******** 2021-10-08T19:11:03.165 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:03.184 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.063) 0:00:07.210 ******** 2021-10-08T19:11:03.201 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:03.229 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.045) 0:00:07.255 ******** 2021-10-08T19:11:03.261 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-10-08T19:11:03.263 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:03.292 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.062) 0:00:07.318 ******** 2021-10-08T19:11:03.314 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:03.338 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.046) 0:00:07.364 ******** 2021-10-08T19:11:03.535 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:11:03.560 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.222) 0:00:07.586 ******** 2021-10-08T19:11:03.600 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:11:03.623 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:03 +0000 (0:00:00.063) 0:00:07.649 ******** 2021-10-08T19:11:03.841 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-10-08T19:11:03.843 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-08T19:11:03.927 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-08T19:11:04.046 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-08T19:11:04.155 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-08T19:11:04.227 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-08T19:11:04.335 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-08T19:11:04.421 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-08T19:11:04.533 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-08T19:11:04.616 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-08T19:11:04.736 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-08T19:11:04.813 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-08T19:11:04.930 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-08T19:11:05.016 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-08T19:11:05.137 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-08T19:11:05.212 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-08T19:11:05.330 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-08T19:11:05.417 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-08T19:11:05.523 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-08T19:11:05.616 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-08T19:11:05.722 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-08T19:11:05.808 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-08T19:11:05.928 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-08T19:11:06.014 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-08T19:11:06.141 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-08T19:11:06.215 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-08T19:11:06.332 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-08T19:11:06.417 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-08T19:11:06.534 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-08T19:11:06.621 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-08T19:11:06.730 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-08T19:11:06.815 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-08T19:11:06.923 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-08T19:11:07.009 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-08T19:11:07.126 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-08T19:11:07.212 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-08T19:11:07.324 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-08T19:11:07.410 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-08T19:11:07.527 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-08T19:11:07.602 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-08T19:11:07.727 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-08T19:11:07.796 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-08T19:11:07.925 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-08T19:11:07.989 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-08T19:11:08.115 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-08T19:11:08.190 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-08T19:11:08.316 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-08T19:11:08.381 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-08T19:11:08.507 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-08T19:11:08.572 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-08T19:11:08.701 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-08T19:11:08.767 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-08T19:11:08.907 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-08T19:11:08.975 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-08T19:11:09.116 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-08T19:11:09.160 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-08T19:11:09.308 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-08T19:11:09.361 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-08T19:11:09.510 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-08T19:11:09.564 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-08T19:11:09.713 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-08T19:11:09.766 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-08T19:11:09.905 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-08T19:11:09.948 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-08T19:11:10.105 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-08T19:11:10.148 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-08T19:11:10.305 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-08T19:11:10.337 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-10-08T19:11:10.495 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-10-08T19:11:10.537 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:11:10.695 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:11:10.727 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-08T19:11:10.887 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-08T19:11:10.919 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-08T19:11:11.089 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-08T19:11:11.112 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-08T19:11:11.284 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-08T19:11:11.316 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-08T19:11:11.484 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-08T19:11:11.516 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-08T19:11:11.697 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-08T19:11:11.720 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-08T19:11:11.888 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-08T19:11:11.922 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-08T19:11:12.082 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-08T19:11:12.126 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:11:12.286 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:11:12.319 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-08T19:11:12.489 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-08T19:11:12.522 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-08T19:11:12.691 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-08T19:11:12.725 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-08T19:11:12.896 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-08T19:11:12.922 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-08T19:11:13.097 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-08T19:11:13.130 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-08T19:11:13.288 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-08T19:11:13.334 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-08T19:11:13.492 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-08T19:11:13.535 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-08T19:11:13.682 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-08T19:11:13.736 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-08T19:11:13.884 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-08T19:11:13.937 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-08T19:11:14.074 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-08T19:11:14.129 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-08T19:11:14.275 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-08T19:11:14.329 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-08T19:11:14.466 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-08T19:11:14.529 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-08T19:11:14.666 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-08T19:11:14.722 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-08T19:11:14.870 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-08T19:11:14.926 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-08T19:11:15.069 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-08T19:11:15.155 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-08T19:11:15.297 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-08T19:11:15.363 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-08T19:11:15.512 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-08T19:11:15.556 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:11:15.715 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:11:15.749 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-08T19:11:15.908 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-08T19:11:15.952 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-08T19:11:16.110 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-08T19:11:16.142 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-08T19:11:16.301 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-08T19:11:16.344 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-08T19:11:16.502 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-08T19:11:16.545 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-08T19:11:16.694 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-08T19:11:16.737 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-08T19:11:16.896 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-08T19:11:16.928 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-08T19:11:17.087 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-08T19:11:17.120 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-08T19:11:17.280 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-08T19:11:17.322 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-08T19:11:17.482 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-08T19:11:17.514 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-08T19:11:17.673 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-08T19:11:17.729 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-08T19:11:17.877 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-08T19:11:17.919 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-08T19:11:18.067 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-08T19:11:18.109 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-08T19:11:18.268 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-08T19:11:18.310 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-08T19:11:18.469 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-08T19:11:18.502 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-08T19:11:18.660 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-08T19:11:18.693 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-08T19:11:18.863 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-08T19:11:18.895 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-08T19:11:19.061 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-08T19:11:19.083 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-08T19:11:19.264 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-08T19:11:19.286 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-08T19:11:19.453 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-08T19:11:19.486 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-08T19:11:19.656 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-08T19:11:19.689 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-10-08T19:11:19.863 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-10-08T19:11:19.883 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-08T19:11:20.064 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-08T19:11:20.086 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-08T19:11:20.255 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-08T19:11:20.288 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-08T19:11:20.471 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-08T19:11:20.482 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-08T19:11:20.674 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-08T19:11:20.685 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-08T19:11:20.868 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-08T19:11:20.882 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-08T19:11:21.071 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-08T19:11:21.083 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-08T19:11:21.278 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-08T19:11:21.479 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-08T19:11:21.480 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-08T19:11:21.669 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-08T19:11:21.683 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-08T19:11:21.878 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-08T19:11:21.881 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-08T19:11:22.070 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-08T19:11:22.070 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-08T19:11:22.268 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-08T19:11:22.284 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-08T19:11:22.466 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-08T19:11:22.488 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-08T19:11:22.663 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:11:22.703 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-08T19:11:22.705 INFO:teuthology.task.ansible.out: 2021-10-08T19:11:22.878 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-08T19:11:22.913 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:11:23.082 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-08T19:11:23.116 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-08T19:11:23.289 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-08T19:11:23.311 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-08T19:11:23.493 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-08T19:11:23.517 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-08T19:11:23.701 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-08T19:11:23.732 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-08T19:11:23.898 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-08T19:11:23.932 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-08T19:11:24.091 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-08T19:11:24.135 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-08T19:11:24.297 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-08T19:11:24.330 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-08T19:11:24.501 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-08T19:11:24.544 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-08T19:11:24.703 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-08T19:11:24.758 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-08T19:11:24.902 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-08T19:11:24.966 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-08T19:11:25.107 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-08T19:11:25.172 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-08T19:11:25.315 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-08T19:11:25.371 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-08T19:11:25.514 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-08T19:11:25.577 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-08T19:11:25.716 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-08T19:11:25.770 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-08T19:11:25.921 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-08T19:11:25.979 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-08T19:11:26.121 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-08T19:11:26.177 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-08T19:11:26.324 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-08T19:11:26.377 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-08T19:11:26.506 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-08T19:11:26.581 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-08T19:11:26.709 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-08T19:11:26.773 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-08T19:11:26.909 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-08T19:11:26.973 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-08T19:11:27.110 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-08T19:11:27.163 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-08T19:11:27.303 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-08T19:11:27.368 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-08T19:11:27.504 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-08T19:11:27.557 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-08T19:11:27.694 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-08T19:11:27.751 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-08T19:11:27.890 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-08T19:11:27.954 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-08T19:11:28.081 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-08T19:11:28.145 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-08T19:11:28.282 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-08T19:11:28.349 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-08T19:11:28.475 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-08T19:11:28.539 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-08T19:11:28.678 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-08T19:11:28.742 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-08T19:11:28.871 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-10-08T19:11:28.936 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-08T19:11:29.074 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-08T19:11:29.128 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-10-08T19:11:29.276 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-08T19:11:29.329 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-08T19:11:29.467 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-08T19:11:29.530 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-08T19:11:29.668 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-08T19:11:29.722 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-08T19:11:29.859 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-08T19:11:29.924 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-08T19:11:30.064 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-08T19:11:30.121 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-08T19:11:30.260 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-10-08T19:11:30.323 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-08T19:11:30.454 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-10-08T19:11:30.528 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-10-08T19:11:30.665 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-10-08T19:11:30.719 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-10-08T19:11:30.857 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-10-08T19:11:30.921 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-10-08T19:11:31.049 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-10-08T19:11:31.112 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-10-08T19:11:31.239 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-10-08T19:11:31.314 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-10-08T19:11:31.444 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-10-08T19:11:31.509 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-10-08T19:11:31.637 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-10-08T19:11:31.711 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-10-08T19:11:31.827 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-10-08T19:11:31.902 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-10-08T19:11:32.028 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-10-08T19:11:32.102 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-10-08T19:11:32.229 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-10-08T19:11:32.306 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-10-08T19:11:32.420 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-10-08T19:11:32.505 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-10-08T19:11:32.623 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-10-08T19:11:32.709 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-10-08T19:11:32.810 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-10-08T19:11:32.915 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-10-08T19:11:33.011 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-10-08T19:11:33.116 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-10-08T19:11:33.201 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-10-08T19:11:33.313 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-10-08T19:11:33.515 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-10-08T19:11:34.802 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-10-08T19:11:35.138 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-10-08T19:11:36.259 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-10-08T19:11:36.662 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-10-08T19:11:37.751 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-10-08T19:11:38.086 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-10-08T19:11:39.110 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-10-08T19:11:39.234 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:39 +0000 (0:00:35.610) 0:00:43.260 ******** 2021-10-08T19:11:39.305 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-10-08T19:11:39.327 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:39 +0000 (0:00:00.093) 0:00:43.353 ******** 2021-10-08T19:11:39.421 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-10-08T19:11:39.423 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-10-08T19:11:39.425 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-10-08T19:11:39.426 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-10-08T19:11:39.428 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-10-08T19:11:39.430 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-10-08T19:11:39.432 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-10-08T19:11:39.434 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95 2021-10-08T19:11:39.434 INFO:teuthology.task.ansible.out:579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-08T19:11:39.436 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-10-08T19:11:39.437 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-10-08T19:11:39.439 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-10-08T19:11:39.441 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-10-08T19:11:39.442 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878 2021-10-08T19:11:39.444 INFO:teuthology.task.ansible.out:bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91 2021-10-08T19:11:39.445 INFO:teuthology.task.ansible.out:e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": 2021-10-08T19:11:39.447 INFO:teuthology.task.ansible.out: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-08T19:11:39.472 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:39 +0000 (0:00:00.144) 0:00:43.498 ******** 2021-10-08T19:11:39.479 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-10-08T19:11:39.481 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-10-08T19:11:39.608 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:39 +0000 (0:00:00.135) 0:00:43.634 ******** 2021-10-08T19:11:39.691 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-10-08T19:11:39.714 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:39 +0000 (0:00:00.106) 0:00:43.740 ******** 2021-10-08T19:11:39.811 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-10-08T19:11:39.813 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-10-08T19:11:39.815 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-10-08T19:11:39.817 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-10-08T19:11:39.819 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-10-08T19:11:39.821 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-10-08T19:11:39.823 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-10-08T19:11:39.824 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95 2021-10-08T19:11:39.825 INFO:teuthology.task.ansible.out:579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-08T19:11:39.826 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-10-08T19:11:39.829 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-10-08T19:11:39.832 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-10-08T19:11:39.833 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-10-08T19:11:39.835 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878 2021-10-08T19:11:39.837 INFO:teuthology.task.ansible.out:bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91 2021-10-08T19:11:39.837 INFO:teuthology.task.ansible.out:e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": 2021-10-08T19:11:39.839 INFO:teuthology.task.ansible.out: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-08T19:11:39.868 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:39 +0000 (0:00:00.152) 0:00:43.893 ******** 2021-10-08T19:11:40.391 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-10-08T19:11:40.397 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"after": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "attempts": 1, "before": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "changed": false, "remote_url_changed": false} 2021-10-08T19:11:40.415 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:00.548) 0:00:44.441 ******** 2021-10-08T19:11:40.565 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"after": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "attempts": 1, "before": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "changed": false, "remote_url_changed": false} 2021-10-08T19:11:40.589 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:11:40 +0000 (0:00:00.173) 0:00:44.615 ******** 2021-10-08T19:11:40.777 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-08T19:11:40.936 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-08T19:11:41.000 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-08T19:11:41.159 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-08T19:11:41.223 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-08T19:11:41.361 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-08T19:11:41.437 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-08T19:11:41.439 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-08T19:11:41.575 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-08T19:11:41.577 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-08T19:11:41.650 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-08T19:11:41.782 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-08T19:11:41.856 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-08T19:11:41.858 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-08T19:11:41.985 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-08T19:11:41.987 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-08T19:11:42.091 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-08T19:11:42.208 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-08T19:11:42.303 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-08T19:11:42.408 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-08T19:11:42.514 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-08T19:11:42.529 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:42.615 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-08T19:11:42.627 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:42.733 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-08T19:11:42.736 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-08T19:11:42.831 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-08T19:11:42.833 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-08T19:11:42.958 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-08T19:11:42.959 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-10-08T19:11:42.969 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVN 2021-10-08T19:11:42.972 INFO:teuthology.task.ansible.out:TUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:43.046 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-08T19:11:43.048 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-10-08T19:11:43.055 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:43.066 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:11:43.187 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-08T19:11:43.266 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-08T19:11:43.399 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-08T19:11:43.401 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-08T19:11:43.476 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-08T19:11:43.478 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-08T19:11:43.614 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-08T19:11:43.688 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-08T19:11:43.815 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-08T19:11:43.890 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-08T19:11:44.026 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-08T19:11:44.100 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-08T19:11:44.237 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-08T19:11:44.239 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-08T19:11:44.322 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-08T19:11:44.324 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-08T19:11:44.449 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-08T19:11:44.451 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-08T19:11:44.525 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-08T19:11:44.526 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-08T19:11:44.650 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-08T19:11:44.725 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-08T19:11:44.850 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-08T19:11:44.935 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-08T19:11:45.075 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-08T19:11:45.077 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-08T19:11:45.149 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-08T19:11:45.151 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-08T19:11:45.276 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-08T19:11:45.360 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-08T19:11:45.491 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-08T19:11:45.575 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-08T19:11:45.700 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-08T19:11:45.785 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-08T19:11:45.921 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-08T19:11:45.994 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-08T19:11:46.121 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-08T19:11:46.195 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-08T19:11:46.331 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-08T19:11:46.333 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-08T19:11:46.404 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-08T19:11:46.407 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-08T19:11:46.530 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-08T19:11:46.614 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-08T19:11:46.740 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-08T19:11:46.824 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-08T19:11:46.941 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-08T19:11:47.025 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-08T19:11:47.151 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-08T19:11:47.226 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-08T19:11:47.353 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:11:47.439 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:11:47.554 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-08T19:11:47.638 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-08T19:11:47.775 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-08T19:11:47.849 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-08T19:11:47.975 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-08T19:11:47.978 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-08T19:11:48.059 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-08T19:11:48.061 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-08T19:11:48.175 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-08T19:11:48.177 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-08T19:11:48.261 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-08T19:11:48.263 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-08T19:11:48.398 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-08T19:11:48.474 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-08T19:11:48.602 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-08T19:11:48.678 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-08T19:11:48.816 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-08T19:11:48.879 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-08T19:11:49.026 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-08T19:11:49.028 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:11:49.100 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-08T19:11:49.102 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:11:49.259 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-08T19:11:49.261 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-08T19:11:49.263 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-08T19:11:49.313 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-08T19:11:49.314 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-08T19:11:49.316 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-08T19:11:49.470 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-08T19:11:49.523 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-08T19:11:49.674 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-08T19:11:49.736 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-08T19:11:49.882 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-08T19:11:49.946 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-08T19:11:50.082 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-08T19:11:50.157 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-08T19:11:50.305 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-08T19:11:50.359 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-08T19:11:50.516 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-08T19:11:50.518 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-08T19:11:50.569 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-08T19:11:50.571 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-08T19:11:50.718 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-08T19:11:50.772 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-08T19:11:50.922 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-08T19:11:50.986 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-08T19:11:51.132 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-08T19:11:51.134 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-08T19:11:51.195 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-08T19:11:51.197 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-08T19:11:51.354 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-08T19:11:51.417 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-08T19:11:51.717 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-08T19:11:51.770 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-08T19:11:51.927 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-08T19:11:51.929 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-08T19:11:51.981 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-08T19:11:51.983 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-08T19:11:52.129 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-08T19:11:52.192 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-08T19:11:52.351 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-08T19:11:52.405 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-08T19:11:52.553 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-08T19:11:52.620 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-08T19:11:52.768 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:11:52.832 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:11:52.968 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-08T19:11:53.043 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-08T19:11:53.169 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-08T19:11:53.243 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-08T19:11:53.380 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-08T19:11:53.459 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-08T19:11:53.580 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-08T19:11:53.677 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-08T19:11:53.782 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-08T19:11:53.878 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-08T19:11:53.994 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-08T19:11:54.089 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-08T19:11:54.194 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-08T19:11:54.289 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-08T19:11:54.395 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-08T19:11:54.500 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-08T19:11:54.605 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-08T19:11:54.710 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-08T19:11:54.814 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-08T19:11:54.931 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-08T19:11:55.026 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-08T19:11:55.132 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-08T19:11:55.259 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-08T19:11:55.342 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-08T19:11:55.476 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-08T19:11:55.561 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-08T19:11:55.677 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-08T19:11:55.771 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-08T19:11:55.887 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-08T19:11:55.971 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-08T19:11:56.097 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-08T19:11:56.181 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-08T19:11:56.297 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-08T19:11:56.299 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-08T19:11:56.393 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-08T19:11:56.395 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-08T19:11:56.503 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-08T19:11:56.598 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-08T19:11:56.725 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-08T19:11:56.809 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-08T19:11:56.928 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-08T19:11:57.023 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-08T19:11:57.138 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-08T19:11:57.140 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-08T19:11:57.224 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-08T19:11:57.226 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-08T19:11:57.348 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-08T19:11:57.433 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-08T19:11:57.547 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-08T19:11:57.632 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-08T19:11:57.771 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-08T19:11:57.835 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-08T19:11:57.982 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-08T19:11:58.046 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-08T19:11:58.184 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-08T19:11:58.248 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-08T19:11:58.396 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-08T19:11:58.460 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-08T19:11:58.597 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-08T19:11:58.671 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-08T19:11:58.807 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-08T19:11:58.810 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-08T19:11:58.881 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-08T19:11:58.883 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-08T19:11:59.019 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-08T19:11:59.094 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-08T19:11:59.232 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-08T19:11:59.296 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-08T19:11:59.433 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-08T19:11:59.518 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-08T19:11:59.644 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-08T19:11:59.728 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-08T19:11:59.844 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-08T19:11:59.930 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-08T19:12:00.059 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-08T19:12:00.134 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-08T19:12:00.260 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-08T19:12:00.262 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:12:00.346 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-08T19:12:00.348 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:12:00.474 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-08T19:12:00.548 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-08T19:12:00.678 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-08T19:12:00.754 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-08T19:12:00.883 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-08T19:12:00.966 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-08T19:12:01.092 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-08T19:12:01.179 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-08T19:12:01.306 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-08T19:12:01.381 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-08T19:12:01.507 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-08T19:12:01.584 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-08T19:12:01.722 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-08T19:12:01.800 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-08T19:12:01.923 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-08T19:12:02.047 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-08T19:12:02.165 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-08T19:12:02.260 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-08T19:12:02.367 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-08T19:12:02.462 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-08T19:12:02.579 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-08T19:12:02.679 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-08T19:12:02.800 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-08T19:12:02.896 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-08T19:12:03.003 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-08T19:12:03.102 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-08T19:12:03.223 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-08T19:12:03.336 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-08T19:12:03.441 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-08T19:12:03.548 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-08T19:12:03.653 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-08T19:12:03.758 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-08T19:12:03.863 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-08T19:12:03.968 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-08T19:12:04.064 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-08T19:12:04.169 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-08T19:12:04.275 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-08T19:12:04.276 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-08T19:12:04.394 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-08T19:12:04.397 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-08T19:12:04.480 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-08T19:12:04.598 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-08T19:12:04.684 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-08T19:12:04.800 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-08T19:12:04.895 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-08T19:12:05.011 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-08T19:12:05.095 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-08T19:12:05.232 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-08T19:12:05.306 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-08T19:12:05.432 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-08T19:12:05.510 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-08T19:12:05.643 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-08T19:12:05.715 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-08T19:12:05.843 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-08T19:12:05.927 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-08T19:12:06.045 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-08T19:12:06.128 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-08T19:12:06.266 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-08T19:12:06.341 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-08T19:12:06.468 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-08T19:12:06.542 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-08T19:12:06.678 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-08T19:12:06.762 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-08T19:12:06.878 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-08T19:12:06.974 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-08T19:12:07.142 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-08T19:12:07.219 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-08T19:12:07.357 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-08T19:12:07.446 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-08T19:12:07.570 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-08T19:12:07.667 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-08T19:12:07.669 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-08T19:12:07.783 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-08T19:12:07.786 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-08T19:12:07.881 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-08T19:12:07.998 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-08T19:12:08.097 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-08T19:12:08.228 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-08T19:12:08.302 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-08T19:12:08.453 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-08T19:12:08.507 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-08T19:12:08.655 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-08T19:12:08.718 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-08T19:12:08.866 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-08T19:12:08.930 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-08T19:12:09.069 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-08T19:12:09.143 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-08T19:12:09.280 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-08T19:12:09.353 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-08T19:12:09.489 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-08T19:12:09.563 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-08T19:12:09.700 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-08T19:12:09.794 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-08T19:12:09.901 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-08T19:12:09.996 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-08T19:12:10.112 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-08T19:12:10.207 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-08T19:12:10.314 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-08T19:12:10.410 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-08T19:12:10.525 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-08T19:12:10.610 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-08T19:12:10.736 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-08T19:12:10.820 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-08T19:12:10.946 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-08T19:12:11.021 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-08T19:12:11.147 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-08T19:12:11.232 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-08T19:12:11.365 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-08T19:12:11.440 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-08T19:12:11.568 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-08T19:12:11.644 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-08T19:12:11.784 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-08T19:12:11.860 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-08T19:12:11.999 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-08T19:12:12.073 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-08T19:12:12.221 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-08T19:12:12.274 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-08T19:12:12.372 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:12 +0000 (0:00:31.783) 0:01:16.398 ******** 2021-10-08T19:12:12.427 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-08T19:12:12.642 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.664 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:12 +0000 (0:00:00.291) 0:01:16.690 ******** 2021-10-08T19:12:12.674 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.676 INFO:teuthology.task.ansible.out: skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.678 INFO:teuthology.task.ansible.out: skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.680 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.680 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.682 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841e 2021-10-08T19:12:12.683 INFO:teuthology.task.ansible.out:e62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.762 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.763 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.784 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.786 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.796 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.797 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.807 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.809 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.818 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.915 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-08T19:12:12.927 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:12.929 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.023 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-08T19:12:13.034 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.036 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.130 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-08T19:12:13.246 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-08T19:12:13.330 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-08T19:12:13.342 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.355 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.366 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.377 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.388 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.399 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.402 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.402 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.413 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.424 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.426 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.435 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.447 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-08T19:12:13.458 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.460 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d3 2021-10-08T19:12:13.462 INFO:teuthology.task.ansible.out:13e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.472 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.474 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.485 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.487 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.488 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.499 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.500 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.502 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.513 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.516 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.526 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.528 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.529 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f3 2021-10-08T19:12:13.530 INFO:teuthology.task.ansible.out:89f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.540 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.541 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.552 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.553 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.564 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.566 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.575 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.577 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.578 INFO:teuthology.task.ansible.out: 2021-10-08T19:12:13.589 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.590 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.601 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.603 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.616 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.627 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.629 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.640 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.641 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.641 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.642 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.644 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.654 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.655 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.666 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.667 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.668 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.679 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.680 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.691 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.693 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.704 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.706 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.717 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.718 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.730 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.742 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/Ffa 2021-10-08T19:12:13.744 INFO:teuthology.task.ansible.out:Q/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.754 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.756 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.769 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.771 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.780 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.782 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.797 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.809 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.820 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.821 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.822 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "c 2021-10-08T19:12:13.823 INFO:teuthology.task.ansible.out:hanged": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.834 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.835 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.836 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.848 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.850 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.860 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.861 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.873 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.875 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.887 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.889 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.900 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.902 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.913 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.915 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.926 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.928 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.940 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.941 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.954 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.967 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.970 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.980 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.992 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:13.993 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.006 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.019 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.031 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.033 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.034 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.046 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.049 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.050 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIK 2021-10-08T19:12:14.051 INFO:teuthology.task.ansible.out:WMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.062 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.064 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.075 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.078 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.087 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.089 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.099 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.101 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.111 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.113 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.113 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var 2021-10-08T19:12:14.115 INFO:teuthology.task.ansible.out:": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.124 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.126 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.127 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.138 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.141 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.151 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.163 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.165 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.176 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.178 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.189 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.191 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.202 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.214 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.216 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.227 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.229 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.239 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.242 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.262 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.264 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.266 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.276 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.278 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.288 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.290 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.291 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.306 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.318 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.328 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.330 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.341 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.346 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.369 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.370 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.394 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:14 +0000 (0:00:01.730) 0:01:18.420 ******** 2021-10-08T19:12:14.402 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.404 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.417 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.428 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.430 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.430 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.441 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.453 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.479 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.500 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:14 +0000 (0:00:00.105) 0:01:18.526 ******** 2021-10-08T19:12:14.519 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:14 +0000 (0:00:00.019) 0:01:18.545 ******** 2021-10-08T19:12:14.569 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:14.591 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:14 +0000 (0:00:00.071) 0:01:18.617 ******** 2021-10-08T19:12:14.798 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-10-08T19:12:14.800 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-08T19:12:14.872 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-08T19:12:14.989 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-08T19:12:15.063 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-08T19:12:15.182 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-08T19:12:15.268 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-08T19:12:15.374 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-08T19:12:15.459 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-08T19:12:15.566 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-08T19:12:15.652 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-08T19:12:15.769 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-08T19:12:15.859 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-08T19:12:15.962 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-08T19:12:16.048 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-08T19:12:16.164 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-08T19:12:16.250 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-08T19:12:16.356 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-08T19:12:16.443 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-08T19:12:16.549 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-08T19:12:16.634 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-08T19:12:16.742 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-08T19:12:16.827 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-08T19:12:16.933 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-08T19:12:17.029 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-08T19:12:17.125 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-08T19:12:17.222 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-08T19:12:17.309 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-08T19:12:17.426 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-08T19:12:17.501 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-08T19:12:17.617 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-08T19:12:17.691 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-08T19:12:17.809 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-08T19:12:17.884 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-08T19:12:18.000 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-08T19:12:18.084 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-08T19:12:18.201 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-08T19:12:18.276 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-08T19:12:18.394 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-08T19:12:18.469 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-08T19:12:18.595 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-08T19:12:18.661 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-08T19:12:18.787 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-08T19:12:18.851 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-08T19:12:18.979 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-08T19:12:19.043 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-08T19:12:19.169 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-08T19:12:19.233 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-08T19:12:19.360 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-08T19:12:19.423 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-08T19:12:19.560 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-08T19:12:19.614 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-08T19:12:19.752 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-08T19:12:19.805 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-08T19:12:19.942 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-08T19:12:19.995 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-08T19:12:20.133 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-08T19:12:20.186 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-08T19:12:20.335 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-08T19:12:20.377 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-08T19:12:20.525 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-08T19:12:20.578 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-08T19:12:20.715 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-08T19:12:20.769 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-08T19:12:20.905 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-08T19:12:20.958 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-08T19:12:21.106 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-08T19:12:21.149 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-08T19:12:21.295 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-08T19:12:21.348 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-08T19:12:21.484 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-08T19:12:21.538 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-08T19:12:21.681 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-08T19:12:21.736 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-08T19:12:21.873 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-08T19:12:21.933 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-08T19:12:22.073 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-08T19:12:22.126 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-08T19:12:22.265 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-08T19:12:23.428 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-10-08T19:12:23.648 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-10-08T19:12:24.819 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-10-08T19:12:25.081 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-10-08T19:12:26.182 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-10-08T19:12:26.412 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-10-08T19:12:27.477 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-10-08T19:12:27.794 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-10-08T19:12:28.742 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-10-08T19:12:29.202 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-10-08T19:12:30.047 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-10-08T19:12:30.245 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-08T19:12:30.434 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-08T19:12:30.623 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-08T19:12:30.634 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-10-08T19:12:30.812 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-08T19:12:30.834 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-08T19:12:31.011 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-08T19:12:31.022 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-08T19:12:31.202 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-08T19:12:31.213 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-08T19:12:31.392 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-08T19:12:31.414 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-08T19:12:31.582 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-08T19:12:31.614 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-08T19:12:31.773 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-08T19:12:31.795 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-08T19:12:31.963 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-08T19:12:31.999 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-08T19:12:32.022 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:32 +0000 (0:00:17.431) 0:01:36.048 ******** 2021-10-08T19:12:32.188 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-08T19:12:32.379 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-08T19:12:32.570 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "checksum": "12c5dc5e271ed86fec0116e9b72d51cbad447485", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e85382e2ab97f552f968a3d84b6a725a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633720352.1137192-17905-185360202467967/source", "state": "file", "uid": 0} TASK [Remove revoked users] **************************************************** ok: [smithi157.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-08T19:12:32.594 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:32 +0000 (0:00:00.571) 0:01:36.620 ******** 2021-10-08T19:12:32.654 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:32 +0000 (0:00:00.060) 0:01:36.680 ******** 2021-10-08T19:12:32.683 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi196.front.sepia.ceph.com] => { "msg": "Host smithi196.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-10-08T19:12:32.708 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:32 +0000 (0:00:00.053) 0:01:36.734 ******** 2021-10-08T19:12:32.713 INFO:teuthology.task.ansible.out: 2021-10-08T19:12:32.807 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-10-08T19:12:32.885 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} Friday 08 October 2021 19:12:32 +0000 (0:00:00.127) 0:01:36.861 ******** 2021-10-08T19:12:32.926 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:32.948 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:32 +0000 (0:00:00.112) 0:01:36.974 ******** 2021-10-08T19:12:33.260 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-10-08T19:12:33.262 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "checksum": "12c5dc5e271ed86fec0116e9b72d51cbad447485", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e85382e2ab97f552f968a3d84b6a725a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633720352.7569375-17995-114915715942786/source", "state": "file", "uid": 0} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.075280", "end": "2021-10-08 19:12:33.239497", "rc": 0, "start": "2021-10-08 19:12:33.164217", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-08T19:12:33.287 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.338) 0:01:37.313 ******** 2021-10-08T19:12:33.308 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.020) 0:01:37.333 ******** 2021-10-08T19:12:33.356 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi157.front.sepia.ceph.com] => { "msg": "Host smithi157.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-10-08T19:12:33.379 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.071) 0:01:37.405 ******** 2021-10-08T19:12:33.386 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:33.411 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.032) 0:01:37.437 ******** 2021-10-08T19:12:33.449 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-10-08T19:12:33.451 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-10-08T19:12:33.474 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.063) 0:01:37.500 ******** 2021-10-08T19:12:33.482 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-10-08T19:12:33.483 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:33.505 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.030) 0:01:37.531 ******** 2021-10-08T19:12:33.543 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-10-08T19:12:33.545 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:33.568 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.063) 0:01:37.594 ******** 2021-10-08T19:12:33.576 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-10-08T19:12:33.578 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:33.602 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.032) 0:01:37.627 ******** 2021-10-08T19:12:33.674 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-10-08T19:12:33.676 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:33.698 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.096) 0:01:37.724 ******** 2021-10-08T19:12:33.790 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-10-08T19:12:33.791 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:33.816 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.117) 0:01:37.842 ******** 2021-10-08T19:12:33.896 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-10-08T19:12:33.897 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.096310", "end": "2021-10-08 19:12:33.873866", "rc": 0, "start": "2021-10-08 19:12:33.777556", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:33.921 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.103) 0:01:37.946 ******** 2021-10-08T19:12:33.944 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:33 +0000 (0:00:00.023) 0:01:37.969 ******** 2021-10-08T19:12:34.010 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.032 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.088) 0:01:38.058 ******** 2021-10-08T19:12:34.038 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-08T19:12:34.040 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:34.064 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.032) 0:01:38.090 ******** 2021-10-08T19:12:34.104 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.128 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.062) 0:01:38.153 ******** 2021-10-08T19:12:34.146 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-10-08T19:12:34.148 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.180 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.052) 0:01:38.206 ******** 2021-10-08T19:12:34.211 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-10-08T19:12:34.212 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.234 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.054) 0:01:38.260 ******** 2021-10-08T19:12:34.263 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-10-08T19:12:34.265 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.287 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.052) 0:01:38.313 ******** 2021-10-08T19:12:34.324 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-10-08T19:12:34.326 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.348 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.061) 0:01:38.374 ******** 2021-10-08T19:12:34.367 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-10-08T19:12:34.369 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.391 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.043) 0:01:38.417 ******** 2021-10-08T19:12:34.418 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-10-08T19:12:34.420 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.442 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.051) 0:01:38.468 ******** 2021-10-08T19:12:34.470 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-10-08T19:12:34.472 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:34.494 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.052) 0:01:38.520 ******** 2021-10-08T19:12:34.527 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.558 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.063) 0:01:38.584 ******** 2021-10-08T19:12:34.576 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-10-08T19:12:34.578 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.601 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.042) 0:01:38.627 ******** 2021-10-08T19:12:34.640 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-08T19:12:34.642 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:34.665 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.063) 0:01:38.691 ******** 2021-10-08T19:12:34.673 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-10-08T19:12:34.675 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:34.699 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.033) 0:01:38.725 ******** 2021-10-08T19:12:34.739 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-10-08T19:12:34.740 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.777 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.079) 0:01:38.804 ******** 2021-10-08T19:12:34.786 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-10-08T19:12:34.788 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.813 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.034) 0:01:38.839 ******** 2021-10-08T19:12:34.852 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-10-08T19:12:34.854 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.877 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.064) 0:01:38.903 ******** 2021-10-08T19:12:34.894 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-10-08T19:12:34.896 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.918 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.041) 0:01:38.944 ******** 2021-10-08T19:12:34.945 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-10-08T19:12:34.947 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:34.969 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:34 +0000 (0:00:00.051) 0:01:38.995 ******** 2021-10-08T19:12:34.987 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-10-08T19:12:34.988 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.011 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.041) 0:01:39.037 ******** 2021-10-08T19:12:35.039 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-10-08T19:12:35.041 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:35.064 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.053) 0:01:39.090 ******** 2021-10-08T19:12:35.083 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-10-08T19:12:35.085 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.117 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.053) 0:01:39.144 ******** 2021-10-08T19:12:35.135 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-10-08T19:12:35.137 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.160 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.042) 0:01:39.186 ******** 2021-10-08T19:12:35.191 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-10-08T19:12:35.192 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:35.214 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.054) 0:01:39.240 ******** 2021-10-08T19:12:35.232 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:35.258 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.044) 0:01:39.284 ******** 2021-10-08T19:12:35.288 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-08T19:12:35.289 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.317 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.054) 0:01:39.339 ******** 2021-10-08T19:12:35.341 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.369 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.055) 0:01:39.395 ******** 2021-10-08T19:12:35.386 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-10-08T19:12:35.388 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.410 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.041) 0:01:39.436 ******** 2021-10-08T19:12:35.448 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-10-08T19:12:35.450 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.474 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.063) 0:01:39.500 ******** 2021-10-08T19:12:35.477 INFO:teuthology.task.ansible.out: 2021-10-08T19:12:35.494 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-10-08T19:12:35.496 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.523 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.048) 0:01:39.548 ******** 2021-10-08T19:12:35.553 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.578 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.055) 0:01:39.604 ******** 2021-10-08T19:12:35.584 INFO:teuthology.task.ansible.out: 2021-10-08T19:12:35.597 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-10-08T19:12:35.599 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.621 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.043) 0:01:39.647 ******** 2021-10-08T19:12:35.676 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-10-08T19:12:35.679 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.700 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.079) 0:01:39.726 ******** 2021-10-08T19:12:35.710 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.734 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.034) 0:01:39.761 ******** 2021-10-08T19:12:35.786 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-10-08T19:12:35.788 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:35.814 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.079) 0:01:39.840 ******** 2021-10-08T19:12:35.833 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-10-08T19:12:35.835 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.857 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.043) 0:01:39.883 ******** 2021-10-08T19:12:35.896 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-08T19:12:35.898 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:35.927 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.069) 0:01:39.953 ******** 2021-10-08T19:12:35.944 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-10-08T19:12:35.945 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:35.969 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:35 +0000 (0:00:00.042) 0:01:39.995 ******** 2021-10-08T19:12:36.002 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:36.024 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.054) 0:01:40.050 ******** 2021-10-08T19:12:36.043 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-10-08T19:12:36.046 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:36.068 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.044) 0:01:40.094 ******** 2021-10-08T19:12:36.097 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-10-08T19:12:36.099 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:36.121 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.052) 0:01:40.147 ******** 2021-10-08T19:12:36.152 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:36.184 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.062) 0:01:40.210 ******** 2021-10-08T19:12:36.202 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:36.226 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.042) 0:01:40.253 ******** 2021-10-08T19:12:36.319 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:36.343 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.116) 0:01:40.369 ******** 2021-10-08T19:12:36.413 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-10-08T19:12:36.414 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:36.436 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.092) 0:01:40.462 ******** 2021-10-08T19:12:36.484 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-10-08T19:12:36.486 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:12:36.509 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.073) 0:01:40.535 ******** 2021-10-08T19:12:36.527 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-10-08T19:12:36.529 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:12:36.551 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.042) 0:01:40.577 ******** 2021-10-08T19:12:36.623 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:36.648 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.096) 0:01:40.674 ******** 2021-10-08T19:12:36.728 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-08T19:12:36.730 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:36.751 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:36 +0000 (0:00:00.102) 0:01:40.777 ******** 2021-10-08T19:12:37.040 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-10-08T19:12:37.042 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:12:37.066 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:37 +0000 (0:00:00.315) 0:01:41.092 ******** 2021-10-08T19:12:37.068 INFO:teuthology.task.ansible.out: 2021-10-08T19:12:37.277 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi196.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-10-08T19:12:37.634 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-10-08T19:12:37.719 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-10-08T19:12:37.747 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:37 +0000 (0:00:00.680) 0:01:41.773 ******** 2021-10-08T19:12:38.138 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-10-08T19:12:38.168 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:38 +0000 (0:00:00.418) 0:01:42.192 ******** 2021-10-08T19:12:38.377 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi196.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-10-08T19:12:38.807 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-10-08T19:12:38.928 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-10-08T19:12:38.951 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:38 +0000 (0:00:00.784) 0:01:42.977 ******** 2021-10-08T19:12:39.048 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.072 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.120) 0:01:43.097 ******** 2021-10-08T19:12:39.152 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.177 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.105) 0:01:43.203 ******** 2021-10-08T19:12:39.275 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-10-08T19:12:39.277 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.302 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.122) 0:01:43.325 ******** 2021-10-08T19:12:39.380 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi157.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-10-08T19:12:39.404 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.104) 0:01:43.430 ******** 2021-10-08T19:12:39.426 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.022) 0:01:43.452 ******** 2021-10-08T19:12:39.487 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-08T19:12:39.489 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.511 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.084) 0:01:43.537 ******** 2021-10-08T19:12:39.523 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-08T19:12:39.527 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.554 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.039) 0:01:43.576 ******** 2021-10-08T19:12:39.581 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-08T19:12:39.587 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.604 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.054) 0:01:43.630 ******** 2021-10-08T19:12:39.623 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.651 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.041) 0:01:43.672 ******** 2021-10-08T19:12:39.690 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.721 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.069) 0:01:43.742 ******** 2021-10-08T19:12:39.734 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-10-08T19:12:39.737 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.759 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.043) 0:01:43.785 ******** 2021-10-08T19:12:39.809 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.841 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.078) 0:01:43.864 ******** 2021-10-08T19:12:39.845 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-10-08T19:12:39.847 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.871 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.033) 0:01:43.897 ******** 2021-10-08T19:12:39.930 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-08T19:12:39.932 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.932 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.943 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.945 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.966 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.094) 0:01:43.992 ******** 2021-10-08T19:12:39.973 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-10-08T19:12:39.975 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:39.997 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:39 +0000 (0:00:00.030) 0:01:44.023 ******** 2021-10-08T19:12:40.024 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-08T19:12:40.026 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:40.049 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:40 +0000 (0:00:00.052) 0:01:44.076 ******** 2021-10-08T19:12:40.078 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-10-08T19:12:40.080 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:40.101 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:40 +0000 (0:00:00.051) 0:01:44.127 ******** 2021-10-08T19:12:40.118 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:40.143 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:40 +0000 (0:00:00.042) 0:01:44.169 ******** 2021-10-08T19:12:40.218 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:40.240 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:40 +0000 (0:00:00.096) 0:01:44.266 ******** 2021-10-08T19:12:40.311 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:40.336 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:40 +0000 (0:00:00.096) 0:01:44.362 ******** 2021-10-08T19:12:40.408 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-10-08T19:12:40.410 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:40.433 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:40 +0000 (0:00:00.095) 0:01:44.458 ******** 2021-10-08T19:12:40.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.228013", "end": "2021-10-08 19:12:40.500333", "rc": 0, "start": "2021-10-08 19:12:40.272320", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:40.551 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:40 +0000 (0:00:00.119) 0:01:44.577 ******** 2021-10-08T19:12:41.515 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.897620", "end": "2021-10-08 19:12:41.500440", "rc": 0, "start": "2021-10-08 19:12:40.602820", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:12:41.538 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:41 +0000 (0:00:00.986) 0:01:45.564 ******** 2021-10-08T19:12:44.330 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-10-08T19:12:44.332 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:44.353 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:44 +0000 (0:00:02.815) 0:01:48.379 ******** 2021-10-08T19:12:44.443 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-10-08T19:12:44.445 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:44.466 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:44 +0000 (0:00:00.112) 0:01:48.492 ******** 2021-10-08T19:12:44.536 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-10-08T19:12:44.538 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:44.560 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:44 +0000 (0:00:00.093) 0:01:48.586 ******** 2021-10-08T19:12:44.629 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-08T19:12:44.631 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:44.651 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:44 +0000 (0:00:00.091) 0:01:48.677 ******** 2021-10-08T19:12:44.679 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-10-08T19:12:44.681 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:44.705 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:44 +0000 (0:00:00.053) 0:01:48.731 ******** 2021-10-08T19:12:44.723 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:44.748 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:44 +0000 (0:00:00.042) 0:01:48.774 ******** 2021-10-08T19:12:44.776 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-10-08T19:12:44.778 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:44.801 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:44 +0000 (0:00:00.053) 0:01:48.827 ******** 2021-10-08T19:12:44.872 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:44.897 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:44 +0000 (0:00:00.095) 0:01:48.923 ******** 2021-10-08T19:12:44.968 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-08T19:12:44.969 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:44.992 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:44 +0000 (0:00:00.093) 0:01:49.017 ******** 2021-10-08T19:12:45.051 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-10-08T19:12:45.052 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:45.074 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:45 +0000 (0:00:00.082) 0:01:49.100 ******** 2021-10-08T19:12:45.229 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-10-08T19:12:45.253 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:45 +0000 (0:00:00.178) 0:01:49.279 ******** 2021-10-08T19:12:45.563 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-10-08T19:12:45.586 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:45 +0000 (0:00:00.333) 0:01:49.612 ******** 2021-10-08T19:12:46.597 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-10-08T19:12:46.598 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:46.620 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:46 +0000 (0:00:01.033) 0:01:50.646 ******** 2021-10-08T19:12:46.899 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:46.922 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:46 +0000 (0:00:00.301) 0:01:50.948 ******** 2021-10-08T19:12:47.141 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-08T19:12:47.144 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-10-08T19:12:47.452 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-10-08T19:12:47.578 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-10-08T19:12:47.898 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-10-08T19:12:48.003 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-10-08T19:12:48.034 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:48 +0000 (0:00:01.111) 0:01:52.060 ******** 2021-10-08T19:12:48.223 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-08T19:12:48.225 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:12:48.246 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:48 +0000 (0:00:00.212) 0:01:52.272 ******** 2021-10-08T19:12:48.316 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-08T19:12:48.317 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-10-08T19:12:48.342 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:48 +0000 (0:00:00.096) 0:01:52.368 ******** 2021-10-08T19:12:48.538 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-08T19:12:48.540 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:12:48.567 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:48 +0000 (0:00:00.225) 0:01:52.593 ******** 2021-10-08T19:12:48.747 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-08T19:12:48.749 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-10-08T19:12:49.065 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-10-08T19:12:49.164 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-10-08T19:12:49.508 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-10-08T19:12:49.594 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-10-08T19:12:49.622 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:49 +0000 (0:00:01.054) 0:01:53.648 ******** 2021-10-08T19:12:49.704 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-08T19:12:49.706 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:49.726 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:49 +0000 (0:00:00.104) 0:01:53.752 ******** 2021-10-08T19:12:49.815 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-10-08T19:12:49.818 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-10-08T19:12:49.839 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:49 +0000 (0:00:00.112) 0:01:53.865 ******** 2021-10-08T19:12:49.940 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-08T19:12:49.942 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-10-08T19:12:49.966 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:49 +0000 (0:00:00.127) 0:01:53.992 ******** 2021-10-08T19:12:50.046 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-08T19:12:50.048 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:50.068 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:50 +0000 (0:00:00.102) 0:01:54.094 ******** 2021-10-08T19:12:50.106 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-10-08T19:12:50.108 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:12:50.131 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:50 +0000 (0:00:00.062) 0:01:54.157 ******** 2021-10-08T19:12:50.158 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-10-08T19:12:50.160 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-10-08T19:12:50.183 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:50 +0000 (0:00:00.051) 0:01:54.209 ******** 2021-10-08T19:12:50.223 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi196.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:50.246 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:50.256 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:50.268 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:50.293 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:50 +0000 (0:00:00.110) 0:01:54.319 ******** 2021-10-08T19:12:50.429 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-10-08T19:12:50.431 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:12:50.452 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:50 +0000 (0:00:00.158) 0:01:54.478 ******** 2021-10-08T19:12:50.544 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-08T19:12:50.546 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:50.566 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:50.587 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:50.599 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:50.625 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:50 +0000 (0:00:00.170) 0:01:54.649 ******** 2021-10-08T19:12:51.617 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:51.641 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:51 +0000 (0:00:01.018) 0:01:55.667 ******** 2021-10-08T19:12:51.722 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-10-08T19:12:51.724 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:51.746 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:51 +0000 (0:00:00.103) 0:01:55.770 ******** 2021-10-08T19:12:51.936 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:51.963 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:51 +0000 (0:00:00.218) 0:01:55.989 ******** 2021-10-08T19:12:52.042 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-10-08T19:12:52.044 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:52.067 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:52 +0000 (0:00:00.103) 0:01:56.093 ******** 2021-10-08T19:12:52.259 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-10-08T19:12:52.299 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:52 +0000 (0:00:00.231) 0:01:56.325 ******** 2021-10-08T19:12:52.575 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-10-08T19:12:52.598 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:52 +0000 (0:00:00.299) 0:01:56.624 ******** 2021-10-08T19:12:52.807 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-10-08T19:12:52.808 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-10-08T19:12:52.832 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:52 +0000 (0:00:00.233) 0:01:56.858 ******** 2021-10-08T19:12:52.934 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-08T19:12:52.935 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:52.945 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:52.968 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:52 +0000 (0:00:00.135) 0:01:56.994 ******** 2021-10-08T19:12:53.110 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-10-08T19:12:53.112 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-10-08T19:12:53.135 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:53 +0000 (0:00:00.167) 0:01:57.161 ******** 2021-10-08T19:12:53.196 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:12:53.222 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:53 +0000 (0:00:00.086) 0:01:57.248 ******** 2021-10-08T19:12:53.256 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-08T19:12:53.257 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:53.267 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:12:53.301 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:53 +0000 (0:00:00.079) 0:01:57.327 ******** 2021-10-08T19:12:53.540 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-10-08T19:12:53.541 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [common : Check firewalld status] ***************************************** fatal: [smithi196.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-10-08T19:12:53.564 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:53 +0000 (0:00:00.262) 0:01:57.590 ******** 2021-10-08T19:12:53.585 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:53 +0000 (0:00:00.021) 0:01:57.611 ******** 2021-10-08T19:12:53.667 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-10-08T19:12:53.669 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:53.691 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:53 +0000 (0:00:00.106) 0:01:57.717 ******** 2021-10-08T19:12:53.850 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-10-08T19:12:53.852 INFO:teuthology.task.ansible.out:fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-10-08T19:12:53.874 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:53 +0000 (0:00:00.182) 0:01:57.900 ******** 2021-10-08T19:12:53.966 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-10-08T19:12:53.968 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:12:53.990 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:53 +0000 (0:00:00.116) 0:01:58.016 ******** 2021-10-08T19:12:54.200 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-10-08T19:12:54.202 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-10-08T19:12:54.227 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:54 +0000 (0:00:00.236) 0:01:58.253 ******** 2021-10-08T19:12:54.508 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-10-08T19:12:54.530 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:54 +0000 (0:00:00.302) 0:01:58.556 ******** 2021-10-08T19:12:54.970 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-08T19:12:54.972 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1306", "ExecMainStartTimestamp": "Fri 2021-10-08 19:10:48 UTC", "ExecMainStartTimestampMonotonic": "20294221", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Fri 2021-10-08 19:10:48 UTC] ; stop_time=[n/a] ; pid=1306 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2021-10-08T19:12:54.974 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1306", "MemoryAccounting": "yes", "MemoryCurrent": "696320", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "98 2021-10-08T19:12:54.975 INFO:teuthology.task.ansible.out:8", "UMask": "0022", "WatchdogTimestamp": "Fri 2021-10-08 19:10:48 UTC", "WatchdogTimestampMonotonic": "20294271", "WatchdogUSec": "0"}} ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1241", "ExecMainStartTimestamp": "Fri 2021-10-08 19:10:34 UTC", "ExecMainStartTimestampMonotonic": "20667783", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Fri 2021-10-08 19:10:34 UTC] ; stop_time=[n/a] ; pid=1241 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", 2021-10-08T19:12:54.977 INFO:teuthology.task.ansible.out:"LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1241", "MemoryAccounting": "yes", "MemoryCurrent": "679936", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1" 2021-10-08T19:12:54.978 INFO:teuthology.task.ansible.out:, "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Fri 2021-10-08 19:10:34 UTC", "WatchdogTimestampMonotonic": "20667815", "WatchdogUSec": "0"}} 2021-10-08T19:12:54.998 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:54 +0000 (0:00:00.467) 0:01:59.024 ******** 2021-10-08T19:12:55.020 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:55 +0000 (0:00:00.022) 0:01:59.046 ******** 2021-10-08T19:12:55.237 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-10-08T19:12:55.239 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001809", "end": "2021-10-08 19:12:55.218745", "rc": 0, "start": "2021-10-08 19:12:55.216936", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-10-08T19:12:55.262 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:55 +0000 (0:00:00.241) 0:01:59.288 ******** 2021-10-08T19:12:55.272 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001723", "end": "2021-10-08 19:12:55.237173", "rc": 0, "start": "2021-10-08 19:12:55.235450", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-10-08T19:12:55.297 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:55 +0000 (0:00:00.035) 0:01:59.323 ******** 2021-10-08T19:12:56.605 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-10-08T19:12:56.606 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:56.628 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:56 +0000 (0:00:01.330) 0:02:00.654 ******** 2021-10-08T19:12:56.646 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:12:56.672 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:12:56 +0000 (0:00:00.043) 0:02:00.698 ******** 2021-10-08T19:13:34.069 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-10-08T19:13:34.071 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8_4.2.noarch", "Installed: selinux-policy-3.14.3-67.el8_4.2.noarch", "Removed: selinux-policy-3.14.3-67.el8_4.1.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8_4.1.noarch"]} 2021-10-08T19:13:34.094 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:34 +0000 (0:00:37.422) 0:02:38.121 ******** 2021-10-08T19:13:34.377 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8_4.2.noarch", "Installed: selinux-policy-3.14.3-67.el8_4.2.noarch", "Removed: selinux-policy-3.14.3-67.el8_4.1.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8_4.1.noarch"]} 2021-10-08T19:13:34.403 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:34 +0000 (0:00:00.308) 0:02:38.429 ******** 2021-10-08T19:13:34.846 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-10-08T19:13:34.848 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-10-08T19:13:34.869 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:34 +0000 (0:00:00.466) 0:02:38.895 ******** 2021-10-08T19:13:34.907 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-10-08T19:13:34.931 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:34 +0000 (0:00:00.061) 0:02:38.957 ******** 2021-10-08T19:13:49.719 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:14.617768", "end": "2021-10-08 19:13:49.700270", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:13:35.082502", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-10-08T19:13:49.742 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:49 +0000 (0:00:14.811) 0:02:53.768 ******** 2021-10-08T19:13:49.762 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:14.587110", "end": "2021-10-08 19:13:49.741741", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:13:35.154631", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-10-08T19:13:49.785 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:49 +0000 (0:00:00.042) 0:02:53.811 ******** 2021-10-08T19:13:50.245 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-10-08T19:13:50.246 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-10-08T19:13:50.268 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:50 +0000 (0:00:00.483) 0:02:54.295 ******** 2021-10-08T19:13:50.287 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-10-08T19:13:50.311 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:50 +0000 (0:00:00.042) 0:02:54.337 ******** 2021-10-08T19:13:50.539 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-10-08T19:13:50.541 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016811", "end": "2021-10-08 19:13:50.517179", "rc": 0, "start": "2021-10-08 19:13:50.500368", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:13:50.564 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:50 +0000 (0:00:00.252) 0:02:54.589 ******** 2021-10-08T19:13:50.571 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013994", "end": "2021-10-08 19:13:50.539844", "rc": 0, "start": "2021-10-08 19:13:50.525850", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:13:50.598 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:50 +0000 (0:00:00.033) 0:02:54.623 ******** 2021-10-08T19:13:50.817 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-10-08T19:13:50.819 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.012006", "end": "2021-10-08 19:13:50.797514", "rc": 0, "start": "2021-10-08 19:13:50.785508", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:13:50.841 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:50 +0000 (0:00:00.244) 0:02:54.867 ******** 2021-10-08T19:13:50.849 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.021685", "end": "2021-10-08 19:13:50.825576", "rc": 0, "start": "2021-10-08 19:13:50.803891", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:13:50.874 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:13:50 +0000 (0:00:00.033) 0:02:54.901 ******** 2021-10-08T19:14:05.578 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-10-08T19:14:05.580 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:14.500873", "end": "2021-10-08 19:14:05.549099", "rc": 0, "start": "2021-10-08 19:13:51.048226", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:05.603 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:05 +0000 (0:00:14.728) 0:03:09.629 ******** 2021-10-08T19:14:05.729 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:14.624361", "end": "2021-10-08 19:14:05.707790", "rc": 0, "start": "2021-10-08 19:13:51.083429", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:05.753 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:05 +0000 (0:00:00.150) 0:03:09.779 ******** 2021-10-08T19:14:05.855 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-08T19:14:05.857 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-10-08T19:14:05.880 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:05 +0000 (0:00:00.127) 0:03:09.906 ******** 2021-10-08T19:14:05.951 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-10-08T19:14:05.974 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:05 +0000 (0:00:00.094) 0:03:10.001 ******** 2021-10-08T19:14:05.992 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-08T19:14:05.993 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-10-08T19:14:06.020 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.045) 0:03:10.046 ******** 2021-10-08T19:14:06.063 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:14:06.085 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.065) 0:03:10.111 ******** 2021-10-08T19:14:06.112 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-10-08T19:14:06.114 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-10-08T19:14:06.139 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.053) 0:03:10.165 ******** 2021-10-08T19:14:06.172 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-10-08T19:14:06.173 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "CentOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "a 2021-10-08T19:14:06.175 INFO:teuthology.task.ansible.out:nsible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-10-08T19:14:06.198 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.059) 0:03:10.224 ******** 2021-10-08T19:14:06.229 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-10-08T19:14:06.230 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:14:06.269 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.070) 0:03:10.295 ******** 2021-10-08T19:14:06.280 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-10-08T19:14:06.282 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:14:06.319 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.050) 0:03:10.345 ******** 2021-10-08T19:14:06.352 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-10-08T19:14:06.353 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "CentOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "a 2021-10-08T19:14:06.355 INFO:teuthology.task.ansible.out:nsible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-10-08T19:14:06.384 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.064) 0:03:10.410 ******** 2021-10-08T19:14:06.478 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-10-08T19:14:06.481 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:14:06.504 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.120) 0:03:10.530 ******** 2021-10-08T19:14:06.527 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:14:06.555 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.051) 0:03:10.581 ******** 2021-10-08T19:14:06.703 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:14:06.725 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.169) 0:03:10.751 ******** 2021-10-08T19:14:06.801 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:06.801 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-10-08T19:14:06.802 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "name": "ubuntu", "state": "present", "system": false} 2021-10-08T19:14:06.828 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.102) 0:03:10.854 ******** 2021-10-08T19:14:06.910 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:06.933 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.104) 0:03:10.958 ******** 2021-10-08T19:14:06.960 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-10-08T19:14:06.963 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "name": "ubuntu", "state": "present", "system": false} 2021-10-08T19:14:06.986 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:06 +0000 (0:00:00.054) 0:03:11.013 ******** 2021-10-08T19:14:06.988 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:07.008 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-10-08T19:14:07.010 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:07.036 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:07 +0000 (0:00:00.049) 0:03:11.062 ******** 2021-10-08T19:14:07.054 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-10-08T19:14:07.055 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:07.082 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:07 +0000 (0:00:00.043) 0:03:11.105 ******** 2021-10-08T19:14:07.171 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-10-08T19:14:07.173 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:07.196 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:07 +0000 (0:00:00.116) 0:03:11.222 ******** 2021-10-08T19:14:07.301 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi196.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-10-08T19:14:07.324 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:07 +0000 (0:00:00.128) 0:03:11.350 ******** 2021-10-08T19:14:07.465 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-10-08T19:14:07.489 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:07 +0000 (0:00:00.165) 0:03:11.515 ******** 2021-10-08T19:14:07.963 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-10-08T19:14:07.964 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-10-08T19:14:07.986 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:07 +0000 (0:00:00.496) 0:03:12.012 ******** 2021-10-08T19:14:08.079 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi196"}, "changed": false} 2021-10-08T19:14:08.100 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:08 +0000 (0:00:00.113) 0:03:12.126 ******** 2021-10-08T19:14:08.118 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-10-08T19:14:08.146 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:08 +0000 (0:00:00.046) 0:03:12.172 ******** 2021-10-08T19:14:08.229 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-10-08T19:14:08.231 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi157"}, "changed": false} 2021-10-08T19:14:08.254 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:08 +0000 (0:00:00.107) 0:03:12.280 ******** 2021-10-08T19:14:09.049 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi157.front.sepia.ceph.com", "ansible_hostname": "smithi157", "ansible_nodename": "smithi157"}, "changed": true, "name": "smithi157"} changed: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi196.front.sepia.ceph.com", "ansible_hostname": "smithi196", "ansible_nodename": "smithi196"}, "changed": true, "name": "smithi196"} 2021-10-08T19:14:09.074 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:09 +0000 (0:00:00.816) 0:03:13.096 ******** 2021-10-08T19:14:09.090 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:09 +0000 (0:00:00.019) 0:03:13.116 ******** 2021-10-08T19:14:09.577 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-10-08T19:14:09.600 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:09 +0000 (0:00:00.510) 0:03:13.626 ******** 2021-10-08T19:14:09.640 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-10-08T19:14:09.665 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:09 +0000 (0:00:00.064) 0:03:13.691 ******** 2021-10-08T19:14:10.126 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-10-08T19:14:10.136 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-10-08T19:14:10.151 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:10 +0000 (0:00:00.485) 0:03:14.177 ******** 2021-10-08T19:14:10.202 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-10-08T19:14:10.231 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:10 +0000 (0:00:00.073) 0:03:14.250 ******** 2021-10-08T19:14:10.732 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi157.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-08T19:14:10.760 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:10 +0000 (0:00:00.534) 0:03:14.785 ******** 2021-10-08T19:14:10.807 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-08T19:14:10.834 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:10 +0000 (0:00:00.063) 0:03:14.849 ******** 2021-10-08T19:14:11.318 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-10-08T19:14:11.325 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-10-08T19:14:11.345 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:11 +0000 (0:00:00.521) 0:03:15.371 ******** 2021-10-08T19:14:11.398 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-10-08T19:14:11.425 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:11 +0000 (0:00:00.079) 0:03:15.450 ******** 2021-10-08T19:14:11.595 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:14:11.618 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:11 +0000 (0:00:00.194) 0:03:15.644 ******** 2021-10-08T19:14:11.669 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:14:11.711 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:11 +0000 (0:00:00.090) 0:03:15.735 ******** 2021-10-08T19:14:11.865 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-08T19:14:11.867 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-10-08T19:14:11.892 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:11 +0000 (0:00:00.182) 0:03:15.917 ******** 2021-10-08T19:14:11.964 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-10-08T19:14:11.989 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:11 +0000 (0:00:00.098) 0:03:16.015 ******** 2021-10-08T19:14:12.187 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi157.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1254, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-08T19:14:12.211 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:12 +0000 (0:00:00.221) 0:03:16.236 ******** 2021-10-08T19:14:12.278 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1254, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-08T19:14:12.315 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:12 +0000 (0:00:00.102) 0:03:16.339 ******** 2021-10-08T19:14:12.815 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-10-08T19:14:12.839 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:12 +0000 (0:00:00.523) 0:03:16.862 ******** 2021-10-08T19:14:12.883 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-10-08T19:14:12.915 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:12 +0000 (0:00:00.077) 0:03:16.939 ******** 2021-10-08T19:14:13.447 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-10-08T19:14:13.470 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:13 +0000 (0:00:00.557) 0:03:17.496 ******** 2021-10-08T19:14:13.492 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-10-08T19:14:13.522 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:13 +0000 (0:00:00.049) 0:03:17.545 ******** 2021-10-08T19:14:15.944 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.240653", "end": "2021-10-08 19:14:15.920920", "rc": 0, "start": "2021-10-08 19:14:13.680267", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:15.969 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:15 +0000 (0:00:02.447) 0:03:19.993 ******** 2021-10-08T19:14:16.040 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.225501", "end": "2021-10-08 19:14:16.009410", "rc": 0, "start": "2021-10-08 19:14:13.783909", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:16.064 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:16 +0000 (0:00:00.095) 0:03:20.089 ******** 2021-10-08T19:14:16.077 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:16.095 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:16 +0000 (0:00:00.032) 0:03:20.121 ******** 2021-10-08T19:14:16.139 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:16.164 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:16 +0000 (0:00:00.069) 0:03:20.191 ******** 2021-10-08T19:14:16.182 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:14:16.184 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:16.209 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:16 +0000 (0:00:00.042) 0:03:20.233 ******** 2021-10-08T19:14:16.248 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:16.274 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:16 +0000 (0:00:00.066) 0:03:20.300 ******** 2021-10-08T19:14:16.292 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-10-08T19:14:16.294 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:16.319 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:16 +0000 (0:00:00.043) 0:03:20.344 ******** 2021-10-08T19:14:16.359 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:16.388 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:16 +0000 (0:00:00.070) 0:03:20.415 ******** 2021-10-08T19:14:16.859 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-10-08T19:14:16.861 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-10-08T19:14:16.924 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-10-08T19:14:17.319 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-10-08T19:14:17.423 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-10-08T19:14:17.877 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-10-08T19:14:17.955 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-10-08T19:14:18.350 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-10-08T19:14:18.378 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:18 +0000 (0:00:01.988) 0:03:22.403 ******** 2021-10-08T19:14:18.397 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-10-08T19:14:18.429 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:18 +0000 (0:00:00.051) 0:03:22.455 ******** 2021-10-08T19:14:18.892 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-08T19:14:18.894 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-10-08T19:14:18.919 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:18 +0000 (0:00:00.489) 0:03:22.944 ******** 2021-10-08T19:14:18.956 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-10-08T19:14:18.983 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:18 +0000 (0:00:00.063) 0:03:23.007 ******** 2021-10-08T19:14:19.434 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-08T19:14:19.436 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-10-08T19:14:19.492 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-10-08T19:14:19.894 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-10-08T19:14:19.945 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-10-08T19:14:20.334 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-10-08T19:14:20.388 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-10-08T19:14:20.763 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "state": "file", "uid": 0} 2021-10-08T19:14:20.790 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:20 +0000 (0:00:01.808) 0:03:24.816 ******** 2021-10-08T19:14:20.830 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "state": "file", "uid": 0} 2021-10-08T19:14:20.864 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:20 +0000 (0:00:00.070) 0:03:24.887 ******** 2021-10-08T19:14:21.356 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-10-08T19:14:21.358 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.313071", "end": "2021-10-08 19:14:21.334043", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-10-08 19:14:21.020972", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'comma 2021-10-08T19:14:21.360 INFO:teuthology.task.ansible.out:nd_warnings=False' in ansible.cfg to get rid of this message. 2021-10-08T19:14:21.382 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.520) 0:03:25.408 ******** 2021-10-08T19:14:21.432 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.323668", "end": "2021-10-08 19:14:21.407533", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-10-08 19:14:21.083865", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2021-10-08T19:14:21.456 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.074) 0:03:25.482 ******** 2021-10-08T19:14:21.462 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-10-08T19:14:21.464 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:21.487 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.031) 0:03:25.513 ******** 2021-10-08T19:14:21.526 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:21.550 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.062) 0:03:25.576 ******** 2021-10-08T19:14:21.569 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-10-08T19:14:21.570 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:21.607 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.057) 0:03:25.633 ******** 2021-10-08T19:14:21.637 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:21.639 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:21.665 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.057) 0:03:25.691 ******** 2021-10-08T19:14:21.686 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:21.710 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.045) 0:03:25.736 ******** 2021-10-08T19:14:21.738 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:21.762 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.052) 0:03:25.788 ******** 2021-10-08T19:14:21.791 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-10-08T19:14:21.814 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.051) 0:03:25.840 ******** 2021-10-08T19:14:21.844 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-10-08T19:14:21.868 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.054) 0:03:25.894 ******** 2021-10-08T19:14:21.898 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-10-08T19:14:21.900 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:21.921 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.052) 0:03:25.947 ******** 2021-10-08T19:14:21.959 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:21.988 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:21 +0000 (0:00:00.067) 0:03:26.014 ******** 2021-10-08T19:14:22.006 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-10-08T19:14:22.008 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:22.032 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:22 +0000 (0:00:00.044) 0:03:26.059 ******** 2021-10-08T19:14:22.036 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:22.062 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:22.089 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:22 +0000 (0:00:00.056) 0:03:26.115 ******** 2021-10-08T19:14:22.275 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-10-08T19:14:22.277 INFO:teuthology.task.ansible.out:fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006537", "end": "2021-10-08 19:14:22.251590", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:14:22.245053", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-10-08T19:14:22.301 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:22 +0000 (0:00:00.212) 0:03:26.327 ******** 2021-10-08T19:14:22.329 INFO:teuthology.task.ansible.out:fatal: [smithi196.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006609", "end": "2021-10-08 19:14:22.311528", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:14:22.304919", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-10-08T19:14:22.356 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:22 +0000 (0:00:00.054) 0:03:26.381 ******** 2021-10-08T19:14:22.373 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-10-08T19:14:22.376 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:22.398 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:22 +0000 (0:00:00.042) 0:03:26.424 ******** 2021-10-08T19:14:22.440 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:22.466 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:22 +0000 (0:00:00.067) 0:03:26.491 ******** 2021-10-08T19:14:26.368 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-10-08T19:14:26.389 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:26 +0000 (0:00:03.923) 0:03:30.415 ******** 2021-10-08T19:14:26.399 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-10-08T19:14:26.423 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:26 +0000 (0:00:00.033) 0:03:30.449 ******** 2021-10-08T19:14:26.425 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:28.809 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-10-08T19:14:28.831 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:28 +0000 (0:00:02.408) 0:03:32.857 ******** 2021-10-08T19:14:28.840 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-10-08T19:14:28.866 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:28 +0000 (0:00:00.035) 0:03:32.892 ******** 2021-10-08T19:14:35.794 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:14:35.796 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-img-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-10-08T19:14:35.822 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:35 +0000 (0:00:06.953) 0:03:39.845 ******** 2021-10-08T19:14:35.902 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-10-08T19:14:35.904 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:35.926 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:35 +0000 (0:00:00.105) 0:03:39.951 ******** 2021-10-08T19:14:36.033 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-img-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-10-08T19:14:36.064 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:36 +0000 (0:00:00.138) 0:03:40.089 ******** 2021-10-08T19:14:36.146 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-10-08T19:14:36.148 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:36.170 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:36 +0000 (0:00:00.107) 0:03:40.197 ******** 2021-10-08T19:14:37.361 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-08T19:14:37.363 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:14:37.386 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:37 +0000 (0:00:01.215) 0:03:41.412 ******** 2021-10-08T19:14:37.607 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:14:37.630 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:37 +0000 (0:00:00.243) 0:03:41.656 ******** 2021-10-08T19:14:38.716 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-08T19:14:38.718 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:14:38.740 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:38 +0000 (0:00:01.109) 0:03:42.766 ******** 2021-10-08T19:14:38.980 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:14:39.003 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:39 +0000 (0:00:00.263) 0:03:43.029 ******** 2021-10-08T19:14:39.105 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-10-08T19:14:39.107 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", 2021-10-08T19:14:39.109 INFO:teuthology.task.ansible.out:"LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-08T19:14:39.133 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:39 +0000 (0:00:00.129) 0:03:43.158 ******** 2021-10-08T19:14:39.352 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", 2021-10-08T19:14:39.354 INFO:teuthology.task.ansible.out:"LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-08T19:14:39.376 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:39 +0000 (0:00:00.243) 0:03:43.402 ******** 2021-10-08T19:14:39.468 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-10-08T19:14:39.470 INFO:teuthology.task.ansible.out:fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-10-08T19:14:39.492 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:39 +0000 (0:00:00.116) 0:03:43.518 ******** 2021-10-08T19:14:39.722 INFO:teuthology.task.ansible.out:fatal: [smithi196.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-10-08T19:14:39.750 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:39 +0000 (0:00:00.255) 0:03:43.774 ******** 2021-10-08T19:14:40.197 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-08T19:14:40.198 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-10-08T19:14:40.220 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.471) 0:03:44.246 ******** 2021-10-08T19:14:40.241 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.020) 0:03:44.267 ******** 2021-10-08T19:14:40.304 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.325 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.084) 0:03:44.352 ******** 2021-10-08T19:14:40.347 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.020) 0:03:44.372 ******** 2021-10-08T19:14:40.396 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.419 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.072) 0:03:44.445 ******** 2021-10-08T19:14:40.428 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.455 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.035) 0:03:44.481 ******** 2021-10-08T19:14:40.496 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.522 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.067) 0:03:44.549 ******** 2021-10-08T19:14:40.530 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.560 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.037) 0:03:44.586 ******** 2021-10-08T19:14:40.610 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.637 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.076) 0:03:44.663 ******** 2021-10-08T19:14:40.645 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.679 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.042) 0:03:44.705 ******** 2021-10-08T19:14:40.699 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-10-08T19:14:40.701 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.723 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.044) 0:03:44.749 ******** 2021-10-08T19:14:40.754 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.780 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.056) 0:03:44.806 ******** 2021-10-08T19:14:40.802 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-10-08T19:14:40.804 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.834 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.054) 0:03:44.860 ******** 2021-10-08T19:14:40.866 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:40.890 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.055) 0:03:44.916 ******** 2021-10-08T19:14:40.921 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-08T19:14:40.949 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.057) 0:03:44.974 ******** 2021-10-08T19:14:40.992 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:40 +0000 (0:00:00.044) 0:03:45.018 ******** 2021-10-08T19:14:41.021 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.050 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.053) 0:03:45.072 ******** 2021-10-08T19:14:41.077 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.104 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.057) 0:03:45.129 ******** 2021-10-08T19:14:41.121 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.148 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.044) 0:03:45.174 ******** 2021-10-08T19:14:41.178 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.206 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.056) 0:03:45.231 ******** 2021-10-08T19:14:41.232 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-10-08T19:14:41.234 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.258 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.053) 0:03:45.284 ******** 2021-10-08T19:14:41.309 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.312 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.335 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.077) 0:03:45.361 ******** 2021-10-08T19:14:41.341 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-10-08T19:14:41.343 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.365 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.030) 0:03:45.391 ******** 2021-10-08T19:14:41.406 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.436 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.070) 0:03:45.462 ******** 2021-10-08T19:14:41.438 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:41.456 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-10-08T19:14:41.493 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.049) 0:03:45.511 ******** 2021-10-08T19:14:41.528 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.042) 0:03:45.554 ******** 2021-10-08T19:14:41.556 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-10-08T19:14:41.558 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.593 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.063) 0:03:45.617 ******** 2021-10-08T19:14:41.600 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.631 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.039) 0:03:45.657 ******** 2021-10-08T19:14:41.659 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-10-08T19:14:41.661 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.684 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.053) 0:03:45.710 ******** 2021-10-08T19:14:41.702 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.728 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.043) 0:03:45.754 ******** 2021-10-08T19:14:41.730 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:41.749 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:41.751 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure packages are not present.] ***************************** 2021-10-08T19:14:41.752 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.779 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.050) 0:03:45.805 ******** 2021-10-08T19:14:41.801 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.826 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.047) 0:03:45.852 ******** 2021-10-08T19:14:41.849 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-08T19:14:41.851 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.874 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.047) 0:03:45.900 ******** 2021-10-08T19:14:41.892 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.893 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:41.920 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.046) 0:03:45.946 ******** 2021-10-08T19:14:41.922 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:41.970 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-10-08T19:14:41.972 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:41.994 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:41 +0000 (0:00:00.073) 0:03:46.020 ******** 2021-10-08T19:14:42.002 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.027 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.032) 0:03:46.052 ******** 2021-10-08T19:14:42.067 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:14:42.069 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.092 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.066) 0:03:46.119 ******** 2021-10-08T19:14:42.111 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.135 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.042) 0:03:46.161 ******** 2021-10-08T19:14:42.167 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-10-08T19:14:42.169 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.202 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.065) 0:03:46.227 ******** 2021-10-08T19:14:42.220 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.244 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.043) 0:03:46.270 ******** 2021-10-08T19:14:42.246 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:42.287 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.299 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.054) 0:03:46.325 ******** 2021-10-08T19:14:42.319 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.353 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.045) 0:03:46.371 ******** 2021-10-08T19:14:42.388 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.413 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.067) 0:03:46.439 ******** 2021-10-08T19:14:42.431 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.458 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.045) 0:03:46.484 ******** 2021-10-08T19:14:42.488 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-10-08T19:14:42.489 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.519 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.060) 0:03:46.545 ******** 2021-10-08T19:14:42.537 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.562 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.042) 0:03:46.588 ******** 2021-10-08T19:14:42.590 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.615 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.053) 0:03:46.641 ******** 2021-10-08T19:14:42.636 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.665 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.046) 0:03:46.687 ******** 2021-10-08T19:14:42.715 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.739 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.077) 0:03:46.765 ******** 2021-10-08T19:14:42.746 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.772 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.033) 0:03:46.798 ******** 2021-10-08T19:14:42.812 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-10-08T19:14:42.814 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.847 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.074) 0:03:46.873 ******** 2021-10-08T19:14:42.854 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.887 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.040) 0:03:46.913 ******** 2021-10-08T19:14:42.915 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.954 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.067) 0:03:46.981 ******** 2021-10-08T19:14:42.982 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:42.999 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:42 +0000 (0:00:00.044) 0:03:47.025 ******** 2021-10-08T19:14:43.030 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-10-08T19:14:43.032 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.057 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.058) 0:03:47.083 ******** 2021-10-08T19:14:43.078 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.101 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.044) 0:03:47.128 ******** 2021-10-08T19:14:43.132 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-10-08T19:14:43.134 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.162 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.058) 0:03:47.186 ******** 2021-10-08T19:14:43.180 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.209 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.044) 0:03:47.230 ******** 2021-10-08T19:14:43.232 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.258 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.054) 0:03:47.284 ******** 2021-10-08T19:14:43.278 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.313 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.055) 0:03:47.339 ******** 2021-10-08T19:14:43.368 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.390 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.077) 0:03:47.417 ******** 2021-10-08T19:14:43.405 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.428 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.037) 0:03:47.454 ******** 2021-10-08T19:14:43.468 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-08T19:14:43.471 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.496 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.066) 0:03:47.521 ******** 2021-10-08T19:14:43.514 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.537 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.041) 0:03:47.563 ******** 2021-10-08T19:14:43.568 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-10-08T19:14:43.570 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.596 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.058) 0:03:47.621 ******** 2021-10-08T19:14:43.613 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.638 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.042) 0:03:47.664 ******** 2021-10-08T19:14:43.679 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.703 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.063) 0:03:47.727 ******** 2021-10-08T19:14:43.723 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.745 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.043) 0:03:47.771 ******** 2021-10-08T19:14:43.782 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.809 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.064) 0:03:47.835 ******** 2021-10-08T19:14:43.810 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:43.829 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.863 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.052) 0:03:47.888 ******** 2021-10-08T19:14:43.883 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.908 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.046) 0:03:47.935 ******** 2021-10-08T19:14:43.931 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:43.958 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:43 +0000 (0:00:00.049) 0:03:47.984 ******** 2021-10-08T19:14:43.987 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:14:43.989 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.012 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.054) 0:03:48.038 ******** 2021-10-08T19:14:44.030 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.054 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.041) 0:03:48.080 ******** 2021-10-08T19:14:44.093 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-08T19:14:44.094 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.129 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.066) 0:03:48.148 ******** 2021-10-08T19:14:44.141 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.165 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.043) 0:03:48.192 ******** 2021-10-08T19:14:44.196 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:14:44.198 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.222 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.056) 0:03:48.248 ******** 2021-10-08T19:14:44.248 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.271 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.049) 0:03:48.297 ******** 2021-10-08T19:14:44.289 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.316 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.044) 0:03:48.342 ******** 2021-10-08T19:14:44.337 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.370 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.049) 0:03:48.391 ******** 2021-10-08T19:14:44.394 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-08T19:14:44.396 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.423 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.053) 0:03:48.445 ******** 2021-10-08T19:14:44.450 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:44.476 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.056) 0:03:48.502 ******** 2021-10-08T19:14:44.697 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-08T19:14:44.699 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-10-08T19:14:44.722 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.245) 0:03:48.747 ******** 2021-10-08T19:14:44.750 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-10-08T19:14:44.774 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.052) 0:03:48.800 ******** 2021-10-08T19:14:44.968 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-08T19:14:44.969 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:14:44.991 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:44 +0000 (0:00:00.217) 0:03:49.017 ******** 2021-10-08T19:14:45.044 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:14:45.068 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.076) 0:03:49.094 ******** 2021-10-08T19:14:45.235 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-08T19:14:45.237 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-10-08T19:14:45.259 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.191) 0:03:49.285 ******** 2021-10-08T19:14:45.310 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-10-08T19:14:45.336 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.076) 0:03:49.362 ******** 2021-10-08T19:14:45.343 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-08T19:14:45.345 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.370 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.033) 0:03:49.396 ******** 2021-10-08T19:14:45.420 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.447 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.077) 0:03:49.473 ******** 2021-10-08T19:14:45.455 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-08T19:14:45.457 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.480 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.033) 0:03:49.507 ******** 2021-10-08T19:14:45.510 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.534 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.053) 0:03:49.560 ******** 2021-10-08T19:14:45.552 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-08T19:14:45.554 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.583 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.048) 0:03:49.609 ******** 2021-10-08T19:14:45.606 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.631 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.047) 0:03:49.657 ******** 2021-10-08T19:14:45.649 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-08T19:14:45.650 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.679 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.047) 0:03:49.704 ******** 2021-10-08T19:14:45.718 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.743 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.065) 0:03:49.769 ******** 2021-10-08T19:14:45.750 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-08T19:14:45.753 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.779 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.035) 0:03:49.805 ******** 2021-10-08T19:14:45.810 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.837 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.055) 0:03:49.860 ******** 2021-10-08T19:14:45.843 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-08T19:14:45.845 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.869 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.034) 0:03:49.895 ******** 2021-10-08T19:14:45.898 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.922 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.052) 0:03:49.948 ******** 2021-10-08T19:14:45.940 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-08T19:14:45.942 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:45.964 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:45 +0000 (0:00:00.041) 0:03:49.990 ******** 2021-10-08T19:14:45.992 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.018 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.053) 0:03:50.044 ******** 2021-10-08T19:14:46.035 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-08T19:14:46.037 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.060 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.042) 0:03:50.086 ******** 2021-10-08T19:14:46.090 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.114 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.054) 0:03:50.140 ******** 2021-10-08T19:14:46.132 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-08T19:14:46.134 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.156 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.042) 0:03:50.182 ******** 2021-10-08T19:14:46.186 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.215 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.058) 0:03:50.241 ******** 2021-10-08T19:14:46.233 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-10-08T19:14:46.235 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.259 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.043) 0:03:50.285 ******** 2021-10-08T19:14:46.289 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.313 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.054) 0:03:50.339 ******** 2021-10-08T19:14:46.343 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.364 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.051) 0:03:50.390 ******** 2021-10-08T19:14:46.384 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.409 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.044) 0:03:50.435 ******** 2021-10-08T19:14:46.449 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.477 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.068) 0:03:50.503 ******** 2021-10-08T19:14:46.487 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.511 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.033) 0:03:50.537 ******** 2021-10-08T19:14:46.538 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.565 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.054) 0:03:50.591 ******** 2021-10-08T19:14:46.584 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.608 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.043) 0:03:50.634 ******** 2021-10-08T19:14:46.635 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-08T19:14:46.637 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.661 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.052) 0:03:50.687 ******** 2021-10-08T19:14:46.679 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.702 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.041) 0:03:50.728 ******** 2021-10-08T19:14:46.730 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.755 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.053) 0:03:50.781 ******** 2021-10-08T19:14:46.776 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.799 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.043) 0:03:50.825 ******** 2021-10-08T19:14:46.827 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-10-08T19:14:46.829 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.851 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.052) 0:03:50.878 ******** 2021-10-08T19:14:46.873 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.894 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.042) 0:03:50.920 ******** 2021-10-08T19:14:46.922 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-08T19:14:46.924 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.946 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.052) 0:03:50.973 ******** 2021-10-08T19:14:46.965 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:46.999 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:46 +0000 (0:00:00.052) 0:03:51.025 ******** 2021-10-08T19:14:47.017 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-10-08T19:14:47.019 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.050 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.047) 0:03:51.073 ******** 2021-10-08T19:14:47.101 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.127 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.080) 0:03:51.153 ******** 2021-10-08T19:14:47.135 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.159 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.031) 0:03:51.185 ******** 2021-10-08T19:14:47.209 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.211 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:47.234 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.075) 0:03:51.260 ******** 2021-10-08T19:14:47.241 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-10-08T19:14:47.243 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.268 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.034) 0:03:51.294 ******** 2021-10-08T19:14:47.270 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:47.320 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.345 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.076) 0:03:51.371 ******** 2021-10-08T19:14:47.352 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-10-08T19:14:47.354 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.381 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.035) 0:03:51.407 ******** 2021-10-08T19:14:47.446 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.473 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.092) 0:03:51.499 ******** 2021-10-08T19:14:47.480 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.508 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.035) 0:03:51.534 ******** 2021-10-08T19:14:47.550 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.577 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.068) 0:03:51.603 ******** 2021-10-08T19:14:47.597 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:14:47.599 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-08T19:14:47.623 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.045) 0:03:51.649 ******** 2021-10-08T19:14:47.653 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-08T19:14:47.681 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.058) 0:03:51.707 ******** 2021-10-08T19:14:47.712 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi157.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.726 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi157.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.749 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.782 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.101) 0:03:51.809 ******** 2021-10-08T19:14:47.792 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.794 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-10-08T19:14:47.796 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.797 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.808 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.810 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-08T19:14:47.838 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:47 +0000 (0:00:00.055) 0:03:51.864 ******** 2021-10-08T19:14:48.115 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-10-08T19:14:48.117 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.007096", "end": "2021-10-08 19:14:48.089293", "rc": 0, "start": "2021-10-08 19:14:48.082197", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock"]} 2021-10-08T19:14:48.143 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.304) 0:03:52.169 ******** 2021-10-08T19:14:48.150 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005916", "end": "2021-10-08 19:14:48.105199", "rc": 0, "start": "2021-10-08 19:14:48.099283", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock"]} 2021-10-08T19:14:48.182 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.038) 0:03:52.208 ******** 2021-10-08T19:14:48.211 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:48.240 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.058) 0:03:52.266 ******** 2021-10-08T19:14:48.259 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:48.286 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.045) 0:03:52.312 ******** 2021-10-08T19:14:48.313 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:48.339 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.052) 0:03:52.364 ******** 2021-10-08T19:14:48.357 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:48.382 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.043) 0:03:52.408 ******** 2021-10-08T19:14:48.412 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:48.414 INFO:teuthology.task.ansible.out: 2021-10-08T19:14:48.439 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.054) 0:03:52.463 ******** 2021-10-08T19:14:48.456 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:48.482 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.043) 0:03:52.506 ******** 2021-10-08T19:14:48.508 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-10-08T19:14:48.510 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:48.534 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.054) 0:03:52.560 ******** 2021-10-08T19:14:48.553 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:48.578 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:48 +0000 (0:00:00.043) 0:03:52.604 ******** 2021-10-08T19:14:49.856 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:14:49.882 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:49 +0000 (0:00:01.304) 0:03:53.908 ******** 2021-10-08T19:14:49.936 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:14:49.961 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:49 +0000 (0:00:00.078) 0:03:53.987 ******** 2021-10-08T19:14:49.979 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-08T19:14:49.981 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289631232, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121492, 'block_used': 12973616, 'inode_total': 61054976, 'inode_available': 60985419, 'inode_used': 69557, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121492, "block_size": 4096, "block_total": 240095108, "block_used": 12973616, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985419, "inode_total": 61054976, "inode_used": 69557, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289631232, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}} 2021-10-08T19:14:50.010 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:50 +0000 (0:00:00.048) 0:03:54.036 ******** 2021-10-08T19:14:50.050 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289651712, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121497, 'block_used': 12973611, 'inode_total': 61054976, 'inode_available': 60985423, 'inode_used': 69553, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121497, "block_size": 4096, "block_total": 240095108, "block_used": 12973611, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985423, "inode_total": 61054976, "inode_used": 69553, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289651712, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}} 2021-10-08T19:14:50.078 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:50 +0000 (0:00:00.067) 0:03:54.104 ******** 2021-10-08T19:14:50.260 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-10-08T19:14:50.262 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005123", "end": "2021-10-08 19:14:50.235346", "rc": 0, "start": "2021-10-08 19:14:50.230223", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:50.298 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:50 +0000 (0:00:00.220) 0:03:54.324 ******** 2021-10-08T19:14:50.309 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005073", "end": "2021-10-08 19:14:50.290731", "rc": 0, "start": "2021-10-08 19:14:50.285658", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:50.334 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:50 +0000 (0:00:00.035) 0:03:54.360 ******** 2021-10-08T19:14:50.384 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi157.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289631232, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121492, 'block_used': 12973616, 'inode_total': 61054976, 'inode_available': 60985419, 'inode_used': 69557, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121492, "block_size": 4096, "block_total": 240095108, "block_used": 12973616, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985419, "inode_total": 61054976, "inode_used": 69557, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289631232, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:50.408 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:50 +0000 (0:00:00.074) 0:03:54.434 ******** 2021-10-08T19:14:50.417 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289651712, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121497, 'block_used': 12973611, 'inode_total': 61054976, 'inode_available': 60985423, 'inode_used': 69553, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121497, "block_size": 4096, "block_total": 240095108, "block_used": 12973611, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985423, "inode_total": 61054976, "inode_used": 69553, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289651712, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:50.443 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:50 +0000 (0:00:00.034) 0:03:54.469 ******** 2021-10-08T19:14:50.471 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-08T19:14:50.498 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:50 +0000 (0:00:00.055) 0:03:54.524 ******** 2021-10-08T19:14:50.542 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:50 +0000 (0:00:00.044) 0:03:54.568 ******** 2021-10-08T19:14:52.062 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-08T19:14:52.064 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAaON4jThsMhHkf02PgDObjARBAc4bB7Qo'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.307867", "end": "2021-10-08 19:14:52.036181", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAaON4jThsMhHkf02PgDObjARBAc4bB7Qo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:50.728314", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:52.233 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0Bwr2dApdGGRy2p5wFcQoYjQeqVdbDcPfy'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.415261", "end": "2021-10-08 19:14:52.187861", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0Bwr2dApdGGRy2p5wFcQoYjQeqVdbDcPfy"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:50.772600", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:53.305 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-IDHW2M-va4L-8kdM-ARcK-NPzh-JSb9-QwfFcq', 'nvme-INTEL_SSDPED1D480GA_PHMB7476002V480DGN', 'nvme-nvme.8086-50484d42373437363030325634383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPED1D480GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '937703088', 'sectorsize': '512', 'size': '447.13 GB', 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.045189", "end": "2021-10-08 19:14:53.273663", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-IDHW2M-va4L-8kdM-ARcK-NPzh-JSb9-QwfFcq", "nvme-INTEL_SSDPED1D480GA_PHMB7476002V480DGN", "nvme-nvme.8086-50484d42373437363030325634383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:52.228474", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now pa 2021-10-08T19:14:53.306 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:53.475 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-5eH7KH-qorU-rfgR-5hyC-RqOH-lL5U-0LX3v9', 'nvme-INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN', 'nvme-nvme.8086-43564654363234363030305a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.067486", "end": "2021-10-08 19:14:53.444123", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-5eH7KH-qorU-rfgR-5hyC-RqOH-lL5U-0LX3v9", "nvme-INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN", "nvme-nvme.8086-43564654363234363030305a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:52.376637", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-10-08T19:14:53.476 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:54.568 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAG8oQ8Vkh3XT1Zaks6RplAyW37oysoG0V'], 'uuids': ['23463e35-a241-4279-b5e1-65dfc2f03a7c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.082000", "end": "2021-10-08 19:14:54.542549", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAG8oQ8Vkh3XT1Zaks6RplAyW37oysoG0V"], "labels": [], "masters": [], "uuids": ["23463e35-a241-4279-b5e1-65dfc2f03a7c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:53.460549", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:54.741 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0B7nnQUamsAdH49K2ifVGpEZHKLnhZ92Ih'], 'uuids': ['cecff1f3-cdc3-485b-9aea-763d09101790'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.082541", "end": "2021-10-08 19:14:54.711633", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0B7nnQUamsAdH49K2ifVGpEZHKLnhZ92Ih"], "labels": [], "masters": [], "uuids": ["cecff1f3-cdc3-485b-9aea-763d09101790"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:53.629092", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:55.817 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AA4IdMzYdi0cqekuzfOacR5xxnPxdw0wM4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.049481", "end": "2021-10-08 19:14:55.786215", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AA4IdMzYdi0cqekuzfOacR5xxnPxdw0wM4"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:54.736734", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:55.966 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0BKDR0H8IIzzx2ZGT5ppvg5XZeXOD3johN'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.038293", "end": "2021-10-08 19:14:55.939055", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0BKDR0H8IIzzx2ZGT5ppvg5XZeXOD3johN"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:54.900762", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:57.056 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAgGGOIHbdLldXqqvvUysSfBWsI7tedOYQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.040059", "end": "2021-10-08 19:14:57.026702", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAgGGOIHbdLldXqqvvUysSfBWsI7tedOYQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:55.986643", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:57.068 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPK', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPK', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPK', 'scsi-35000c50092924b2b', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPK', 'wwn-0x5000c50092924b2b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFPK', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092924b2b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPK-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPK-part1', 'scsi-35000c50092924b2b-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPK-part1', 'wwn-0x5000c50092924b2b-part1'], 'uuids': ['617a2b93-35a0-462f-bde1-46e282c74935'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPK", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPK", "scsi-35000c50092924b2b", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPK", "wwn-0x5000c50092924b2b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPK-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:14:57.069 INFO:teuthology.task.ansible.out:Z1W5XFPK-part1", "scsi-35000c50092924b2b-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPK-part1", "wwn-0x5000c50092924b2b-part1"], "labels": [], "masters": [], "uuids": ["617a2b93-35a0-462f-bde1-46e282c74935"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092924b2b"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:57.218 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0Bm0Kr1AwqeyVXbk6dFcL7LyM8rfL9soqP'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.066363", "end": "2021-10-08 19:14:57.190280", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0Bm0Kr1AwqeyVXbk6dFcL7LyM8rfL9soqP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:56.123917", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:57.230 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XGPQ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XGPQ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XGPQ', 'scsi-35000c50092928bab', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XGPQ', 'wwn-0x5000c50092928bab'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XGPQ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092928bab', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XGPQ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XGPQ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XGPQ-part1', 'scsi-35000c50092928bab-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XGPQ-part1', 'wwn-0x5000c50092928bab-part1'], 'uuids': ['617a2b93-35a0-462f-bde1-46e282c74935'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGPQ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XGPQ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XGPQ", "scsi-35000c50092928bab", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XGPQ", "wwn-0x5000c50092928bab"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGPQ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XGPQ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:14:57.232 INFO:teuthology.task.ansible.out:Z1W5XGPQ-part1", "scsi-35000c50092928bab-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XGPQ-part1", "wwn-0x5000c50092928bab-part1"], "labels": [], "masters": [], "uuids": ["617a2b93-35a0-462f-bde1-46e282c74935"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGPQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092928bab"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:14:58.300 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AADxE42ZMLDN4zGvFf9FBIe5eXDNBhXC6B'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.051461", "end": "2021-10-08 19:14:58.268348", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AADxE42ZMLDN4zGvFf9FBIe5eXDNBhXC6B"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:57.216887", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:58.329 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:58 +0000 (0:00:07.786) 0:04:02.355 ******** 2021-10-08T19:14:58.463 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0B6PozkW1MdT2yNtnm13ZSluDscleRevFS'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.054444", "end": "2021-10-08 19:14:58.432202", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0B6PozkW1MdT2yNtnm13ZSluDscleRevFS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:57.377758", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:14:58.496 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:14:58 +0000 (0:00:00.166) 0:04:02.521 ******** 2021-10-08T19:14:58.712 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-08T19:14:58.714 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAaON4jThsMhHkf02PgDObjARBAc4bB7Qo'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.100858", "end": "2021-10-08 19:14:58.686474", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAaON4jThsMhHkf02PgDObjARBAc4bB7Qo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:58.585616", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0981135 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0981135 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:58.908 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0Bwr2dApdGGRy2p5wFcQoYjQeqVdbDcPfy'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.145101", "end": "2021-10-08 19:14:58.881106", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0Bwr2dApdGGRy2p5wFcQoYjQeqVdbDcPfy"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:58.736005", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142384 s, 810 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142384 s, 810 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:58.941 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-IDHW2M-va4L-8kdM-ARcK-NPzh-JSb9-QwfFcq', 'nvme-INTEL_SSDPED1D480GA_PHMB7476002V480DGN', 'nvme-nvme.8086-50484d42373437363030325634383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPED1D480GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '937703088', 'sectorsize': '512', 'size': '447.13 GB', 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.039813", "end": "2021-10-08 19:14:58.907956", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-IDHW2M-va4L-8kdM-ARcK-NPzh-JSb9-QwfFcq", "nvme-INTEL_SSDPED1D480GA_PHMB7476002V480DGN", "nvme-nvme.8086-50484d42373437363030325634383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:58.868143", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0371002 s, 3.1 GB/s", "stderr_lines": [" 2021-10-08T19:14:58.944 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0371002 s, 3.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:59.116 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-5eH7KH-qorU-rfgR-5hyC-RqOH-lL5U-0LX3v9', 'nvme-INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN', 'nvme-nvme.8086-43564654363234363030305a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.039751", "end": "2021-10-08 19:14:59.091202", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-5eH7KH-qorU-rfgR-5hyC-RqOH-lL5U-0LX3v9", "nvme-INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN", "nvme-nvme.8086-43564654363234363030305a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:59.051451", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0370693 s, 3.1 GB/s", "std 2021-10-08T19:14:59.118 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0370693 s, 3.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:59.226 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAG8oQ8Vkh3XT1Zaks6RplAyW37oysoG0V'], 'uuids': ['23463e35-a241-4279-b5e1-65dfc2f03a7c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.098354", "end": "2021-10-08 19:14:59.197646", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAG8oQ8Vkh3XT1Zaks6RplAyW37oysoG0V"], "labels": [], "masters": [], "uuids": ["23463e35-a241-4279-b5e1-65dfc2f03a7c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:59.099292", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0958754 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0958754 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:59.438 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0B7nnQUamsAdH49K2ifVGpEZHKLnhZ92Ih'], 'uuids': ['cecff1f3-cdc3-485b-9aea-763d09101790'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.142167", "end": "2021-10-08 19:14:59.411934", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0B7nnQUamsAdH49K2ifVGpEZHKLnhZ92Ih"], "labels": [], "masters": [], "uuids": ["cecff1f3-cdc3-485b-9aea-763d09101790"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:59.269767", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139573 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139573 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:59.504 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AA4IdMzYdi0cqekuzfOacR5xxnPxdw0wM4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.100180", "end": "2021-10-08 19:14:59.476923", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AA4IdMzYdi0cqekuzfOacR5xxnPxdw0wM4"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:59.376743", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0974932 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0974932 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:59.773 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0BKDR0H8IIzzx2ZGT5ppvg5XZeXOD3johN'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.144422", "end": "2021-10-08 19:14:59.731010", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0BKDR0H8IIzzx2ZGT5ppvg5XZeXOD3johN"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:59.586588", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141853 s, 813 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141853 s, 813 MB/s"], "stdout": "", "stdout_lines": []} changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAgGGOIHbdLldXqqvvUysSfBWsI7tedOYQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'siz 2021-10-08T19:14:59.775 INFO:teuthology.task.ansible.out:e': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.098906", "end": "2021-10-08 19:14:59.749246", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AAgGGOIHbdLldXqqvvUysSfBWsI7tedOYQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:59.650340", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0962817 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0962817 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:14:59.784 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPK', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPK', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPK', 'scsi-35000c50092924b2b', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPK', 'wwn-0x5000c50092924b2b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFPK', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092924b2b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPK-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPK-part1', 'scsi-35000c50092924b2b-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPK-part1', 'wwn-0x5000c50092924b2b-part1'], 'uuids': ['617a2b93-35a0-462f-bde1-46e282c74935'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPK", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPK", "scsi-35000c50092924b2b", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPK", "wwn-0x5000c50092924b2b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPK-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:14:59.786 INFO:teuthology.task.ansible.out:Z1W5XFPK-part1", "scsi-35000c50092924b2b-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPK-part1", "wwn-0x5000c50092924b2b-part1"], "labels": [], "masters": [], "uuids": ["617a2b93-35a0-462f-bde1-46e282c74935"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092924b2b"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:00.063 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AADxE42ZMLDN4zGvFf9FBIe5eXDNBhXC6B'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.099341", "end": "2021-10-08 19:15:00.033435", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-f3VSobRWU77BlzC00pHnxcZYJqZDp7AADxE42ZMLDN4zGvFf9FBIe5eXDNBhXC6B"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:59.934094", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0967055 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0967055 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:00.093 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:00 +0000 (0:00:01.597) 0:04:04.119 ******** 2021-10-08T19:15:00.109 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0Bm0Kr1AwqeyVXbk6dFcL7LyM8rfL9soqP'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.142775", "end": "2021-10-08 19:15:00.049640", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0Bm0Kr1AwqeyVXbk6dFcL7LyM8rfL9soqP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:14:59.906865", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140144 s, 823 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140144 s, 823 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:00.110 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XGPQ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XGPQ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XGPQ', 'scsi-35000c50092928bab', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XGPQ', 'wwn-0x5000c50092928bab'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XGPQ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092928bab', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XGPQ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XGPQ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XGPQ-part1', 'scsi-35000c50092928bab-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XGPQ-part1', 'wwn-0x5000c50092928bab-part1'], 'uuids': ['617a2b93-35a0-462f-bde1-46e282c74935'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGPQ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XGPQ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XGPQ", "scsi-35000c50092928bab", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XGPQ", "wwn-0x5000c50092928bab"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGPQ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XGPQ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:15:00.112 INFO:teuthology.task.ansible.out:Z1W5XGPQ-part1", "scsi-35000c50092928bab-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XGPQ-part1", "wwn-0x5000c50092928bab-part1"], "labels": [], "masters": [], "uuids": ["617a2b93-35a0-462f-bde1-46e282c74935"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGPQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092928bab"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:00.410 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-10-08T19:15:00.412 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.061588", "end": "2021-10-08 19:15:00.336211", "rc": 0, "start": "2021-10-08 19:15:00.274623", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0B6PozkW1MdT2yNtnm13ZSluDscleRevFS'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.150839", "end": "2021-10-08 19:15:00.383960", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CDMzWxiePSgTmzcYUnfQ9JAg0BLjPT0B6PozkW1MdT2yNtnm13ZSluDscleRevFS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:15:00.233121", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.1482 s, 778 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.1482 s, 778 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:00.441 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:00 +0000 (0:00:00.348) 0:04:04.467 ******** 2021-10-08T19:15:00.465 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:00 +0000 (0:00:00.023) 0:04:04.491 ******** 2021-10-08T19:15:00.674 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.046738", "end": "2021-10-08 19:15:00.650690", "rc": 0, "start": "2021-10-08 19:15:00.603952", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:00.697 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:00 +0000 (0:00:00.232) 0:04:04.723 ******** 2021-10-08T19:15:00.770 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-08T19:15:00.833 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:00 +0000 (0:00:00.135) 0:04:04.859 ******** 2021-10-08T19:15:00.840 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-10-08T19:15:00.842 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.065467", "end": "2021-10-08 19:15:00.698928", "rc": 0, "start": "2021-10-08 19:15:00.633461", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:00.866 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:00 +0000 (0:00:00.032) 0:04:04.892 ******** 2021-10-08T19:15:00.872 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-10-08T19:15:00.874 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:00.907 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:00 +0000 (0:00:00.040) 0:04:04.932 ******** 2021-10-08T19:15:00.946 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:00.968 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:00 +0000 (0:00:00.062) 0:04:04.995 ******** 2021-10-08T19:15:01.003 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-08T19:15:01.004 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.035 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.065) 0:04:05.060 ******** 2021-10-08T19:15:01.065 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.088 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.053) 0:04:05.114 ******** 2021-10-08T19:15:01.108 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.047412", "end": "2021-10-08 19:15:01.076783", "rc": 0, "start": "2021-10-08 19:15:01.029371", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:01.137 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.049) 0:04:05.163 ******** 2021-10-08T19:15:01.170 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-08T19:15:01.197 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.057) 0:04:05.220 ******** 2021-10-08T19:15:01.223 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-10-08T19:15:01.225 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.251 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.055) 0:04:05.276 ******** 2021-10-08T19:15:01.278 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.280 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:15:01.307 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.056) 0:04:05.333 ******** 2021-10-08T19:15:01.330 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.022) 0:04:05.355 ******** 2021-10-08T19:15:01.349 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-08T19:15:01.350 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289631232, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121492, 'block_used': 12973616, 'inode_total': 61054976, 'inode_available': 60985419, 'inode_used': 69557, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121492, "block_size": 4096, "block_total": 240095108, "block_used": 12973616, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985419, "inode_total": 61054976, "inode_used": 69557, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289631232, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.374 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.044) 0:04:05.400 ******** 2021-10-08T19:15:01.383 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-08T19:15:01.385 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.418 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.044) 0:04:05.444 ******** 2021-10-08T19:15:01.426 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.457 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.032) 0:04:05.477 ******** 2021-10-08T19:15:01.459 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-10-08T19:15:01.461 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.488 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.037) 0:04:05.514 ******** 2021-10-08T19:15:01.496 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:15:01.497 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.523 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.035) 0:04:05.549 ******** 2021-10-08T19:15:01.565 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.589 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.064) 0:04:05.614 ******** 2021-10-08T19:15:01.628 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-10-08T19:15:01.630 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.653 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.064) 0:04:05.678 ******** 2021-10-08T19:15:01.682 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:15:01.684 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.705 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.052) 0:04:05.731 ******** 2021-10-08T19:15:01.726 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.020) 0:04:05.752 ******** 2021-10-08T19:15:01.746 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.771 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.044) 0:04:05.797 ******** 2021-10-08T19:15:01.778 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-08T19:15:01.781 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930289651712, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227121497, 'block_used': 12973611, 'inode_total': 61054976, 'inode_available': 60985423, 'inode_used': 69553, 'uuid': '617a2b93-35a0-462f-bde1-46e282c74935'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227121497, "block_size": 4096, "block_total": 240095108, "block_used": 12973611, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985423, "inode_total": 61054976, "inode_used": 69553, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930289651712, "size_total": 983429562368, "uuid": "617a2b93-35a0-462f-bde1-46e282c74935"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.803 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.032) 0:04:05.829 ******** 2021-10-08T19:15:01.842 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-10-08T19:15:01.844 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.870 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.066) 0:04:05.896 ******** 2021-10-08T19:15:01.911 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:15:01.913 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:01.940 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:01 +0000 (0:00:00.068) 0:04:05.964 ******** 2021-10-08T19:15:01.980 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:02.006 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:02 +0000 (0:00:00.068) 0:04:06.032 ******** 2021-10-08T19:15:02.050 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:02.072 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:02 +0000 (0:00:00.065) 0:04:06.098 ******** 2021-10-08T19:15:02.112 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:02.139 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:02 +0000 (0:00:00.066) 0:04:06.165 ******** 2021-10-08T19:15:02.181 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:02.202 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:02 +0000 (0:00:00.063) 0:04:06.229 ******** 2021-10-08T19:15:02.505 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-10-08T19:15:02.507 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-08T19:15:02.530 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:02 +0000 (0:00:00.327) 0:04:06.556 ******** 2021-10-08T19:15:02.699 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-08T19:15:02.722 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:02 +0000 (0:00:00.192) 0:04:06.749 ******** 2021-10-08T19:15:02.724 INFO:teuthology.task.ansible.out: 2021-10-08T19:15:03.157 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:15:03.160 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:15:03.509 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:15:03.522 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:15:03.853 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:15:03.889 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:15:04.274 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:15:04.618 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:15:04.643 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:04 +0000 (0:00:01.918) 0:04:08.667 ******** 2021-10-08T19:15:04.649 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:15:04.677 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:04 +0000 (0:00:00.035) 0:04:08.702 ******** 2021-10-08T19:15:04.862 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-08T19:15:04.887 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:04 +0000 (0:00:00.210) 0:04:08.913 ******** 2021-10-08T19:15:04.895 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-08T19:15:04.931 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:04 +0000 (0:00:00.044) 0:04:08.957 ******** 2021-10-08T19:15:05.117 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-08T19:15:05.118 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:15:05.182 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:15:05.289 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:15:05.354 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:15:05.464 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:15:05.552 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:15:05.639 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:15:05.652 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:05.680 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:05 +0000 (0:00:00.748) 0:04:09.706 ******** 2021-10-08T19:15:05.710 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:05.735 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:05 +0000 (0:00:00.055) 0:04:09.761 ******** 2021-10-08T19:15:05.743 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-08T19:15:05.746 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi196.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:05.784 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:05 +0000 (0:00:00.048) 0:04:09.810 ******** 2021-10-08T19:15:05.798 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:05.821 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:05 +0000 (0:00:00.036) 0:04:09.847 ******** 2021-10-08T19:15:05.827 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-10-08T19:15:05.830 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:05.854 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:05 +0000 (0:00:00.032) 0:04:09.879 ******** 2021-10-08T19:15:05.884 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:05.906 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:05 +0000 (0:00:00.051) 0:04:09.931 ******** 2021-10-08T19:15:06.031 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-10-08T19:15:06.033 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:15:06.057 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:06 +0000 (0:00:00.151) 0:04:10.083 ******** 2021-10-08T19:15:06.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-10-08T19:15:06.102 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:15:06.126 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:06 +0000 (0:00:00.069) 0:04:10.152 ******** 2021-10-08T19:15:06.152 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:06 +0000 (0:00:00.026) 0:04:10.178 ******** 2021-10-08T19:15:06.193 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-08T19:15:06.215 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:06 +0000 (0:00:00.062) 0:04:10.241 ******** 2021-10-08T19:15:06.647 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi157.front.sepia.ceph.com] => {"changed": true} 2021-10-08T19:15:06.672 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:06 +0000 (0:00:00.455) 0:04:10.696 ******** 2021-10-08T19:15:06.712 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true} 2021-10-08T19:15:06.735 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:06 +0000 (0:00:00.064) 0:04:10.761 ******** 2021-10-08T19:15:07.076 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-08T19:15:07.095 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.359) 0:04:11.121 ******** 2021-10-08T19:15:07.122 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.025) 0:04:11.146 ******** 2021-10-08T19:15:07.127 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-10-08T19:15:07.130 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.153 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.031) 0:04:11.178 ******** 2021-10-08T19:15:07.171 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.172 INFO:teuthology.task.ansible.out: 2021-10-08T19:15:07.196 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.044) 0:04:11.222 ******** 2021-10-08T19:15:07.203 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-10-08T19:15:07.209 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.234 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.035) 0:04:11.258 ******** 2021-10-08T19:15:07.249 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.273 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.039) 0:04:11.297 ******** 2021-10-08T19:15:07.279 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.302 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.030) 0:04:11.328 ******** 2021-10-08T19:15:07.310 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.338 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.033) 0:04:11.362 ******** 2021-10-08T19:15:07.343 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.384 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.047) 0:04:11.410 ******** 2021-10-08T19:15:07.391 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.421 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.037) 0:04:11.447 ******** 2021-10-08T19:15:07.430 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-10-08T19:15:07.432 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.462 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.041) 0:04:11.488 ******** 2021-10-08T19:15:07.472 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.499 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.036) 0:04:11.525 ******** 2021-10-08T19:15:07.508 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-10-08T19:15:07.510 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.539 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.040) 0:04:11.565 ******** 2021-10-08T19:15:07.551 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.580 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.041) 0:04:11.606 ******** 2021-10-08T19:15:07.587 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-10-08T19:15:07.589 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.616 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.035) 0:04:11.641 ******** 2021-10-08T19:15:07.625 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.650 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.035) 0:04:11.677 ******** 2021-10-08T19:15:07.661 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-10-08T19:15:07.670 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.701 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.040) 0:04:11.717 ******** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.729 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.037) 0:04:11.754 ******** 2021-10-08T19:15:07.753 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.787 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.054) 0:04:11.808 ******** 2021-10-08T19:15:07.791 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.825 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.032) 0:04:11.841 ******** 2021-10-08T19:15:07.835 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.851 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.033) 0:04:11.875 ******** 2021-10-08T19:15:07.856 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.881 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.031) 0:04:11.907 ******** 2021-10-08T19:15:07.888 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-10-08T19:15:07.891 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.914 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.033) 0:04:11.941 ******** 2021-10-08T19:15:07.925 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.947 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.032) 0:04:11.973 ******** 2021-10-08T19:15:07.954 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-10-08T19:15:07.961 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:07.989 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:07 +0000 (0:00:00.041) 0:04:12.014 ******** 2021-10-08T19:15:07.997 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:08.026 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:08 +0000 (0:00:00.035) 0:04:12.050 ******** 2021-10-08T19:15:08.033 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:08.060 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:08 +0000 (0:00:00.035) 0:04:12.085 ******** 2021-10-08T19:15:08.068 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:08.100 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:08 +0000 (0:00:00.039) 0:04:12.125 ******** 2021-10-08T19:15:08.106 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-10-08T19:15:08.109 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:08.132 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:08 +0000 (0:00:00.032) 0:04:12.157 ******** 2021-10-08T19:15:08.139 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:08.164 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:08 +0000 (0:00:00.032) 0:04:12.190 ******** 2021-10-08T19:15:08.171 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-10-08T19:15:08.172 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:08.195 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:08 +0000 (0:00:00.031) 0:04:12.222 ******** 2021-10-08T19:15:08.203 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:08.227 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:08 +0000 (0:00:00.031) 0:04:12.253 ******** 2021-10-08T19:15:08.665 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-10-08T19:15:08.667 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-10-08T19:15:08.689 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:08 +0000 (0:00:00.462) 0:04:12.715 ******** 2021-10-08T19:15:08.720 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-10-08T19:15:08.743 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:08 +0000 (0:00:00.053) 0:04:12.769 ******** 2021-10-08T19:15:09.010 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-08T19:15:09.014 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "916", "ExecMainStartTimestamp": "Fri 2021-10-08 19:10:41 UTC", "ExecMainStartTimestampMonotonic": "12610684", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitM 2021-10-08T19:15:09.016 INFO:teuthology.task.ansible.out:EMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "916", "MemoryAccounting": "yes", "MemoryCurrent": "1818624", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Fri 2021-10-08 19:10:41 UTC", "WatchdogTimestampMonotonic": "12610744", "WatchdogUSec": "0"}} 2021-10-08T19:15:09.064 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.314) 0:04:13.084 ******** 2021-10-08T19:15:09.085 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "891", "ExecMainStartTimestamp": "Fri 2021-10-08 19:10:25 UTC", "ExecMainStartTimestampMonotonic": "11919099", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitM 2021-10-08T19:15:09.087 INFO:teuthology.task.ansible.out:EMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "891", "MemoryAccounting": "yes", "MemoryCurrent": "1818624", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Fri 2021-10-08 19:10:25 UTC", "WatchdogTimestampMonotonic": "11919383", "WatchdogUSec": "0"}} 2021-10-08T19:15:09.102 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.044) 0:04:13.129 ******** 2021-10-08T19:15:09.109 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:15:09.111 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-08T19:15:09.159 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.055) 0:04:13.184 ******** 2021-10-08T19:15:09.168 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-08T19:15:09.196 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.037) 0:04:13.222 ******** 2021-10-08T19:15:09.205 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:15:09.208 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-08T19:15:09.233 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.036) 0:04:13.259 ******** 2021-10-08T19:15:09.243 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-08T19:15:09.265 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.032) 0:04:13.291 ******** 2021-10-08T19:15:09.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-10-08T19:15:09.273 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:09.307 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.034) 0:04:13.325 ******** 2021-10-08T19:15:09.315 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:09.336 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.036) 0:04:13.362 ******** 2021-10-08T19:15:09.344 INFO:teuthology.task.ansible.out: 2021-10-08T19:15:09.350 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:09.392 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.052) 0:04:13.414 ******** 2021-10-08T19:15:09.402 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:09.427 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.038) 0:04:13.453 ******** 2021-10-08T19:15:09.434 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-10-08T19:15:09.435 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:09.491 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.062) 0:04:13.516 ******** 2021-10-08T19:15:09.502 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:09.535 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.043) 0:04:13.559 ******** 2021-10-08T19:15:09.706 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-10-08T19:15:09.732 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.198) 0:04:13.758 ******** 2021-10-08T19:15:09.763 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-10-08T19:15:09.792 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:09 +0000 (0:00:00.058) 0:04:13.817 ******** 2021-10-08T19:15:10.230 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-10-08T19:15:10.230 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-10-08T19:15:10.256 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:10 +0000 (0:00:00.464) 0:04:14.281 ******** 2021-10-08T19:15:10.294 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-10-08T19:15:10.320 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:10 +0000 (0:00:00.065) 0:04:14.346 ******** 2021-10-08T19:15:11.341 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-10-08T19:15:11.343 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-10-08T19:15:11.365 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:01.045) 0:04:15.391 ******** 2021-10-08T19:15:11.390 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-10-08T19:15:11.392 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:11.419 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.054) 0:04:15.446 ******** 2021-10-08T19:15:11.440 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.020) 0:04:15.466 ******** 2021-10-08T19:15:11.457 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-10-08T19:15:11.459 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-08T19:15:11.480 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.040) 0:04:15.506 ******** 2021-10-08T19:15:11.488 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-10-08T19:15:11.490 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:11.516 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.035) 0:04:15.542 ******** 2021-10-08T19:15:11.548 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-10-08T19:15:11.550 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-08T19:15:11.572 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.055) 0:04:15.598 ******** 2021-10-08T19:15:11.663 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-08T19:15:11.665 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-10-08T19:15:11.690 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.117) 0:04:15.716 ******** 2021-10-08T19:15:11.731 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-10-08T19:15:11.734 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:11.754 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.064) 0:04:15.780 ******** 2021-10-08T19:15:11.772 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-10-08T19:15:11.801 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.046) 0:04:15.827 ******** 2021-10-08T19:15:11.808 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-10-08T19:15:11.809 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-08T19:15:11.832 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.031) 0:04:15.858 ******** 2021-10-08T19:15:11.839 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-10-08T19:15:11.841 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:11.866 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.032) 0:04:15.891 ******** 2021-10-08T19:15:11.872 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-10-08T19:15:11.873 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:11.900 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.035) 0:04:15.926 ******** 2021-10-08T19:15:11.910 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-08T19:15:11.938 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.038) 0:04:15.964 ******** 2021-10-08T19:15:11.978 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.001 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:11 +0000 (0:00:00.063) 0:04:16.027 ******** 2021-10-08T19:15:12.091 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-10-08T19:15:12.093 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-08T19:15:12.116 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.114) 0:04:16.142 ******** 2021-10-08T19:15:12.191 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-08T19:15:12.217 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.101) 0:04:16.243 ******** 2021-10-08T19:15:12.321 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-08T19:15:12.345 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.128) 0:04:16.371 ******** 2021-10-08T19:15:12.373 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-08T19:15:12.375 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.396 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.050) 0:04:16.422 ******** 2021-10-08T19:15:12.413 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-08T19:15:12.415 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-08T19:15:12.440 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.043) 0:04:16.465 ******** 2021-10-08T19:15:12.449 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-10-08T19:15:12.452 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.463 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.491 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.051) 0:04:16.517 ******** 2021-10-08T19:15:12.499 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-08T19:15:12.501 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.524 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.033) 0:04:16.550 ******** 2021-10-08T19:15:12.533 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-08T19:15:12.535 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.547 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.548 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.548 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.548 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.562 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-10-08T19:15:12.564 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.594 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.062) 0:04:16.613 ******** 2021-10-08T19:15:12.596 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.597 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.624 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.036) 0:04:16.649 ******** 2021-10-08T19:15:12.630 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:15:12.632 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.658 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.035) 0:04:16.684 ******** 2021-10-08T19:15:12.677 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-08T19:15:12.679 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.690 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.692 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-10-08T19:15:12.692 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.714 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.055) 0:04:16.740 ******** 2021-10-08T19:15:12.734 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.020) 0:04:16.760 ******** 2021-10-08T19:15:12.752 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-10-08T19:15:12.754 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.777 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.043) 0:04:16.803 ******** 2021-10-08T19:15:12.785 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:15:12.787 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.812 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.035) 0:04:16.838 ******** 2021-10-08T19:15:12.819 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-10-08T19:15:12.821 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.845 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.032) 0:04:16.871 ******** 2021-10-08T19:15:12.854 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.878 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.033) 0:04:16.904 ******** 2021-10-08T19:15:12.886 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-10-08T19:15:12.888 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.915 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.036) 0:04:16.941 ******** 2021-10-08T19:15:12.923 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-10-08T19:15:12.925 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.949 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.034) 0:04:16.975 ******** 2021-10-08T19:15:12.954 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-08T19:15:12.956 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:12.987 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:12 +0000 (0:00:00.038) 0:04:17.013 ******** 2021-10-08T19:15:12.994 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-10-08T19:15:12.996 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:13.018 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:13 +0000 (0:00:00.030) 0:04:17.044 ******** 2021-10-08T19:15:13.024 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:13.052 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:13 +0000 (0:00:00.034) 0:04:17.078 ******** 2021-10-08T19:15:13.060 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-10-08T19:15:13.061 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:13.087 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:13 +0000 (0:00:00.034) 0:04:17.113 ******** 2021-10-08T19:15:13.093 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-08T19:15:13.096 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:13.120 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:13 +0000 (0:00:00.033) 0:04:17.146 ******** 2021-10-08T19:15:13.129 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-08T19:15:13.131 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:13.158 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:13 +0000 (0:00:00.037) 0:04:17.184 ******** 2021-10-08T19:15:13.198 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:13.222 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:13 +0000 (0:00:00.064) 0:04:17.248 ******** 2021-10-08T19:15:13.250 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-08T19:15:13.252 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:13.284 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:13 +0000 (0:00:00.062) 0:04:17.310 ******** 2021-10-08T19:15:13.347 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-08T19:15:13.349 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005137", "end": "2021-10-08 19:15:13.308164", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-08 19:15:13.303027", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:13.527 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004977", "end": "2021-10-08 19:15:13.484372", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-08 19:15:13.479395", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi157.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003003", "end": "2021-10-08 19:15:13.487333", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-08 19:15:13.484330", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:13.703 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002844", "end": "2021-10-08 19:15:13.669142", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:15:13.666298", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:13.705 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002855", "end": "2021-10-08 19:15:13.669168", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-08 19:15:13.666313", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:13.862 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002749", "end": "2021-10-08 19:15:13.838231", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:15:13.835482", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:13.874 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003238", "end": "2021-10-08 19:15:13.841237", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-08 19:15:13.837999", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:13.898 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:13 +0000 (0:00:00.614) 0:04:17.925 ******** 2021-10-08T19:15:13.926 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-08T19:15:13.949 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:13 +0000 (0:00:00.050) 0:04:17.975 ******** 2021-10-08T19:15:13.976 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-10-08T19:15:13.977 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:14.041 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi196.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003145", "end": "2021-10-08 19:15:14.009002", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-08 19:15:14.005857", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:14.064 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:14 +0000 (0:00:00.115) 0:04:18.090 ******** 2021-10-08T19:15:14.093 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-08T19:15:14.115 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:14 +0000 (0:00:00.050) 0:04:18.141 ******** 2021-10-08T19:15:14.144 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:14.213 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-10-08T19:15:14.233 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:14 +0000 (0:00:00.118) 0:04:18.259 ******** 2021-10-08T19:15:14.259 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:14 +0000 (0:00:00.024) 0:04:18.283 ******** 2021-10-08T19:15:14.880 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi157.front.sepia.ceph.com] 2021-10-08T19:15:14.929 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:14 +0000 (0:00:00.671) 0:04:18.955 ******** 2021-10-08T19:15:14.941 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] 2021-10-08T19:15:14.971 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:14.995 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:14 +0000 (0:00:00.066) 0:04:19.021 ******** 2021-10-08T19:15:15.019 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:15 +0000 (0:00:00.023) 0:04:19.045 ******** 2021-10-08T19:15:15.028 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-08T19:15:15.030 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-10-08T19:15:15.055 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:15 +0000 (0:00:00.036) 0:04:19.081 ******** 2021-10-08T19:15:15.063 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:15.088 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:15 +0000 (0:00:00.033) 0:04:19.114 ******** 2021-10-08T19:15:15.097 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-10-08T19:15:15.099 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-10-08T19:15:15.139 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:15 +0000 (0:00:00.049) 0:04:19.164 ******** 2021-10-08T19:15:15.149 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-10-08T19:15:15.171 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:15 +0000 (0:00:00.033) 0:04:19.197 ******** 2021-10-08T19:15:15.223 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-10-08T19:15:15.248 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:15 +0000 (0:00:00.077) 0:04:19.274 ******** 2021-10-08T19:15:20.633 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Installed: podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aada8.noarch", "Installed: podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Removed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch"]} 2021-10-08T19:15:20.653 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:20 +0000 (0:00:05.405) 0:04:24.680 ******** 2021-10-08T19:15:20.662 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Installed: podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aada8.noarch", "Installed: podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Removed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch"]} 2021-10-08T19:15:20.687 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:20 +0000 (0:00:00.033) 0:04:24.713 ******** 2021-10-08T19:15:20.694 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-08T19:15:20.697 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-10-08T19:15:20.722 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:20 +0000 (0:00:00.034) 0:04:24.748 ******** 2021-10-08T19:15:20.735 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-10-08T19:15:20.758 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:20 +0000 (0:00:00.036) 0:04:24.784 ******** 2021-10-08T19:15:20.765 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-08T19:15:20.768 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:20.792 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:20 +0000 (0:00:00.033) 0:04:24.818 ******** 2021-10-08T19:15:20.802 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:20.830 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:20 +0000 (0:00:00.037) 0:04:24.855 ******** 2021-10-08T19:15:21.033 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-08T19:15:21.036 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:15:21.048 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:15:21.237 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:15:21.264 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:21 +0000 (0:00:00.435) 0:04:25.290 ******** 2021-10-08T19:15:21.274 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:15:21.300 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:21 +0000 (0:00:00.035) 0:04:25.326 ******** 2021-10-08T19:15:21.758 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-08T19:15:21.761 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:15:21.792 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:15:22.221 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} ok: [smithi196.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:15:22.244 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:22 +0000 (0:00:00.944) 0:04:26.270 ******** 2021-10-08T19:15:22.280 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:22 +0000 (0:00:00.035) 0:04:26.306 ******** 2021-10-08T19:15:23.529 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-10-08T19:15:23.531 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:15:23.552 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:23 +0000 (0:00:01.271) 0:04:27.578 ******** 2021-10-08T19:15:23.570 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:15:23.601 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:23 +0000 (0:00:00.049) 0:04:27.627 ******** 2021-10-08T19:15:26.145 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-7lvewgdi-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-7lvewgdi-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0 2021-10-08T19:15:26.147 INFO:teuthology.task.ansible.out::", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-jrixmwdb-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-jrixmwdb-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/ 2021-10-08T19:15:26.152 INFO:teuthology.task.ansible.out:lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-08T19:15:26.179 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:26 +0000 (0:00:02.569) 0:04:30.197 ******** 2021-10-08T19:15:26.193 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:26 +0000 (0:00:00.022) 0:04:30.219 ******** 2021-10-08T19:15:26.202 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-10-08T19:15:26.203 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:26.229 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:26 +0000 (0:00:00.035) 0:04:30.255 ******** 2021-10-08T19:15:26.237 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:26.264 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:26 +0000 (0:00:00.034) 0:04:30.290 ******** 2021-10-08T19:15:26.271 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:26.297 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:26 +0000 (0:00:00.033) 0:04:30.323 ******** 2021-10-08T19:15:26.304 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:26.329 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:26 +0000 (0:00:00.032) 0:04:30.356 ******** 2021-10-08T19:15:26.672 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.160239", "end": "2021-10-08 19:15:26.647516", "rc": 0, "start": "2021-10-08 19:15:26.487277", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:26.696 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:26 +0000 (0:00:00.366) 0:04:30.722 ******** 2021-10-08T19:15:26.711 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.166543", "end": "2021-10-08 19:15:26.672013", "rc": 0, "start": "2021-10-08 19:15:26.505470", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:15:26.733 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:15:26 +0000 (0:00:00.036) 0:04:30.759 ******** 2021-10-08T19:15:26.759 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-10-08T19:15:26.840 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:15:26.879 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-10-08T19:15:26.880 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-10-08T19:15:26.882 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-10-08T19:15:26.882 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-08T19:15:26.897 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Friday 08 October 2021 19:15:26 +0000 (0:00:00.163) 0:04:30.923 ******** 2021-10-08T19:15:28.562 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] 2021-10-08T19:15:28.582 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] 2021-10-08T19:15:28.600 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Friday 08 October 2021 19:15:28 +0000 (0:00:01.702) 0:04:32.625 ******** 2021-10-08T19:15:28.800 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:15:28.833 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:15:28.834 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-10-08T19:15:28.836 INFO:teuthology.task.ansible.out:smithi157.front.sepia.ceph.com : ok=132 changed=40 unreachable=0 failed=0 skipped=188 rescued=0 ignored=3 smithi196.front.sepia.ceph.com : ok=132 changed=40 unreachable=0 failed=0 skipped=188 rescued=0 ignored=3 Friday 08 October 2021 19:15:28 +0000 (0:00:00.235) 0:04:32.861 ******** =============================================================================== common : nrpe - Ensure SELinux policy is up to date -------------------- 37.42s Create all admin users with sudo access. ------------------------------- 35.61s users : Update authorized_keys using the keys repo --------------------- 31.78s Remove revoked users --------------------------------------------------- 17.43s common : nrpe - Remove SELinux policy package -------------------------- 14.81s common : nrpe - Load SELinux policy package ---------------------------- 14.73s testnode : Zap all non-root disks --------------------------------------- 7.79s testnode : Install packages --------------------------------------------- 6.95s container-host : Install container packages ----------------------------- 5.41s testnode : Ensure ceph packages are not present. ------------------------ 3.92s common : Install Kerberos Packages (RedHat) ----------------------------- 2.82s container-host : Install registries-conf-ctl ---------------------------- 2.57s testnode : Rebuild rpmdb ------------------------------------------------ 2.45s testnode : Ensure ceph dependency packages are not present. ------------- 2.41s testnode : Configure local mirrorlists ---------------------------------- 1.99s testnode : Create logical volume(s) ------------------------------------- 1.92s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.81s users : Update authorized_keys for each user with literal keys ---------- 1.73s Gathering Facts --------------------------------------------------------- 1.70s testnode : Blow away lingering OSD data and FSIDs 2021-10-08T19:15:28.838 INFO:teuthology.task.ansible.out: ----------------------- 1.60s 2021-10-08T19:15:29.209 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2021-10-08T19:15:29.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2021-10-08T19:15:29.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:15:29.291 DEBUG:teuthology.orchestra.run.smithi157:> true 2021-10-08T19:15:29.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2021-10-08T19:15:29.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:15:29.439 DEBUG:teuthology.orchestra.run.smithi196:> true 2021-10-08T19:15:29.519 INFO:teuthology.run_tasks:Running task clock... 2021-10-08T19:15:29.532 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-10-08T19:15:29.532 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-08T19:15:29.534 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-08T19:15:29.567 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-10-08T19:15:29.581 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-10-08T19:15:29.615 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2021-10-08T19:15:29.624 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2021-10-08T19:15:29.639 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-10-08T19:15:29.651 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-10-08T19:15:29.717 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2021-10-08T19:15:29.721 INFO:teuthology.orchestra.run.smithi157.stdout:210 Number of sources = 4 2021-10-08T19:15:29.721 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-10-08T19:15:29.722 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2021-10-08T19:15:29.722 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:15:29.722 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:15:29.723 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:15:29.723 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:15:29.723 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-08T19:15:29.724 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-08T19:15:29.768 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-10-08T19:15:29.782 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-10-08T19:15:29.817 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2021-10-08T19:15:29.828 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2021-10-08T19:15:29.838 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-10-08T19:15:29.852 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-10-08T19:15:29.918 INFO:teuthology.orchestra.run.smithi196.stderr:bash: ntpq: command not found 2021-10-08T19:15:29.919 INFO:teuthology.orchestra.run.smithi196.stdout:210 Number of sources = 4 2021-10-08T19:15:29.920 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-10-08T19:15:29.920 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2021-10-08T19:15:29.921 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:15:29.921 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:15:29.921 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:15:29.922 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:15:29.923 INFO:teuthology.run_tasks:Running task pexec... 2021-10-08T19:15:29.946 INFO:teuthology.task.pexec:Executing custom commands... 2021-10-08T19:15:29.947 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi157.front.sepia.ceph.com 2021-10-08T19:15:29.947 DEBUG:teuthology.orchestra.run.smithi157:> TESTDIR=/home/ubuntu/cephtest bash -s 2021-10-08T19:15:29.948 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi196.front.sepia.ceph.com 2021-10-08T19:15:29.948 DEBUG:teuthology.orchestra.run.smithi196:> TESTDIR=/home/ubuntu/cephtest bash -s 2021-10-08T19:15:30.465 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:06 ago on Fri 08 Oct 2021 07:14:24 PM UTC. 2021-10-08T19:15:30.518 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:06 ago on Fri 08 Oct 2021 07:14:24 PM UTC. 2021-10-08T19:15:31.147 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:15:31.148 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:15:31.148 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2021-10-08T19:15:31.148 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:15:31.148 INFO:teuthology.orchestra.run.smithi157.stdout:Resetting modules: 2021-10-08T19:15:31.149 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools 2021-10-08T19:15:31.149 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:15:31.149 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:15:31.149 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:15:31.149 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:15:31.228 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:15:31.228 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:15:31.229 INFO:teuthology.orchestra.run.smithi196.stdout: Package Architecture Version Repository Size 2021-10-08T19:15:31.229 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:15:31.229 INFO:teuthology.orchestra.run.smithi196.stdout:Resetting modules: 2021-10-08T19:15:31.229 INFO:teuthology.orchestra.run.smithi196.stdout: container-tools 2021-10-08T19:15:31.229 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:15:31.230 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:15:31.230 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:15:31.230 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:15:31.397 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:15:31.468 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:15:31.924 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:07 ago on Fri 08 Oct 2021 07:14:24 PM UTC. 2021-10-08T19:15:31.995 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:07 ago on Fri 08 Oct 2021 07:14:24 PM UTC. 2021-10-08T19:15:32.608 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:15:32.611 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================================== 2021-10-08T19:15:32.612 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:15:32.612 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================================== 2021-10-08T19:15:32.612 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2021-10-08T19:15:32.613 INFO:teuthology.orchestra.run.smithi157.stdout: containernetworking-plugins x86_64 0.9.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 20 M 2021-10-08T19:15:32.613 INFO:teuthology.orchestra.run.smithi157.stdout: criu x86_64 3.15-1.module_el8.4.0+786+4668b267 CentOS-AppStream 511 k 2021-10-08T19:15:32.615 INFO:teuthology.orchestra.run.smithi157.stdout: libslirp x86_64 4.3.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 69 k 2021-10-08T19:15:32.615 INFO:teuthology.orchestra.run.smithi157.stdout: slirp4netns x86_64 1.1.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:15:32.616 INFO:teuthology.orchestra.run.smithi157.stdout:Installing group/module packages: 2021-10-08T19:15:32.616 INFO:teuthology.orchestra.run.smithi157.stdout: buildah x86_64 1.19.7-1.module_el8.4.0+786+4668b267 CentOS-AppStream 6.9 M 2021-10-08T19:15:32.616 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman noarch 29-2.module_el8.4.0+786+4668b267 CentOS-AppStream 1.1 M 2021-10-08T19:15:32.617 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 5.9 M 2021-10-08T19:15:32.617 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox noarch 0.0.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 16 k 2021-10-08T19:15:32.618 INFO:teuthology.orchestra.run.smithi157.stdout: udica noarch 0.2.4-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:15:32.618 INFO:teuthology.orchestra.run.smithi157.stdout:Downgrading: 2021-10-08T19:15:32.619 INFO:teuthology.orchestra.run.smithi157.stdout: conmon x86_64 2:2.0.26-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:15:32.619 INFO:teuthology.orchestra.run.smithi157.stdout: container-selinux noarch 2:2.158.0-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:15:32.619 INFO:teuthology.orchestra.run.smithi157.stdout: containers-common x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 97 k 2021-10-08T19:15:32.620 INFO:teuthology.orchestra.run.smithi157.stdout: crun x86_64 0.18-2.module_el8.4.0+786+4668b267 CentOS-AppStream 185 k 2021-10-08T19:15:32.620 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-overlayfs x86_64 1.4.0-2.module_el8.4.0+786+4668b267 CentOS-AppStream 72 k 2021-10-08T19:15:32.621 INFO:teuthology.orchestra.run.smithi157.stdout: podman x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 11 M 2021-10-08T19:15:32.621 INFO:teuthology.orchestra.run.smithi157.stdout: podman-catatonit x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 320 k 2021-10-08T19:15:32.622 INFO:teuthology.orchestra.run.smithi157.stdout: podman-docker noarch 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 55 k 2021-10-08T19:15:32.622 INFO:teuthology.orchestra.run.smithi157.stdout: runc x86_64 1.0.0-71.rc92.module_el8.4.0+833+9763146c CentOS-AppStream 3.1 M 2021-10-08T19:15:32.623 INFO:teuthology.orchestra.run.smithi157.stdout:Installing module profiles: 2021-10-08T19:15:32.623 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools/common 2021-10-08T19:15:32.624 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling module streams: 2021-10-08T19:15:32.624 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools 3.0 2021-10-08T19:15:32.625 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:15:32.625 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:15:32.626 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================================== 2021-10-08T19:15:32.626 INFO:teuthology.orchestra.run.smithi157.stdout:Install 5 Packages 2021-10-08T19:15:32.627 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 4 Packages 2021-10-08T19:15:32.627 INFO:teuthology.orchestra.run.smithi157.stdout:Downgrade 9 Packages 2021-10-08T19:15:32.627 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:15:32.628 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 49 M 2021-10-08T19:15:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:15:32.646 INFO:teuthology.orchestra.run.smithi157.stdout:(1/18): conmon-2.0.26-1.module_el8.4.0+786+4668 1.6 MB/s | 51 kB 00:00 2021-10-08T19:15:32.650 INFO:teuthology.orchestra.run.smithi157.stdout:(2/18): crun-0.18-2.module_el8.4.0+786+4668b267 62 MB/s | 185 kB 00:00 2021-10-08T19:15:32.651 INFO:teuthology.orchestra.run.smithi157.stdout:(3/18): container-selinux-2.158.0-1.module_el8. 1.4 MB/s | 51 kB 00:00 2021-10-08T19:15:32.652 INFO:teuthology.orchestra.run.smithi157.stdout:(4/18): fuse-overlayfs-1.4.0-2.module_el8.4.0+7 32 MB/s | 72 kB 00:00 2021-10-08T19:15:32.663 INFO:teuthology.orchestra.run.smithi157.stdout:(5/18): containers-common-1.2.2-7.module_el8.4. 2.1 MB/s | 97 kB 00:00 2021-10-08T19:15:32.663 INFO:teuthology.orchestra.run.smithi157.stdout:(6/18): podman-catatonit-3.0.1-6.module_el8.4.0 36 MB/s | 320 kB 00:00 2021-10-08T19:15:32.664 INFO:teuthology.orchestra.run.smithi157.stdout:(7/18): podman-docker-3.0.1-6.module_el8.4.0+78 19 MB/s | 55 kB 00:00 2021-10-08T19:15:32.700 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:15:32.702 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================================== 2021-10-08T19:15:32.703 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:15:32.703 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================================== 2021-10-08T19:15:32.703 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2021-10-08T19:15:32.703 INFO:teuthology.orchestra.run.smithi196.stdout: containernetworking-plugins x86_64 0.9.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 20 M 2021-10-08T19:15:32.704 INFO:teuthology.orchestra.run.smithi196.stdout: criu x86_64 3.15-1.module_el8.4.0+786+4668b267 CentOS-AppStream 511 k 2021-10-08T19:15:32.704 INFO:teuthology.orchestra.run.smithi196.stdout: libslirp x86_64 4.3.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 69 k 2021-10-08T19:15:32.704 INFO:teuthology.orchestra.run.smithi196.stdout: slirp4netns x86_64 1.1.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:15:32.704 INFO:teuthology.orchestra.run.smithi196.stdout:Installing group/module packages: 2021-10-08T19:15:32.704 INFO:teuthology.orchestra.run.smithi196.stdout: buildah x86_64 1.19.7-1.module_el8.4.0+786+4668b267 CentOS-AppStream 6.9 M 2021-10-08T19:15:32.705 INFO:teuthology.orchestra.run.smithi196.stdout: cockpit-podman noarch 29-2.module_el8.4.0+786+4668b267 CentOS-AppStream 1.1 M 2021-10-08T19:15:32.705 INFO:teuthology.orchestra.run.smithi196.stdout: skopeo x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 5.9 M 2021-10-08T19:15:32.705 INFO:teuthology.orchestra.run.smithi196.stdout: toolbox noarch 0.0.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 16 k 2021-10-08T19:15:32.705 INFO:teuthology.orchestra.run.smithi196.stdout: udica noarch 0.2.4-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:15:32.706 INFO:teuthology.orchestra.run.smithi196.stdout:Downgrading: 2021-10-08T19:15:32.706 INFO:teuthology.orchestra.run.smithi196.stdout: conmon x86_64 2:2.0.26-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:15:32.706 INFO:teuthology.orchestra.run.smithi196.stdout: container-selinux noarch 2:2.158.0-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-10-08T19:15:32.706 INFO:teuthology.orchestra.run.smithi196.stdout: containers-common x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 97 k 2021-10-08T19:15:32.706 INFO:teuthology.orchestra.run.smithi196.stdout: crun x86_64 0.18-2.module_el8.4.0+786+4668b267 CentOS-AppStream 185 k 2021-10-08T19:15:32.707 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-overlayfs x86_64 1.4.0-2.module_el8.4.0+786+4668b267 CentOS-AppStream 72 k 2021-10-08T19:15:32.707 INFO:teuthology.orchestra.run.smithi196.stdout: podman x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 11 M 2021-10-08T19:15:32.707 INFO:teuthology.orchestra.run.smithi196.stdout: podman-catatonit x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 320 k 2021-10-08T19:15:32.707 INFO:teuthology.orchestra.run.smithi196.stdout: podman-docker noarch 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 55 k 2021-10-08T19:15:32.708 INFO:teuthology.orchestra.run.smithi196.stdout: runc x86_64 1.0.0-71.rc92.module_el8.4.0+833+9763146c CentOS-AppStream 3.1 M 2021-10-08T19:15:32.708 INFO:teuthology.orchestra.run.smithi196.stdout:Installing module profiles: 2021-10-08T19:15:32.708 INFO:teuthology.orchestra.run.smithi196.stdout: container-tools/common 2021-10-08T19:15:32.708 INFO:teuthology.orchestra.run.smithi196.stdout:Enabling module streams: 2021-10-08T19:15:32.708 INFO:teuthology.orchestra.run.smithi196.stdout: container-tools 3.0 2021-10-08T19:15:32.709 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:15:32.709 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:15:32.709 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================================== 2021-10-08T19:15:32.709 INFO:teuthology.orchestra.run.smithi196.stdout:Install 5 Packages 2021-10-08T19:15:32.709 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 4 Packages 2021-10-08T19:15:32.710 INFO:teuthology.orchestra.run.smithi196.stdout:Downgrade 9 Packages 2021-10-08T19:15:32.710 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:15:32.711 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 49 M 2021-10-08T19:15:32.711 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:15:32.744 INFO:teuthology.orchestra.run.smithi196.stdout:(1/18): container-selinux-2.158.0-1.module_el8. 1.3 MB/s | 51 kB 00:00 2021-10-08T19:15:32.745 INFO:teuthology.orchestra.run.smithi157.stdout:(8/18): runc-1.0.0-71.rc92.module_el8.4.0+833+9 37 MB/s | 3.1 MB 00:00 2021-10-08T19:15:32.745 INFO:teuthology.orchestra.run.smithi196.stdout:(2/18): conmon-2.0.26-1.module_el8.4.0+786+4668 1.3 MB/s | 51 kB 00:00 2021-10-08T19:15:32.755 INFO:teuthology.orchestra.run.smithi196.stdout:(3/18): fuse-overlayfs-1.4.0-2.module_el8.4.0+7 7.2 MB/s | 72 kB 00:00 2021-10-08T19:15:32.764 INFO:teuthology.orchestra.run.smithi196.stdout:(4/18): crun-0.18-2.module_el8.4.0+786+4668b267 9.4 MB/s | 185 kB 00:00 2021-10-08T19:15:32.776 INFO:teuthology.orchestra.run.smithi196.stdout:(5/18): containers-common-1.2.2-7.module_el8.4. 1.4 MB/s | 97 kB 00:00 2021-10-08T19:15:32.782 INFO:teuthology.orchestra.run.smithi157.stdout:(9/18): cockpit-podman-29-2.module_el8.4.0+786+ 29 MB/s | 1.1 MB 00:00 2021-10-08T19:15:32.786 INFO:teuthology.orchestra.run.smithi196.stdout:(6/18): podman-docker-3.0.1-6.module_el8.4.0+78 5.3 MB/s | 55 kB 00:00 2021-10-08T19:15:32.803 INFO:teuthology.orchestra.run.smithi196.stdout:(7/18): podman-catatonit-3.0.1-6.module_el8.4.0 8.0 MB/s | 320 kB 00:00 2021-10-08T19:15:32.927 INFO:teuthology.orchestra.run.smithi157.stdout:(10/18): podman-3.0.1-6.module_el8.4.0+786+4668 41 MB/s | 11 MB 00:00 2021-10-08T19:15:32.934 INFO:teuthology.orchestra.run.smithi157.stdout:(11/18): toolbox-0.0.8-1.module_el8.4.0+786+466 2.1 MB/s | 16 kB 00:00 2021-10-08T19:15:32.943 INFO:teuthology.orchestra.run.smithi157.stdout:(12/18): udica-0.2.4-1.module_el8.4.0+786+4668b 5.9 MB/s | 51 kB 00:00 2021-10-08T19:15:33.008 INFO:teuthology.orchestra.run.smithi157.stdout:(13/18): skopeo-1.2.2-7.module_el8.4.0+786+4668 27 MB/s | 5.9 MB 00:00 2021-10-08T19:15:33.030 INFO:teuthology.orchestra.run.smithi157.stdout:(14/18): criu-3.15-1.module_el8.4.0+786+4668b26 18 MB/s | 511 kB 00:00 2021-10-08T19:15:33.043 INFO:teuthology.orchestra.run.smithi157.stdout:(15/18): libslirp-4.3.1-1.module_el8.4.0+786+46 5.0 MB/s | 69 kB 00:00 2021-10-08T19:15:33.057 INFO:teuthology.orchestra.run.smithi157.stdout:(16/18): slirp4netns-1.1.8-1.module_el8.4.0+786 3.8 MB/s | 51 kB 00:00 2021-10-08T19:15:33.111 INFO:teuthology.orchestra.run.smithi157.stdout:(17/18): buildah-1.19.7-1.module_el8.4.0+786+46 15 MB/s | 6.9 MB 00:00 2021-10-08T19:15:33.118 INFO:teuthology.orchestra.run.smithi196.stdout:(8/18): runc-1.0.0-71.rc92.module_el8.4.0+833+9 9.3 MB/s | 3.1 MB 00:00 2021-10-08T19:15:33.216 INFO:teuthology.orchestra.run.smithi196.stdout:(9/18): cockpit-podman-29-2.module_el8.4.0+786+ 11 MB/s | 1.1 MB 00:00 2021-10-08T19:15:33.275 INFO:teuthology.orchestra.run.smithi196.stdout:(10/18): buildah-1.19.7-1.module_el8.4.0+786+46 15 MB/s | 6.9 MB 00:00 2021-10-08T19:15:33.291 INFO:teuthology.orchestra.run.smithi196.stdout:(11/18): toolbox-0.0.8-1.module_el8.4.0+786+466 976 kB/s | 16 kB 00:00 2021-10-08T19:15:33.332 INFO:teuthology.orchestra.run.smithi196.stdout:(12/18): podman-3.0.1-6.module_el8.4.0+786+4668 20 MB/s | 11 MB 00:00 2021-10-08T19:15:33.404 INFO:teuthology.orchestra.run.smithi196.stdout:(13/18): udica-0.2.4-1.module_el8.4.0+786+4668b 449 kB/s | 51 kB 00:00 2021-10-08T19:15:33.429 INFO:teuthology.orchestra.run.smithi196.stdout:(14/18): criu-3.15-1.module_el8.4.0+786+4668b26 20 MB/s | 511 kB 00:00 2021-10-08T19:15:33.430 INFO:teuthology.orchestra.run.smithi157.stdout:(18/18): containernetworking-plugins-0.9.1-1.mo 40 MB/s | 20 MB 00:00 2021-10-08T19:15:33.432 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:33.432 INFO:teuthology.orchestra.run.smithi157.stdout:Total 60 MB/s | 49 MB 00:00 2021-10-08T19:15:33.437 INFO:teuthology.orchestra.run.smithi196.stdout:(15/18): libslirp-4.3.1-1.module_el8.4.0+786+46 8.4 MB/s | 69 kB 00:00 2021-10-08T19:15:33.446 INFO:teuthology.orchestra.run.smithi196.stdout:(16/18): slirp4netns-1.1.8-1.module_el8.4.0+786 5.9 MB/s | 51 kB 00:00 2021-10-08T19:15:33.448 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:15:33.491 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:15:33.491 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:15:33.567 INFO:teuthology.orchestra.run.smithi196.stdout:(17/18): skopeo-1.2.2-7.module_el8.4.0+786+4668 17 MB/s | 5.9 MB 00:00 2021-10-08T19:15:33.733 INFO:teuthology.orchestra.run.smithi196.stdout:(18/18): containernetworking-plugins-0.9.1-1.mo 49 MB/s | 20 MB 00:00 2021-10-08T19:15:33.736 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:33.737 INFO:teuthology.orchestra.run.smithi196.stdout:Total 48 MB/s | 49 MB 00:01 2021-10-08T19:15:33.752 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:15:33.795 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:15:33.796 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:15:34.015 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:15:34.017 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:15:34.331 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:15:34.335 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:15:35.218 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:15:35.257 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x 1/1 2021-10-08T19:15:35.414 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-10-08T19:15:35.422 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-10-08T19:15:35.436 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:15:35.568 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:15:35.613 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x 1/1 2021-10-08T19:15:35.668 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:15:35.785 INFO:teuthology.orchestra.run.smithi196.stdout: Downgrading : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-10-08T19:15:35.793 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-10-08T19:15:35.813 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:15:36.005 INFO:teuthology.orchestra.run.smithi196.stdout: Downgrading : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:15:50.662 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:15:50.852 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 3/31 2021-10-08T19:15:51.032 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-10-08T19:15:51.034 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 4/31 2021-10-08T19:15:51.198 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 3/31 2021-10-08T19:15:51.287 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-10-08T19:15:51.362 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 4/31 2021-10-08T19:15:51.581 INFO:teuthology.orchestra.run.smithi196.stdout: Downgrading : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-10-08T19:15:51.785 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 6/31 2021-10-08T19:15:52.138 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 6/31 2021-10-08T19:15:53.707 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 7/31 2021-10-08T19:15:53.911 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : containernetworking-plugins-0.9.1-1.module_el8.4.0 8/31 2021-10-08T19:15:54.014 INFO:teuthology.orchestra.run.smithi196.stdout: Downgrading : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 7/31 2021-10-08T19:15:54.118 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 9/31 2021-10-08T19:15:54.195 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : containernetworking-plugins-0.9.1-1.module_el8.4.0 8/31 2021-10-08T19:15:54.303 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 10/31 2021-10-08T19:15:54.364 INFO:teuthology.orchestra.run.smithi196.stdout: Downgrading : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 9/31 2021-10-08T19:15:54.544 INFO:teuthology.orchestra.run.smithi196.stdout: Downgrading : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 10/31 2021-10-08T19:15:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 11/31 2021-10-08T19:15:55.967 INFO:teuthology.orchestra.run.smithi196.stdout: Downgrading : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 11/31 2021-10-08T19:15:56.168 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 12/31 2021-10-08T19:15:56.243 INFO:teuthology.orchestra.run.smithi196.stdout: Downgrading : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 12/31 2021-10-08T19:15:56.396 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 13/31 2021-10-08T19:15:56.484 INFO:teuthology.orchestra.run.smithi196.stdout: Downgrading : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 13/31 2021-10-08T19:15:56.583 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 14/31 2021-10-08T19:15:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 14/31 2021-10-08T19:15:57.288 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 15/31 2021-10-08T19:15:57.333 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 15/31 2021-10-08T19:15:57.947 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 16/31 2021-10-08T19:15:57.997 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 16/31 2021-10-08T19:15:58.136 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 17/31 2021-10-08T19:15:58.181 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 17/31 2021-10-08T19:15:58.321 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 18/31 2021-10-08T19:15:58.350 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 18/31 2021-10-08T19:15:58.445 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 19/31 2021-10-08T19:15:58.449 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 19/31 2021-10-08T19:15:58.599 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 20/31 2021-10-08T19:15:58.653 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 20/31 2021-10-08T19:15:58.777 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : containers-common-1:1.2.2-10.module_el8.4.0+830+80 21/31 2021-10-08T19:15:58.825 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : containers-common-1:1.2.2-10.module_el8.4.0+830+80 21/31 2021-10-08T19:15:58.916 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 22/31 2021-10-08T19:15:59.090 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 23/31 2021-10-08T19:15:59.090 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-10-08T19:15:59.426 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 22/31 2021-10-08T19:15:59.603 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 23/31 2021-10-08T19:15:59.603 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-10-08T19:15:59.724 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-10-08T19:15:59.753 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-10-08T19:15:59.848 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 25/31 2021-10-08T19:15:59.905 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 25/31 2021-10-08T19:16:00.035 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 26/31 2021-10-08T19:16:00.050 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 26/31 2021-10-08T19:16:00.156 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 27/31 2021-10-08T19:16:00.195 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 27/31 2021-10-08T19:16:00.560 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 28/31 2021-10-08T19:16:00.560 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 29/31 2021-10-08T19:16:00.561 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 28/31 2021-10-08T19:16:00.561 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 29/31 2021-10-08T19:16:00.602 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 30/31 2021-10-08T19:16:00.658 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 30/31 2021-10-08T19:16:00.789 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-10-08T19:16:00.841 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-10-08T19:16:20.000 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 31/31 2021-10-08T19:16:20.122 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 31/31 2021-10-08T19:16:20.559 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-10-08T19:16:20.559 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 1/31 2021-10-08T19:16:20.559 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 2/31 2021-10-08T19:16:20.559 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 3/31 2021-10-08T19:16:20.560 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 4/31 2021-10-08T19:16:20.560 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-10-08T19:16:20.560 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : containers-common-1:1.2.2-10.module_el8.4.0+830+80 6/31 2021-10-08T19:16:20.560 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 7/31 2021-10-08T19:16:20.561 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 8/31 2021-10-08T19:16:20.561 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 9/31 2021-10-08T19:16:20.561 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 10/31 2021-10-08T19:16:20.561 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 11/31 2021-10-08T19:16:20.562 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 12/31 2021-10-08T19:16:20.562 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 13/31 2021-10-08T19:16:20.562 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 14/31 2021-10-08T19:16:20.562 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 15/31 2021-10-08T19:16:20.562 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 16/31 2021-10-08T19:16:20.563 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 17/31 2021-10-08T19:16:20.563 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 18/31 2021-10-08T19:16:20.563 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 19/31 2021-10-08T19:16:20.563 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 20/31 2021-10-08T19:16:20.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 21/31 2021-10-08T19:16:20.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 22/31 2021-10-08T19:16:20.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 23/31 2021-10-08T19:16:20.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 24/31 2021-10-08T19:16:20.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 25/31 2021-10-08T19:16:20.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 26/31 2021-10-08T19:16:20.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 27/31 2021-10-08T19:16:20.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 28/31 2021-10-08T19:16:20.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 29/31 2021-10-08T19:16:20.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 30/31 2021-10-08T19:16:20.622 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-10-08T19:16:20.622 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 1/31 2021-10-08T19:16:20.622 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 2/31 2021-10-08T19:16:20.623 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 3/31 2021-10-08T19:16:20.623 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 4/31 2021-10-08T19:16:20.623 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-10-08T19:16:20.623 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : containers-common-1:1.2.2-10.module_el8.4.0+830+80 6/31 2021-10-08T19:16:20.624 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 7/31 2021-10-08T19:16:20.624 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 8/31 2021-10-08T19:16:20.624 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 9/31 2021-10-08T19:16:20.624 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 10/31 2021-10-08T19:16:20.624 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 11/31 2021-10-08T19:16:20.625 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 12/31 2021-10-08T19:16:20.625 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 13/31 2021-10-08T19:16:20.625 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 14/31 2021-10-08T19:16:20.625 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 15/31 2021-10-08T19:16:20.625 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 16/31 2021-10-08T19:16:20.626 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 17/31 2021-10-08T19:16:20.626 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 18/31 2021-10-08T19:16:20.626 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 19/31 2021-10-08T19:16:20.626 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 20/31 2021-10-08T19:16:20.627 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 21/31 2021-10-08T19:16:20.627 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 22/31 2021-10-08T19:16:20.627 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 23/31 2021-10-08T19:16:20.627 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 24/31 2021-10-08T19:16:20.627 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 25/31 2021-10-08T19:16:20.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 26/31 2021-10-08T19:16:20.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 27/31 2021-10-08T19:16:20.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 28/31 2021-10-08T19:16:20.629 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 29/31 2021-10-08T19:16:20.629 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 30/31 2021-10-08T19:16:21.203 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 31/31 2021-10-08T19:16:21.203 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:16:21.203 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2021-10-08T19:16:21.204 INFO:teuthology.orchestra.run.smithi157.stdout: containernetworking-plugins-0.9.1-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.204 INFO:teuthology.orchestra.run.smithi157.stdout: criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.204 INFO:teuthology.orchestra.run.smithi157.stdout: libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.204 INFO:teuthology.orchestra.run.smithi157.stdout: slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.204 INFO:teuthology.orchestra.run.smithi157.stdout:Downgraded: 2021-10-08T19:16:21.205 INFO:teuthology.orchestra.run.smithi157.stdout: conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.205 INFO:teuthology.orchestra.run.smithi157.stdout: container-selinux-2:2.158.0-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.205 INFO:teuthology.orchestra.run.smithi157.stdout: containers-common-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.205 INFO:teuthology.orchestra.run.smithi157.stdout: crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.205 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.206 INFO:teuthology.orchestra.run.smithi157.stdout: podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.206 INFO:teuthology.orchestra.run.smithi157.stdout: podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.206 INFO:teuthology.orchestra.run.smithi157.stdout: podman-docker-3.0.1-6.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.206 INFO:teuthology.orchestra.run.smithi157.stdout: runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86_64 2021-10-08T19:16:21.207 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:16:21.207 INFO:teuthology.orchestra.run.smithi157.stdout: buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.207 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman-29-2.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.207 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.207 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.208 INFO:teuthology.orchestra.run.smithi157.stdout: udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.209 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:16:21.209 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:16:21.302 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 31/31 2021-10-08T19:16:21.302 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:16:21.303 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2021-10-08T19:16:21.303 INFO:teuthology.orchestra.run.smithi196.stdout: containernetworking-plugins-0.9.1-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.303 INFO:teuthology.orchestra.run.smithi196.stdout: criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.303 INFO:teuthology.orchestra.run.smithi196.stdout: libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.304 INFO:teuthology.orchestra.run.smithi196.stdout: slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.304 INFO:teuthology.orchestra.run.smithi196.stdout:Downgraded: 2021-10-08T19:16:21.304 INFO:teuthology.orchestra.run.smithi196.stdout: conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.304 INFO:teuthology.orchestra.run.smithi196.stdout: container-selinux-2:2.158.0-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.304 INFO:teuthology.orchestra.run.smithi196.stdout: containers-common-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.305 INFO:teuthology.orchestra.run.smithi196.stdout: crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.305 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.305 INFO:teuthology.orchestra.run.smithi196.stdout: podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.305 INFO:teuthology.orchestra.run.smithi196.stdout: podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.305 INFO:teuthology.orchestra.run.smithi196.stdout: podman-docker-3.0.1-6.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.306 INFO:teuthology.orchestra.run.smithi196.stdout: runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86_64 2021-10-08T19:16:21.306 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:16:21.306 INFO:teuthology.orchestra.run.smithi196.stdout: buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.306 INFO:teuthology.orchestra.run.smithi196.stdout: cockpit-podman-29-2.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.307 INFO:teuthology.orchestra.run.smithi196.stdout: skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-10-08T19:16:21.307 INFO:teuthology.orchestra.run.smithi196.stdout: toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.307 INFO:teuthology.orchestra.run.smithi196.stdout: udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 2021-10-08T19:16:21.307 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:16:21.307 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:16:21.494 DEBUG:teuthology.parallel:result is None 2021-10-08T19:16:21.557 DEBUG:teuthology.parallel:result is None 2021-10-08T19:16:21.558 INFO:teuthology.run_tasks:Running task install... 2021-10-08T19:16:21.570 DEBUG:teuthology.task.install:project ceph 2021-10-08T19:16:21.571 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf'}, 'extra_packages': ['cephadm']} 2021-10-08T19:16:21.571 DEBUG:teuthology.task.install:config {'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf'} 2021-10-08T19:16:21.572 INFO:teuthology.task.install:Using flavor: basic 2021-10-08T19:16:21.579 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-10-08T19:16:21.580 INFO:teuthology.task.install:extra packages: [] 2021-10-08T19:16:21.580 DEBUG:teuthology.orchestra.run.smithi157:> sudo lsb_release -is 2021-10-08T19:16:21.613 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS 2021-10-08T19:16:21.615 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:16:21.615 DEBUG:teuthology.orchestra.run.smithi196:> sudo lsb_release -is 2021-10-08T19:16:21.616 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf', 'tag': None, 'wait_for_package': False} 2021-10-08T19:16:21.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo lsb_release -is 2021-10-08T19:16:21.649 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS 2021-10-08T19:16:21.651 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:16:21.652 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf', 'tag': None, 'wait_for_package': False} 2021-10-08T19:16:21.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo lsb_release -is 2021-10-08T19:16:21.687 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS 2021-10-08T19:16:21.688 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:16:21.689 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:16:21.730 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS 2021-10-08T19:16:21.730 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:16:21.731 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:16:21.868 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/ 2021-10-08T19:16:21.868 INFO:teuthology.task.install.rpm:Package version is 17.0.0-8087.g103b6cc3 2021-10-08T19:16:21.912 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/ 2021-10-08T19:16:21.912 INFO:teuthology.task.install.rpm:Package version is 17.0.0-8087.g103b6cc3 2021-10-08T19:16:22.049 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-10-08T19:16:22.050 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:16:22.050 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-10-08T19:16:22.069 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-10-08T19:16:22.070 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:16:22.070 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-10-08T19:16:22.075 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-10-08T19:16:22.075 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/103b6cc3554193fcd0852d9c647cef19e99920cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-10-08T19:16:22.094 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-10-08T19:16:22.094 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/103b6cc3554193fcd0852d9c647cef19e99920cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-10-08T19:16:22.140 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-10-08T19:16:22.158 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-10-08T19:16:22.216 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-10-08T19:16:22.231 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-10-08T19:16:22.277 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2021-10-08T19:16:22.279 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2021-10-08T19:16:22.295 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2021-10-08T19:16:22.296 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2021-10-08T19:16:22.557 INFO:teuthology.orchestra.run.smithi157.stdout:63 files removed 2021-10-08T19:16:22.574 INFO:teuthology.orchestra.run.smithi196.stdout:63 files removed 2021-10-08T19:16:22.585 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw 2021-10-08T19:16:22.604 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw 2021-10-08T19:16:23.235 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 283 kB/s | 75 kB 00:00 2021-10-08T19:16:23.237 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 307 kB/s | 75 kB 00:00 2021-10-08T19:16:23.472 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 44 kB/s | 9.0 kB 00:00 2021-10-08T19:16:23.473 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 44 kB/s | 9.0 kB 00:00 2021-10-08T19:16:23.701 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2021-10-08T19:16:23.701 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2021-10-08T19:16:23.960 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - AppStream 39 MB/s | 9.3 MB 00:00 2021-10-08T19:16:23.967 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - AppStream 38 MB/s | 9.3 MB 00:00 2021-10-08T19:16:25.549 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - Base 42 MB/s | 7.5 MB 00:00 2021-10-08T19:16:25.602 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - Base 40 MB/s | 7.5 MB 00:00 2021-10-08T19:16:26.654 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - Extras 130 kB/s | 10 kB 00:00 2021-10-08T19:16:26.713 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - Extras 131 kB/s | 10 kB 00:00 2021-10-08T19:16:26.803 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - PowerTools 26 MB/s | 2.4 MB 00:00 2021-10-08T19:16:26.858 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - PowerTools 27 MB/s | 2.4 MB 00:00 2021-10-08T19:16:29.125 INFO:teuthology.orchestra.run.smithi196.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2021-10-08T19:16:29.161 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2021-10-08T19:16:29.954 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 14 MB/s | 10 MB 00:00 2021-10-08T19:16:30.004 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 13 MB/s | 10 MB 00:00 2021-10-08T19:16:32.089 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2021-10-08T19:16:32.209 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2021-10-08T19:16:33.692 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:16:33.695 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:16:33.695 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:16:33.696 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:16:33.696 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:16:33.696 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 8.9 M 2021-10-08T19:16:33.696 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2021-10-08T19:16:33.697 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.4 M 2021-10-08T19:16:33.697 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:16:33.697 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2021-10-08T19:16:33.697 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 5.2 M 2021-10-08T19:16:33.698 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 20 M 2021-10-08T19:16:33.698 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:16:33.698 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-10-08T19:16:33.698 INFO:teuthology.orchestra.run.smithi196.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-10-08T19:16:33.699 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 784 k 2021-10-08T19:16:33.699 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-10-08T19:16:33.700 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-10-08T19:16:33.700 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 483 k 2021-10-08T19:16:33.700 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-10-08T19:16:33.700 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:16:33.701 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-10-08T19:16:33.701 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-10-08T19:16:33.701 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse 2021-10-08T19:16:33.701 INFO:teuthology.orchestra.run.smithi196.stdout: x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 k 2021-10-08T19:16:33.701 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 78 k 2021-10-08T19:16:33.702 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 178 k 2021-10-08T19:16:33.702 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-10-08T19:16:33.702 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 366 k 2021-10-08T19:16:33.702 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 345 k 2021-10-08T19:16:33.703 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 109 k 2021-10-08T19:16:33.703 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:16:33.703 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:16:33.703 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:16:33.704 INFO:teuthology.orchestra.run.smithi196.stdout:Install 21 Packages 2021-10-08T19:16:33.704 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 2 Packages 2021-10-08T19:16:33.704 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:16:33.705 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 49 M 2021-10-08T19:16:33.705 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:16:33.812 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:16:33.815 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:16:33.815 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:16:33.815 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:16:33.816 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:16:33.816 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 8.9 M 2021-10-08T19:16:33.816 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2021-10-08T19:16:33.816 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.4 M 2021-10-08T19:16:33.817 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:16:33.817 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2021-10-08T19:16:33.817 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 5.2 M 2021-10-08T19:16:33.817 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 20 M 2021-10-08T19:16:33.817 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:16:33.818 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-10-08T19:16:33.818 INFO:teuthology.orchestra.run.smithi157.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-10-08T19:16:33.818 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 784 k 2021-10-08T19:16:33.818 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-10-08T19:16:33.819 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-10-08T19:16:33.819 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 483 k 2021-10-08T19:16:33.819 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-10-08T19:16:33.819 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:16:33.820 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-10-08T19:16:33.820 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-10-08T19:16:33.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse 2021-10-08T19:16:33.820 INFO:teuthology.orchestra.run.smithi157.stdout: x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 k 2021-10-08T19:16:33.822 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 78 k 2021-10-08T19:16:33.822 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 178 k 2021-10-08T19:16:33.822 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-10-08T19:16:33.823 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 366 k 2021-10-08T19:16:33.823 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 345 k 2021-10-08T19:16:33.823 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 109 k 2021-10-08T19:16:33.823 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:16:33.823 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:16:33.824 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:16:33.824 INFO:teuthology.orchestra.run.smithi157.stdout:Install 21 Packages 2021-10-08T19:16:33.824 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 2 Packages 2021-10-08T19:16:33.824 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:16:33.825 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 49 M 2021-10-08T19:16:33.825 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:16:34.878 INFO:teuthology.orchestra.run.smithi196.stdout:(1/23): ceph-base-17.0.0-8087.g103b6cc3.el8.x86 4.4 MB/s | 5.2 MB 00:01 2021-10-08T19:16:34.931 INFO:teuthology.orchestra.run.smithi196.stdout:(2/23): ceph-selinux-17.0.0-8087.g103b6cc3.el8. 452 kB/s | 24 kB 00:00 2021-10-08T19:16:35.147 INFO:teuthology.orchestra.run.smithi196.stdout:(3/23): libcephfs2-17.0.0-8087.g103b6cc3.el8.x8 3.6 MB/s | 784 kB 00:00 2021-10-08T19:16:35.193 INFO:teuthology.orchestra.run.smithi157.stdout:(1/23): ceph-base-17.0.0-8087.g103b6cc3.el8.x86 3.8 MB/s | 5.2 MB 00:01 2021-10-08T19:16:35.258 INFO:teuthology.orchestra.run.smithi157.stdout:(2/23): ceph-selinux-17.0.0-8087.g103b6cc3.el8. 375 kB/s | 24 kB 00:00 2021-10-08T19:16:35.263 INFO:teuthology.orchestra.run.smithi196.stdout:(4/23): libradosstriper1-17.0.0-8087.g103b6cc3. 4.1 MB/s | 483 kB 00:00 2021-10-08T19:16:35.498 INFO:teuthology.orchestra.run.smithi157.stdout:(3/23): libcephfs2-17.0.0-8087.g103b6cc3.el8.x8 3.2 MB/s | 784 kB 00:00 2021-10-08T19:16:35.519 INFO:teuthology.orchestra.run.smithi196.stdout:(5/23): ceph-radosgw-17.0.0-8087.g103b6cc3.el8. 4.9 MB/s | 8.9 MB 00:01 2021-10-08T19:16:35.594 INFO:teuthology.orchestra.run.smithi196.stdout:(6/23): python3-ceph-argparse-17.0.0-8087.g103b 594 kB/s | 44 kB 00:00 2021-10-08T19:16:35.632 INFO:teuthology.orchestra.run.smithi157.stdout:(4/23): libradosstriper1-17.0.0-8087.g103b6cc3. 3.5 MB/s | 483 kB 00:00 2021-10-08T19:16:35.666 INFO:teuthology.orchestra.run.smithi196.stdout:(7/23): python3-ceph-common-17.0.0-8087.g103b6c 1.1 MB/s | 78 kB 00:00 2021-10-08T19:16:35.743 INFO:teuthology.orchestra.run.smithi196.stdout:(8/23): python3-cephfs-17.0.0-8087.g103b6cc3.el 2.2 MB/s | 178 kB 00:00 2021-10-08T19:16:35.955 INFO:teuthology.orchestra.run.smithi196.stdout:(9/23): librgw2-17.0.0-8087.g103b6cc3.el8.x86_6 5.5 MB/s | 3.8 MB 00:00 2021-10-08T19:16:36.014 INFO:teuthology.orchestra.run.smithi196.stdout:(10/23): python3-rbd-17.0.0-8087.g103b6cc3.el8. 5.8 MB/s | 345 kB 00:00 2021-10-08T19:16:36.064 INFO:teuthology.orchestra.run.smithi196.stdout:(11/23): python3-rgw-17.0.0-8087.g103b6cc3.el8. 2.2 MB/s | 109 kB 00:00 2021-10-08T19:16:36.103 INFO:teuthology.orchestra.run.smithi196.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 9.1 MB/s | 353 kB 00:00 2021-10-08T19:16:36.106 INFO:teuthology.orchestra.run.smithi196.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 65 MB/s | 259 kB 00:00 2021-10-08T19:16:36.108 INFO:teuthology.orchestra.run.smithi196.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 30 MB/s | 44 kB 00:00 2021-10-08T19:16:36.110 INFO:teuthology.orchestra.run.smithi196.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 31 MB/s | 47 kB 00:00 2021-10-08T19:16:36.131 INFO:teuthology.orchestra.run.smithi157.stdout:(5/23): ceph-radosgw-17.0.0-8087.g103b6cc3.el8. 3.9 MB/s | 8.9 MB 00:02 2021-10-08T19:16:36.172 INFO:teuthology.orchestra.run.smithi157.stdout:(6/23): python3-ceph-argparse-17.0.0-8087.g103b 1.1 MB/s | 44 kB 00:00 2021-10-08T19:16:36.215 INFO:teuthology.orchestra.run.smithi157.stdout:(7/23): python3-ceph-common-17.0.0-8087.g103b6c 1.8 MB/s | 78 kB 00:00 2021-10-08T19:16:36.262 INFO:teuthology.orchestra.run.smithi157.stdout:(8/23): python3-cephfs-17.0.0-8087.g103b6cc3.el 3.7 MB/s | 178 kB 00:00 2021-10-08T19:16:36.310 INFO:teuthology.orchestra.run.smithi157.stdout:(9/23): librgw2-17.0.0-8087.g103b6cc3.el8.x86_6 5.7 MB/s | 3.8 MB 00:00 2021-10-08T19:16:36.316 INFO:teuthology.orchestra.run.smithi196.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2021-10-08T19:16:36.348 INFO:teuthology.orchestra.run.smithi157.stdout:(10/23): python3-rados-17.0.0-8087.g103b6cc3.el 4.2 MB/s | 366 kB 00:00 2021-10-08T19:16:36.390 INFO:teuthology.orchestra.run.smithi157.stdout:(11/23): python3-rbd-17.0.0-8087.g103b6cc3.el8. 4.3 MB/s | 345 kB 00:00 2021-10-08T19:16:36.394 INFO:teuthology.orchestra.run.smithi196.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 2.3 MB/s | 181 kB 00:00 2021-10-08T19:16:36.396 INFO:teuthology.orchestra.run.smithi157.stdout:(12/23): python3-rgw-17.0.0-8087.g103b6cc3.el8. 2.2 MB/s | 109 kB 00:00 2021-10-08T19:16:36.421 INFO:teuthology.orchestra.run.smithi196.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 2.2 MB/s | 59 kB 00:00 2021-10-08T19:16:36.423 INFO:teuthology.orchestra.run.smithi157.stdout:(13/23): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2021-10-08T19:16:36.425 INFO:teuthology.orchestra.run.smithi157.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 29 MB/s | 44 kB 00:00 2021-10-08T19:16:36.427 INFO:teuthology.orchestra.run.smithi157.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 31 MB/s | 47 kB 00:00 2021-10-08T19:16:36.430 INFO:teuthology.orchestra.run.smithi157.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.6 MB/s | 259 kB 00:00 2021-10-08T19:16:36.447 INFO:teuthology.orchestra.run.smithi196.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 2.8 MB/s | 75 kB 00:00 2021-10-08T19:16:36.470 INFO:teuthology.orchestra.run.smithi196.stdout:(20/23): python3-rados-17.0.0-8087.g103b6cc3.el 503 kB/s | 366 kB 00:00 2021-10-08T19:16:36.598 INFO:teuthology.orchestra.run.smithi157.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 1.1 MB/s | 181 kB 00:00 2021-10-08T19:16:36.626 INFO:teuthology.orchestra.run.smithi157.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 2.0 MB/s | 59 kB 00:00 2021-10-08T19:16:36.631 INFO:teuthology.orchestra.run.smithi157.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2021-10-08T19:16:36.683 INFO:teuthology.orchestra.run.smithi157.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2021-10-08T19:16:36.708 INFO:teuthology.orchestra.run.smithi196.stdout:(21/23): ceph-common-17.0.0-8087.g103b6cc3.el8. 6.6 MB/s | 20 MB 00:03 2021-10-08T19:16:37.046 INFO:teuthology.orchestra.run.smithi196.stdout:(22/23): librbd1-17.0.0-8087.g103b6cc3.el8.x86_ 6.7 MB/s | 3.9 MB 00:00 2021-10-08T19:16:37.183 INFO:teuthology.orchestra.run.smithi196.stdout:(23/23): librados2-17.0.0-8087.g103b6cc3.el8.x8 4.6 MB/s | 3.4 MB 00:00 2021-10-08T19:16:37.186 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:16:37.187 INFO:teuthology.orchestra.run.smithi196.stdout:Total 14 MB/s | 49 MB 00:03 2021-10-08T19:16:37.191 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:16:37.232 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:16:37.233 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:16:37.270 INFO:teuthology.orchestra.run.smithi157.stdout:(21/23): ceph-common-17.0.0-8087.g103b6cc3.el8. 5.8 MB/s | 20 MB 00:03 2021-10-08T19:16:37.332 INFO:teuthology.orchestra.run.smithi157.stdout:(22/23): librados2-17.0.0-8087.g103b6cc3.el8.x8 4.9 MB/s | 3.4 MB 00:00 2021-10-08T19:16:37.504 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:16:37.505 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:16:37.619 INFO:teuthology.orchestra.run.smithi157.stdout:(23/23): librbd1-17.0.0-8087.g103b6cc3.el8.x86_ 4.1 MB/s | 3.9 MB 00:00 2021-10-08T19:16:37.623 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:16:37.624 INFO:teuthology.orchestra.run.smithi157.stdout:Total 13 MB/s | 49 MB 00:03 2021-10-08T19:16:37.628 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:16:37.672 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:16:37.673 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:16:37.955 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:16:37.957 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:16:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:16:38.683 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2021-10-08T19:16:38.856 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-10-08T19:16:38.953 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:16:39.138 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2021-10-08T19:16:39.224 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-10-08T19:16:39.295 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-10-08T19:16:39.356 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:16:39.439 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:16:39.646 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:16:39.677 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-10-08T19:16:39.823 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:16:39.854 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:16:39.950 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:16:40.160 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:16:40.227 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:16:40.345 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:16:40.390 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:16:40.453 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:16:40.646 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-10-08T19:16:40.772 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:16:40.848 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:16:40.953 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:16:41.022 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:16:41.203 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-10-08T19:16:41.251 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:16:41.354 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:16:41.431 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:16:41.510 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:16:41.679 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-10-08T19:16:41.762 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:16:41.773 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 11/25 2021-10-08T19:16:41.950 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:16:41.953 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:16:42.029 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:16:42.139 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:16:42.160 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-10-08T19:16:42.280 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 11/25 2021-10-08T19:16:42.332 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 14/25 2021-10-08T19:16:42.439 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:16:42.489 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:16:42.561 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:16:42.612 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:16:42.730 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2021-10-08T19:16:42.830 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 14/25 2021-10-08T19:16:42.906 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2021-10-08T19:16:42.970 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:16:43.042 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:16:43.078 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2021-10-08T19:16:43.227 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2021-10-08T19:16:43.231 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 19/25 2021-10-08T19:16:43.378 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2021-10-08T19:16:43.604 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2021-10-08T19:16:43.754 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 19/25 2021-10-08T19:16:46.686 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:16:46.906 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:16:47.203 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:16:47.386 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:16:47.467 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:16:47.717 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:16:47.802 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:16:47.938 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:16:47.948 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:16:48.199 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:16:48.281 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:16:48.461 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:17:03.234 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:17:03.235 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2021-10-08T19:17:03.235 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2021-10-08T19:17:03.235 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /dev 2021-10-08T19:17:03.235 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /run 2021-10-08T19:17:03.236 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2021-10-08T19:17:03.236 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2021-10-08T19:17:03.237 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2021-10-08T19:17:03.237 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2021-10-08T19:17:03.237 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /dev 2021-10-08T19:17:03.237 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:03.877 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:17:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2021-10-08T19:17:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2021-10-08T19:17:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2021-10-08T19:17:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /run 2021-10-08T19:17:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2021-10-08T19:17:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2021-10-08T19:17:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2021-10-08T19:17:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2021-10-08T19:17:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2021-10-08T19:17:03.880 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:04.289 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:17:04.359 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:17:04.359 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:17:04.562 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:17:04.563 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:17:04.988 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:17:05.047 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:17:05.048 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:17:05.260 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:17:05.260 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:17:05.316 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:17:05.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/25 2021-10-08T19:17:05.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:17:05.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:17:05.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:17:05.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:17:05.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 6/25 2021-10-08T19:17:05.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/25 2021-10-08T19:17:05.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 8/25 2021-10-08T19:17:05.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 9/25 2021-10-08T19:17:05.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 10/25 2021-10-08T19:17:05.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 11/25 2021-10-08T19:17:05.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:17:05.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:17:05.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2021-10-08T19:17:05.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2021-10-08T19:17:05.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-10-08T19:17:05.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2021-10-08T19:17:05.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-10-08T19:17:05.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2021-10-08T19:17:05.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2021-10-08T19:17:05.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2021-10-08T19:17:05.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:17:05.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-10-08T19:17:05.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 24/25 2021-10-08T19:17:05.949 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:17:05.950 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/25 2021-10-08T19:17:05.950 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:17:05.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:17:05.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:17:05.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:17:05.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 6/25 2021-10-08T19:17:05.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/25 2021-10-08T19:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 8/25 2021-10-08T19:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 9/25 2021-10-08T19:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 10/25 2021-10-08T19:17:05.953 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 11/25 2021-10-08T19:17:05.953 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:17:05.953 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:17:05.954 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2021-10-08T19:17:05.954 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2021-10-08T19:17:05.954 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-10-08T19:17:05.955 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2021-10-08T19:17:05.955 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-10-08T19:17:05.955 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2021-10-08T19:17:05.955 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2021-10-08T19:17:05.955 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2021-10-08T19:17:05.956 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:17:05.956 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-10-08T19:17:05.956 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 24/25 2021-10-08T19:17:06.035 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:17:06.035 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:06.035 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2021-10-08T19:17:06.036 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.036 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.036 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:17:06.036 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.037 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.037 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.037 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.037 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-10-08T19:17:06.037 INFO:teuthology.orchestra.run.smithi196.stdout: leveldb-1.22-1.el8.x86_64 2021-10-08T19:17:06.038 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.038 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.2-3.el8.x86_64 2021-10-08T19:17:06.038 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-10-08T19:17:06.038 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.038 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-10-08T19:17:06.039 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.039 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.3.1-3.el8.x86_64 2021-10-08T19:17:06.039 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-10-08T19:17:06.039 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.040 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.040 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.040 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-10-08T19:17:06.040 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.040 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.041 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.041 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:06.041 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:17:06.285 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-test 2021-10-08T19:17:06.772 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:34 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:06.849 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:17:06.850 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:06.850 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2021-10-08T19:17:06.850 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.850 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.851 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:17:06.851 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.851 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.851 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.852 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.852 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-10-08T19:17:06.852 INFO:teuthology.orchestra.run.smithi157.stdout: leveldb-1.22-1.el8.x86_64 2021-10-08T19:17:06.852 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.853 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.2-3.el8.x86_64 2021-10-08T19:17:06.853 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-10-08T19:17:06.853 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.853 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-10-08T19:17:06.853 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.854 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.3.1-3.el8.x86_64 2021-10-08T19:17:06.854 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-10-08T19:17:06.854 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.854 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-10-08T19:17:06.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:06.856 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:06.856 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:17:07.109 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-test 2021-10-08T19:17:07.444 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:17:07.445 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:07.445 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:17:07.446 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:07.446 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:17:07.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 M 2021-10-08T19:17:07.447 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2021-10-08T19:17:07.447 INFO:teuthology.orchestra.run.smithi196.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-10-08T19:17:07.449 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 170 k 2021-10-08T19:17:07.449 INFO:teuthology.orchestra.run.smithi196.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-10-08T19:17:07.450 INFO:teuthology.orchestra.run.smithi196.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-10-08T19:17:07.450 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-10-08T19:17:07.451 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-10-08T19:17:07.451 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:07.452 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:17:07.452 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:07.453 INFO:teuthology.orchestra.run.smithi196.stdout:Install 7 Packages 2021-10-08T19:17:07.453 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:07.455 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 46 M 2021-10-08T19:17:07.455 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 211 M 2021-10-08T19:17:07.456 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:17:07.595 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:35 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:07.621 INFO:teuthology.orchestra.run.smithi196.stdout:(1/7): libcephsqlite-17.0.0-8087.g103b6cc3.el8. 980 kB/s | 170 kB 00:00 2021-10-08T19:17:08.366 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:17:08.368 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:08.368 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:17:08.369 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:08.369 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:17:08.369 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 M 2021-10-08T19:17:08.369 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2021-10-08T19:17:08.370 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-10-08T19:17:08.370 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 170 k 2021-10-08T19:17:08.370 INFO:teuthology.orchestra.run.smithi157.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-10-08T19:17:08.370 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-10-08T19:17:08.371 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-10-08T19:17:08.371 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-10-08T19:17:08.371 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:08.371 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:17:08.372 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:08.372 INFO:teuthology.orchestra.run.smithi157.stdout:Install 7 Packages 2021-10-08T19:17:08.372 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:08.372 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 46 M 2021-10-08T19:17:08.373 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 211 M 2021-10-08T19:17:08.373 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:17:08.779 INFO:teuthology.orchestra.run.smithi157.stdout:(1/7): libcephsqlite-17.0.0-8087.g103b6cc3.el8. 415 kB/s | 170 kB 00:00 2021-10-08T19:17:09.733 INFO:teuthology.orchestra.run.smithi196.stdout:(2/7): ceph-test-17.0.0-8087.g103b6cc3.el8.x86_ 19 MB/s | 44 MB 00:02 2021-10-08T19:17:09.743 INFO:teuthology.orchestra.run.smithi196.stdout:(3/7): oniguruma-6.8.2-2.el8.x86_64.rpm 88 kB/s | 187 kB 00:02 2021-10-08T19:17:09.747 INFO:teuthology.orchestra.run.smithi196.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 64 MB/s | 250 kB 00:00 2021-10-08T19:17:10.120 INFO:teuthology.orchestra.run.smithi196.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 185 kB/s | 69 kB 00:00 2021-10-08T19:17:10.681 INFO:teuthology.orchestra.run.smithi157.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 99 kB/s | 187 kB 00:01 2021-10-08T19:17:10.682 INFO:teuthology.orchestra.run.smithi196.stdout:(6/7): socat-1.7.3.3-2.el8.x86_64.rpm 319 kB/s | 302 kB 00:00 2021-10-08T19:17:10.688 INFO:teuthology.orchestra.run.smithi157.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 47 MB/s | 302 kB 00:00 2021-10-08T19:17:10.691 INFO:teuthology.orchestra.run.smithi157.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 62 MB/s | 250 kB 00:00 2021-10-08T19:17:10.793 INFO:teuthology.orchestra.run.smithi157.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 672 kB/s | 69 kB 00:00 2021-10-08T19:17:11.720 INFO:teuthology.orchestra.run.smithi157.stdout:(6/7): ceph-test-17.0.0-8087.g103b6cc3.el8.x86_ 13 MB/s | 44 MB 00:03 2021-10-08T19:17:11.754 INFO:teuthology.orchestra.run.smithi157.stdout:(7/7): jq-1.5-12.el8.x86_64.rpm 48 kB/s | 161 kB 00:03 2021-10-08T19:17:11.757 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:11.759 INFO:teuthology.orchestra.run.smithi157.stdout:Total 13 MB/s | 46 MB 00:03 2021-10-08T19:17:11.763 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:17:11.787 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:17:11.787 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:17:12.034 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:17:12.037 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:17:12.497 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:17:12.701 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-10-08T19:17:12.910 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-10-08T19:17:13.101 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-10-08T19:17:13.265 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:17:13.334 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:17:13.505 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-10-08T19:17:14.321 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/7 2021-10-08T19:17:15.910 INFO:teuthology.orchestra.run.smithi196.stdout:(7/7): jq-1.5-12.el8.x86_64.rpm 19 kB/s | 161 kB 00:08 2021-10-08T19:17:15.914 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:15.915 INFO:teuthology.orchestra.run.smithi196.stdout:Total 5.4 MB/s | 46 MB 00:08 2021-10-08T19:17:15.919 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:17:15.942 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:17:15.943 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:17:16.190 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:17:16.192 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:17:16.691 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:17:16.909 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-10-08T19:17:17.085 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-10-08T19:17:17.302 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-10-08T19:17:17.474 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:17:17.553 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:17:17.739 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-10-08T19:17:17.866 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/7 2021-10-08T19:17:18.851 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/7 2021-10-08T19:17:19.112 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/7 2021-10-08T19:17:19.346 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/7 2021-10-08T19:17:19.347 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/7 2021-10-08T19:17:19.347 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/7 2021-10-08T19:17:19.347 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-10-08T19:17:19.347 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:17:19.348 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-10-08T19:17:19.348 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-10-08T19:17:19.690 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-10-08T19:17:19.691 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:19.691 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:17:19.691 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 jq-1.5-12.el8.x86_64 2021-10-08T19:17:19.691 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-10-08T19:17:19.692 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-10-08T19:17:19.692 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-10-08T19:17:19.692 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:19.692 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:17:20.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph 2021-10-08T19:17:21.427 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:49 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:22.111 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:17:22.115 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2021-10-08T19:17:22.115 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:17:22.116 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2021-10-08T19:17:22.116 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:17:22.116 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 6.4 k 2021-10-08T19:17:22.116 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2021-10-08T19:17:22.117 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 2.3 M 2021-10-08T19:17:22.117 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 1.5 M 2021-10-08T19:17:22.117 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 214 k 2021-10-08T19:17:22.117 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:17:22.118 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 17 M 2021-10-08T19:17:22.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-10-08T19:17:22.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-10-08T19:17:22.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-10-08T19:17:22.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-10-08T19:17:22.119 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-10-08T19:17:22.119 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-10-08T19:17:22.119 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-10-08T19:17:22.119 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-10-08T19:17:22.120 INFO:teuthology.orchestra.run.smithi157.stdout: python3-lxml x86_64 4.2.3-2.el8 CentOS-AppStream 1.5 M 2021-10-08T19:17:22.120 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-10-08T19:17:22.120 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-10-08T19:17:22.120 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-10-08T19:17:22.120 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-10-08T19:17:22.121 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-10-08T19:17:22.121 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-10-08T19:17:22.121 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-10-08T19:17:22.121 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-10-08T19:17:22.122 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-10-08T19:17:22.122 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-10-08T19:17:22.122 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-10-08T19:17:22.122 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-10-08T19:17:22.123 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-10-08T19:17:22.123 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-10-08T19:17:22.123 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-10-08T19:17:22.128 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-10-08T19:17:22.129 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-10-08T19:17:22.129 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-10-08T19:17:22.129 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-10-08T19:17:22.129 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2021-10-08T19:17:22.129 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-10-08T19:17:22.130 INFO:teuthology.orchestra.run.smithi157.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-10-08T19:17:22.130 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:22.130 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:17:22.130 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2021-10-08T19:17:22.131 INFO:teuthology.orchestra.run.smithi157.stdout:Install 36 Packages 2021-10-08T19:17:22.131 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:22.132 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 29 M 2021-10-08T19:17:22.132 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 115 M 2021-10-08T19:17:22.132 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:17:22.221 INFO:teuthology.orchestra.run.smithi157.stdout:(1/36): ceph-17.0.0-8087.g103b6cc3.el8.x86_64.r 65 kB/s | 6.4 kB 00:00 2021-10-08T19:17:22.231 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/7 2021-10-08T19:17:22.480 INFO:teuthology.orchestra.run.smithi157.stdout:(2/36): ceph-mds-17.0.0-8087.g103b6cc3.el8.x86_ 6.3 MB/s | 2.3 MB 00:00 2021-10-08T19:17:22.485 INFO:teuthology.orchestra.run.smithi157.stdout:(3/36): ceph-mgr-17.0.0-8087.g103b6cc3.el8.x86_ 4.2 MB/s | 1.5 MB 00:00 2021-10-08T19:17:22.513 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/7 2021-10-08T19:17:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:(4/36): ceph-mgr-modules-core-17.0.0-8087.g103b 3.2 MB/s | 214 kB 00:00 2021-10-08T19:17:22.582 INFO:teuthology.orchestra.run.smithi157.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 6.6 MB/s | 214 kB 00:00 2021-10-08T19:17:22.601 INFO:teuthology.orchestra.run.smithi157.stdout:(6/36): python3-lxml-4.2.3-2.el8.x86_64.rpm 80 MB/s | 1.5 MB 00:00 2021-10-08T19:17:22.604 INFO:teuthology.orchestra.run.smithi157.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 59 MB/s | 157 kB 00:00 2021-10-08T19:17:22.605 INFO:teuthology.orchestra.run.smithi157.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 33 MB/s | 39 kB 00:00 2021-10-08T19:17:22.607 INFO:teuthology.orchestra.run.smithi157.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 39 MB/s | 54 kB 00:00 2021-10-08T19:17:22.608 INFO:teuthology.orchestra.run.smithi157.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 26 MB/s | 27 kB 00:00 2021-10-08T19:17:22.615 INFO:teuthology.orchestra.run.smithi157.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 76 MB/s | 457 kB 00:00 2021-10-08T19:17:22.618 INFO:teuthology.orchestra.run.smithi157.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 63 MB/s | 195 kB 00:00 2021-10-08T19:17:22.619 INFO:teuthology.orchestra.run.smithi157.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 30 MB/s | 34 kB 00:00 2021-10-08T19:17:22.621 INFO:teuthology.orchestra.run.smithi157.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 56 MB/s | 123 kB 00:00 2021-10-08T19:17:22.633 INFO:teuthology.orchestra.run.smithi157.stdout:(15/36): ceph-mon-17.0.0-8087.g103b6cc3.el8.x86 9.4 MB/s | 3.9 MB 00:00 2021-10-08T19:17:22.634 INFO:teuthology.orchestra.run.smithi157.stdout:(16/36): python3-urllib3-1.24.2-5.el8.noarch.rp 14 MB/s | 177 kB 00:00 2021-10-08T19:17:22.751 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/7 2021-10-08T19:17:22.752 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/7 2021-10-08T19:17:22.752 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/7 2021-10-08T19:17:22.752 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-10-08T19:17:22.752 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-10-08T19:17:22.752 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-10-08T19:17:22.753 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-10-08T19:17:22.764 INFO:teuthology.orchestra.run.smithi157.stdout:(17/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 335 kB/s | 44 kB 00:00 2021-10-08T19:17:22.801 INFO:teuthology.orchestra.run.smithi157.stdout:(18/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.1 MB/s | 185 kB 00:00 2021-10-08T19:17:22.848 INFO:teuthology.orchestra.run.smithi157.stdout:(19/36): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.0 MB/s | 173 kB 00:00 2021-10-08T19:17:22.877 INFO:teuthology.orchestra.run.smithi157.stdout:(20/36): python3-cssselect-0.9.2-10.el8.noarch. 1.4 MB/s | 40 kB 00:00 2021-10-08T19:17:22.905 INFO:teuthology.orchestra.run.smithi157.stdout:(21/36): python3-jaraco-6.2-6.el8.noarch.rpm 398 kB/s | 11 kB 00:00 2021-10-08T19:17:22.933 INFO:teuthology.orchestra.run.smithi157.stdout:(22/36): python3-jaraco-functools-2.0-4.el8.noa 626 kB/s | 18 kB 00:00 2021-10-08T19:17:22.948 INFO:teuthology.orchestra.run.smithi157.stdout:(23/36): python3-cherrypy-18.4.0-1.el8.noarch.r 2.6 MB/s | 384 kB 00:00 2021-10-08T19:17:22.961 INFO:teuthology.orchestra.run.smithi157.stdout:(24/36): python3-logutils-0.3.5-11.el8.noarch.r 1.7 MB/s | 49 kB 00:00 2021-10-08T19:17:22.994 INFO:teuthology.orchestra.run.smithi157.stdout:(25/36): python3-more-itertools-7.2.0-3.el8.noa 1.2 MB/s | 59 kB 00:00 2021-10-08T19:17:23.019 INFO:teuthology.orchestra.run.smithi157.stdout:(26/36): python3-portend-2.6-1.el8.noarch.rpm 637 kB/s | 16 kB 00:00 2021-10-08T19:17:23.046 INFO:teuthology.orchestra.run.smithi157.stdout:(27/36): python3-simplegeneric-0.8.1-17.el8.noa 710 kB/s | 19 kB 00:00 2021-10-08T19:17:23.077 INFO:teuthology.orchestra.run.smithi157.stdout:(28/36): python3-singledispatch-3.4.0.3-18.el8. 768 kB/s | 24 kB 00:00 2021-10-08T19:17:23.112 INFO:teuthology.orchestra.run.smithi157.stdout:(29/36): python3-tempora-1.14.1-5.el8.noarch.rp 822 kB/s | 29 kB 00:00 2021-10-08T19:17:23.126 INFO:teuthology.orchestra.run.smithi157.stdout:(30/36): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2021-10-08T19:17:23.134 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-10-08T19:17:23.135 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:23.135 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:17:23.135 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 jq-1.5-12.el8.x86_64 2021-10-08T19:17:23.136 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-10-08T19:17:23.136 INFO:teuthology.orchestra.run.smithi196.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-10-08T19:17:23.136 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-10-08T19:17:23.137 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:23.137 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:17:23.238 INFO:teuthology.orchestra.run.smithi157.stdout:(31/36): ceph-osd-17.0.0-8087.g103b6cc3.el8.x86 22 MB/s | 17 MB 00:00 2021-10-08T19:17:23.239 INFO:teuthology.orchestra.run.smithi157.stdout:(32/36): python3-trustme-0.6.0-4.el8.noarch.rpm 218 kB/s | 27 kB 00:00 2021-10-08T19:17:23.288 INFO:teuthology.orchestra.run.smithi157.stdout:(33/36): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2021-10-08T19:17:23.304 INFO:teuthology.orchestra.run.smithi157.stdout:(34/36): python3-waitress-1.2.1-2.el8.1.noarch. 1.3 MB/s | 241 kB 00:00 2021-10-08T19:17:23.315 INFO:teuthology.orchestra.run.smithi157.stdout:(35/36): python3-zc-lockfile-2.0-2.el8.noarch.r 863 kB/s | 23 kB 00:00 2021-10-08T19:17:23.323 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph 2021-10-08T19:17:23.486 INFO:teuthology.orchestra.run.smithi157.stdout:(36/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.0 MB/s | 251 kB 00:00 2021-10-08T19:17:23.488 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:23.489 INFO:teuthology.orchestra.run.smithi157.stdout:Total 21 MB/s | 29 MB 00:01 2021-10-08T19:17:23.499 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:17:23.538 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:17:23.538 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:17:23.750 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:17:23.752 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:17:23.800 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:51 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:24.476 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:17:24.479 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2021-10-08T19:17:24.479 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:17:24.480 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2021-10-08T19:17:24.480 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:17:24.480 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 6.4 k 2021-10-08T19:17:24.480 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2021-10-08T19:17:24.480 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 2.3 M 2021-10-08T19:17:24.481 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 1.5 M 2021-10-08T19:17:24.481 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 214 k 2021-10-08T19:17:24.481 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:17:24.481 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 17 M 2021-10-08T19:17:24.482 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-10-08T19:17:24.482 INFO:teuthology.orchestra.run.smithi196.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-10-08T19:17:24.482 INFO:teuthology.orchestra.run.smithi196.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-10-08T19:17:24.482 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-10-08T19:17:24.483 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-10-08T19:17:24.483 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-10-08T19:17:24.483 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-10-08T19:17:24.483 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-10-08T19:17:24.483 INFO:teuthology.orchestra.run.smithi196.stdout: python3-lxml x86_64 4.2.3-2.el8 CentOS-AppStream 1.5 M 2021-10-08T19:17:24.484 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-10-08T19:17:24.484 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-10-08T19:17:24.484 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-10-08T19:17:24.485 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-10-08T19:17:24.485 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-10-08T19:17:24.485 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-10-08T19:17:24.485 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-10-08T19:17:24.486 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-10-08T19:17:24.486 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-10-08T19:17:24.486 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-10-08T19:17:24.486 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-10-08T19:17:24.487 INFO:teuthology.orchestra.run.smithi196.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-10-08T19:17:24.487 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-10-08T19:17:24.487 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-10-08T19:17:24.487 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-10-08T19:17:24.488 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-10-08T19:17:24.488 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-10-08T19:17:24.488 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-10-08T19:17:24.488 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-10-08T19:17:24.488 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2021-10-08T19:17:24.489 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-10-08T19:17:24.489 INFO:teuthology.orchestra.run.smithi196.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-10-08T19:17:24.489 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:24.489 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:17:24.490 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2021-10-08T19:17:24.490 INFO:teuthology.orchestra.run.smithi196.stdout:Install 36 Packages 2021-10-08T19:17:24.490 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:24.491 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 29 M 2021-10-08T19:17:24.491 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 115 M 2021-10-08T19:17:24.491 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:17:24.584 INFO:teuthology.orchestra.run.smithi196.stdout:(1/36): ceph-17.0.0-8087.g103b6cc3.el8.x86_64.r 65 kB/s | 6.4 kB 00:00 2021-10-08T19:17:24.988 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:17:25.220 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2021-10-08T19:17:25.307 INFO:teuthology.orchestra.run.smithi196.stdout:(2/36): ceph-mgr-17.0.0-8087.g103b6cc3.el8.x86_ 1.8 MB/s | 1.5 MB 00:00 2021-10-08T19:17:25.446 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2021-10-08T19:17:25.558 INFO:teuthology.orchestra.run.smithi196.stdout:(3/36): ceph-mds-17.0.0-8087.g103b6cc3.el8.x86_ 2.1 MB/s | 2.3 MB 00:01 2021-10-08T19:17:25.678 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2021-10-08T19:17:25.689 INFO:teuthology.orchestra.run.smithi196.stdout:(4/36): ceph-mgr-modules-core-17.0.0-8087.g103b 1.6 MB/s | 214 kB 00:00 2021-10-08T19:17:25.722 INFO:teuthology.orchestra.run.smithi196.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 6.5 MB/s | 214 kB 00:00 2021-10-08T19:17:25.741 INFO:teuthology.orchestra.run.smithi196.stdout:(6/36): python3-lxml-4.2.3-2.el8.x86_64.rpm 81 MB/s | 1.5 MB 00:00 2021-10-08T19:17:25.744 INFO:teuthology.orchestra.run.smithi196.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 49 MB/s | 157 kB 00:00 2021-10-08T19:17:25.745 INFO:teuthology.orchestra.run.smithi196.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 33 MB/s | 39 kB 00:00 2021-10-08T19:17:25.747 INFO:teuthology.orchestra.run.smithi196.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 40 MB/s | 54 kB 00:00 2021-10-08T19:17:25.748 INFO:teuthology.orchestra.run.smithi196.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 25 MB/s | 27 kB 00:00 2021-10-08T19:17:25.754 INFO:teuthology.orchestra.run.smithi196.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 76 MB/s | 457 kB 00:00 2021-10-08T19:17:25.757 INFO:teuthology.orchestra.run.smithi196.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 63 MB/s | 195 kB 00:00 2021-10-08T19:17:25.759 INFO:teuthology.orchestra.run.smithi196.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 30 MB/s | 34 kB 00:00 2021-10-08T19:17:25.761 INFO:teuthology.orchestra.run.smithi196.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 46 MB/s | 123 kB 00:00 2021-10-08T19:17:25.765 INFO:teuthology.orchestra.run.smithi196.stdout:(15/36): python3-urllib3-1.24.2-5.el8.noarch.rp 65 MB/s | 177 kB 00:00 2021-10-08T19:17:25.865 INFO:teuthology.orchestra.run.smithi196.stdout:(16/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 434 kB/s | 44 kB 00:00 2021-10-08T19:17:25.887 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2021-10-08T19:17:25.962 INFO:teuthology.orchestra.run.smithi196.stdout:(17/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.9 MB/s | 185 kB 00:00 2021-10-08T19:17:26.037 INFO:teuthology.orchestra.run.smithi196.stdout:(18/36): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.3 MB/s | 173 kB 00:00 2021-10-08T19:17:26.061 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 5/36 2021-10-08T19:17:26.069 INFO:teuthology.orchestra.run.smithi196.stdout:(19/36): ceph-mon-17.0.0-8087.g103b6cc3.el8.x86 2.6 MB/s | 3.9 MB 00:01 2021-10-08T19:17:26.145 INFO:teuthology.orchestra.run.smithi196.stdout:(20/36): python3-cssselect-0.9.2-10.el8.noarch. 529 kB/s | 40 kB 00:00 2021-10-08T19:17:26.170 INFO:teuthology.orchestra.run.smithi196.stdout:(21/36): python3-jaraco-6.2-6.el8.noarch.rpm 449 kB/s | 11 kB 00:00 2021-10-08T19:17:26.193 INFO:teuthology.orchestra.run.smithi196.stdout:(22/36): python3-cherrypy-18.4.0-1.el8.noarch.r 2.4 MB/s | 384 kB 00:00 2021-10-08T19:17:26.196 INFO:teuthology.orchestra.run.smithi196.stdout:(23/36): python3-jaraco-functools-2.0-4.el8.noa 699 kB/s | 18 kB 00:00 2021-10-08T19:17:26.200 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2021-10-08T19:17:26.219 INFO:teuthology.orchestra.run.smithi196.stdout:(24/36): python3-logutils-0.3.5-11.el8.noarch.r 1.9 MB/s | 49 kB 00:00 2021-10-08T19:17:26.245 INFO:teuthology.orchestra.run.smithi196.stdout:(25/36): python3-more-itertools-7.2.0-3.el8.noa 1.2 MB/s | 59 kB 00:00 2021-10-08T19:17:26.270 INFO:teuthology.orchestra.run.smithi196.stdout:(26/36): python3-portend-2.6-1.el8.noarch.rpm 631 kB/s | 16 kB 00:00 2021-10-08T19:17:26.296 INFO:teuthology.orchestra.run.smithi196.stdout:(27/36): python3-simplegeneric-0.8.1-17.el8.noa 738 kB/s | 19 kB 00:00 2021-10-08T19:17:26.319 INFO:teuthology.orchestra.run.smithi196.stdout:(28/36): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2021-10-08T19:17:26.320 INFO:teuthology.orchestra.run.smithi196.stdout:(29/36): python3-singledispatch-3.4.0.3-18.el8. 958 kB/s | 24 kB 00:00 2021-10-08T19:17:26.344 INFO:teuthology.orchestra.run.smithi196.stdout:(30/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.1 MB/s | 29 kB 00:00 2021-10-08T19:17:26.345 INFO:teuthology.orchestra.run.smithi196.stdout:(31/36): python3-trustme-0.6.0-4.el8.noarch.rpm 1.1 MB/s | 27 kB 00:00 2021-10-08T19:17:26.399 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2021-10-08T19:17:26.420 INFO:teuthology.orchestra.run.smithi196.stdout:(32/36): python3-waitress-1.2.1-2.el8.1.noarch. 3.1 MB/s | 241 kB 00:00 2021-10-08T19:17:26.446 INFO:teuthology.orchestra.run.smithi196.stdout:(33/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.5 MB/s | 251 kB 00:00 2021-10-08T19:17:26.446 INFO:teuthology.orchestra.run.smithi196.stdout:(34/36): python3-webtest-2.0.33-1.el8.noarch.rp 3.1 MB/s | 85 kB 00:00 2021-10-08T19:17:26.471 INFO:teuthology.orchestra.run.smithi196.stdout:(35/36): python3-zc-lockfile-2.0-2.el8.noarch.r 919 kB/s | 23 kB 00:00 2021-10-08T19:17:26.557 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2021-10-08T19:17:26.727 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2021-10-08T19:17:26.938 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2021-10-08T19:17:27.158 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 11/36 2021-10-08T19:17:27.333 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2021-10-08T19:17:27.555 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2021-10-08T19:17:27.758 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2021-10-08T19:17:28.030 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 15/36 2021-10-08T19:17:28.098 INFO:teuthology.orchestra.run.smithi196.stdout:(36/36): ceph-osd-17.0.0-8087.g103b6cc3.el8.x86 6.0 MB/s | 17 MB 00:02 2021-10-08T19:17:28.100 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:28.101 INFO:teuthology.orchestra.run.smithi196.stdout:Total 8.1 MB/s | 29 MB 00:03 2021-10-08T19:17:28.111 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:17:28.149 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:17:28.149 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:17:28.229 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2021-10-08T19:17:28.364 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:17:28.366 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:17:28.538 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2021-10-08T19:17:28.783 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2021-10-08T19:17:29.010 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2021-10-08T19:17:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2021-10-08T19:17:29.621 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2021-10-08T19:17:29.661 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:17:29.852 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-lxml-4.2.3-2.el8.x86_64 22/36 2021-10-08T19:17:29.880 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2021-10-08T19:17:30.043 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2021-10-08T19:17:30.080 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2021-10-08T19:17:30.232 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2021-10-08T19:17:30.296 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2021-10-08T19:17:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2021-10-08T19:17:30.463 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2021-10-08T19:17:30.637 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 5/36 2021-10-08T19:17:30.706 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2021-10-08T19:17:30.751 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2021-10-08T19:17:30.949 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2021-10-08T19:17:30.966 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2021-10-08T19:17:31.125 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2021-10-08T19:17:31.236 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2021-10-08T19:17:31.250 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2021-10-08T19:17:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2021-10-08T19:17:31.591 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2021-10-08T19:17:31.666 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 11/36 2021-10-08T19:17:31.832 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2021-10-08T19:17:31.926 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2021-10-08T19:17:32.046 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2021-10-08T19:17:32.270 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2021-10-08T19:17:32.344 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 31/36 2021-10-08T19:17:32.499 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 15/36 2021-10-08T19:17:32.550 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/36 2021-10-08T19:17:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2021-10-08T19:17:32.917 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2021-10-08T19:17:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2021-10-08T19:17:33.351 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2021-10-08T19:17:33.576 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2021-10-08T19:17:33.980 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2021-10-08T19:17:34.033 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/36 2021-10-08T19:17:34.242 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 33/36 2021-10-08T19:17:34.292 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-lxml-4.2.3-2.el8.x86_64 22/36 2021-10-08T19:17:34.460 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2021-10-08T19:17:34.632 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 33/36 2021-10-08T19:17:34.649 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2021-10-08T19:17:34.820 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 34/36 2021-10-08T19:17:34.834 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2021-10-08T19:17:35.035 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 34/36 2021-10-08T19:17:35.203 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 35/36 2021-10-08T19:17:35.219 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 35/36 2021-10-08T19:17:35.360 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 36/36 2021-10-08T19:17:35.716 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 36/36 2021-10-08T19:17:35.716 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/36 2021-10-08T19:17:35.717 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/36 2021-10-08T19:17:35.717 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/36 2021-10-08T19:17:35.717 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/36 2021-10-08T19:17:35.717 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/36 2021-10-08T19:17:35.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 6/36 2021-10-08T19:17:35.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2021-10-08T19:17:35.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-lxml-4.2.3-2.el8.x86_64 8/36 2021-10-08T19:17:35.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2021-10-08T19:17:35.719 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2021-10-08T19:17:35.719 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2021-10-08T19:17:35.719 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2021-10-08T19:17:35.719 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2021-10-08T19:17:35.720 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2021-10-08T19:17:35.720 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2021-10-08T19:17:35.720 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2021-10-08T19:17:35.720 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 17/36 2021-10-08T19:17:35.721 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2021-10-08T19:17:35.721 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2021-10-08T19:17:35.721 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 20/36 2021-10-08T19:17:35.721 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2021-10-08T19:17:35.722 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2021-10-08T19:17:35.722 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2021-10-08T19:17:35.722 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2021-10-08T19:17:35.722 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2021-10-08T19:17:35.723 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2021-10-08T19:17:35.723 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2021-10-08T19:17:35.723 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2021-10-08T19:17:35.723 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2021-10-08T19:17:35.723 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2021-10-08T19:17:35.724 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2021-10-08T19:17:35.724 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 32/36 2021-10-08T19:17:35.724 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2021-10-08T19:17:35.724 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2021-10-08T19:17:35.725 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2021-10-08T19:17:35.827 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2021-10-08T19:17:36.069 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2021-10-08T19:17:36.315 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2021-10-08T19:17:36.640 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2021-10-08T19:17:36.640 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:36.641 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:17:36.641 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:36.641 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:36.641 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:36.641 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:36.642 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:36.642 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:36.642 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-10-08T19:17:36.643 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-10-08T19:17:36.643 INFO:teuthology.orchestra.run.smithi157.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-10-08T19:17:36.643 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-10-08T19:17:36.643 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-10-08T19:17:36.643 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-10-08T19:17:36.644 INFO:teuthology.orchestra.run.smithi157.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-10-08T19:17:36.644 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-6.2-6.el8.noarch 2021-10-08T19:17:36.644 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-10-08T19:17:36.644 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-10-08T19:17:36.645 INFO:teuthology.orchestra.run.smithi157.stdout: python3-lxml-4.2.3-2.el8.x86_64 2021-10-08T19:17:36.645 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.0.6-13.el8.noarch 2021-10-08T19:17:36.645 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-10-08T19:17:36.645 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-10-08T19:17:36.646 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-10-08T19:17:36.646 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-2.6-1.el8.noarch 2021-10-08T19:17:36.646 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-10-08T19:17:36.646 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2017.2-9.el8.noarch 2021-10-08T19:17:36.646 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-10-08T19:17:36.647 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-10-08T19:17:36.647 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-10-08T19:17:36.647 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-10-08T19:17:36.647 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-10-08T19:17:36.647 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-10-08T19:17:36.648 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-10-08T19:17:36.648 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-10-08T19:17:36.648 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-10-08T19:17:36.648 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-10-08T19:17:36.649 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-10-08T19:17:36.649 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-10-08T19:17:36.649 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:36.649 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:17:36.689 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2021-10-08T19:17:37.063 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2021-10-08T19:17:37.340 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-base 2021-10-08T19:17:37.484 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 31/36 2021-10-08T19:17:37.691 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/36 2021-10-08T19:17:37.824 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:05 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:38.303 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:17:38.477 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:17:38.479 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2021-10-08T19:17:38.479 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:17:38.543 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install cephadm 2021-10-08T19:17:39.020 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:07 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:39.170 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/36 2021-10-08T19:17:39.415 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 33/36 2021-10-08T19:17:39.707 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:17:39.708 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:39.709 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:17:39.709 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:39.709 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:17:39.709 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 66 k 2021-10-08T19:17:39.710 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:39.710 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:17:39.710 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:39.710 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2021-10-08T19:17:39.711 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:39.711 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 66 k 2021-10-08T19:17:39.711 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 291 k 2021-10-08T19:17:39.711 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:17:39.803 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 33/36 2021-10-08T19:17:39.856 INFO:teuthology.orchestra.run.smithi157.stdout:cephadm-17.0.0-8087.g103b6cc3.el8.noarch.rpm 451 kB/s | 66 kB 00:00 2021-10-08T19:17:39.856 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:39.857 INFO:teuthology.orchestra.run.smithi157.stdout:Total 447 kB/s | 66 kB 00:00 2021-10-08T19:17:39.857 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:17:39.864 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:17:39.864 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:17:39.865 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:17:39.868 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:17:39.934 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:17:39.988 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 34/36 2021-10-08T19:17:40.201 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 34/36 2021-10-08T19:17:40.345 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 35/36 2021-10-08T19:17:40.362 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 35/36 2021-10-08T19:17:40.511 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 36/36 2021-10-08T19:17:40.860 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 36/36 2021-10-08T19:17:40.861 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/36 2021-10-08T19:17:40.861 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/36 2021-10-08T19:17:40.861 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/36 2021-10-08T19:17:40.861 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/36 2021-10-08T19:17:40.862 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/36 2021-10-08T19:17:40.862 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 6/36 2021-10-08T19:17:40.862 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2021-10-08T19:17:40.862 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-lxml-4.2.3-2.el8.x86_64 8/36 2021-10-08T19:17:40.863 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2021-10-08T19:17:40.863 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2021-10-08T19:17:40.863 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2021-10-08T19:17:40.863 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2021-10-08T19:17:40.863 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2021-10-08T19:17:40.864 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2021-10-08T19:17:40.864 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2021-10-08T19:17:40.864 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2021-10-08T19:17:40.864 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 17/36 2021-10-08T19:17:40.864 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2021-10-08T19:17:40.865 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2021-10-08T19:17:40.865 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 20/36 2021-10-08T19:17:40.865 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2021-10-08T19:17:40.865 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2021-10-08T19:17:40.866 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2021-10-08T19:17:40.866 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2021-10-08T19:17:40.866 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2021-10-08T19:17:40.866 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2021-10-08T19:17:40.867 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2021-10-08T19:17:40.867 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2021-10-08T19:17:40.867 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2021-10-08T19:17:40.867 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2021-10-08T19:17:40.867 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2021-10-08T19:17:40.868 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 32/36 2021-10-08T19:17:40.868 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2021-10-08T19:17:40.868 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2021-10-08T19:17:40.868 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2021-10-08T19:17:41.648 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:41.795 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:41.828 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2021-10-08T19:17:41.828 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:41.828 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:17:41.828 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:41.829 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:41.829 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:41.829 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:41.829 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:41.829 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:41.830 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-10-08T19:17:41.830 INFO:teuthology.orchestra.run.smithi196.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-10-08T19:17:41.830 INFO:teuthology.orchestra.run.smithi196.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-10-08T19:17:41.830 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-10-08T19:17:41.831 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-10-08T19:17:41.831 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-10-08T19:17:41.831 INFO:teuthology.orchestra.run.smithi196.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-10-08T19:17:41.831 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-6.2-6.el8.noarch 2021-10-08T19:17:41.831 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-10-08T19:17:41.832 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-10-08T19:17:41.832 INFO:teuthology.orchestra.run.smithi196.stdout: python3-lxml-4.2.3-2.el8.x86_64 2021-10-08T19:17:41.832 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.0.6-13.el8.noarch 2021-10-08T19:17:41.832 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-10-08T19:17:41.833 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-10-08T19:17:41.833 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-10-08T19:17:41.833 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-2.6-1.el8.noarch 2021-10-08T19:17:41.833 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-10-08T19:17:41.833 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2017.2-9.el8.noarch 2021-10-08T19:17:41.834 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-10-08T19:17:41.834 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-10-08T19:17:41.834 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-10-08T19:17:41.834 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-10-08T19:17:41.835 INFO:teuthology.orchestra.run.smithi196.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-10-08T19:17:41.835 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-10-08T19:17:41.835 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-10-08T19:17:41.835 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-10-08T19:17:41.835 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-10-08T19:17:41.836 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-10-08T19:17:41.836 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-10-08T19:17:41.836 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-10-08T19:17:41.836 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:41.837 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:17:41.987 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:42.055 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-base 2021-10-08T19:17:42.294 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:42.294 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:42.294 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:17:42.295 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:42.295 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:42.295 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:17:42.537 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:10 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:43.003 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-immutable-object-cache 2021-10-08T19:17:43.054 INFO:teuthology.orchestra.run.smithi196.stdout:Package ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:17:43.239 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:17:43.240 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2021-10-08T19:17:43.240 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:17:43.300 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install cephadm 2021-10-08T19:17:43.503 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:11 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:43.773 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:11 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:44.152 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:17:44.153 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:44.153 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2021-10-08T19:17:44.153 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:44.154 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:17:44.154 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 169 k 2021-10-08T19:17:44.154 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:44.154 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:17:44.154 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:44.155 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2021-10-08T19:17:44.155 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:44.155 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 169 k 2021-10-08T19:17:44.155 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 567 k 2021-10-08T19:17:44.156 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:17:44.322 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-immutable-object-cache-17.0.0-8087.g103b6c 1.0 MB/s | 169 kB 00:00 2021-10-08T19:17:44.323 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:44.323 INFO:teuthology.orchestra.run.smithi157.stdout:Total 997 kB/s | 169 kB 00:00 2021-10-08T19:17:44.323 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:17:44.335 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:17:44.336 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:17:44.382 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:17:44.384 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:17:44.456 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:17:44.456 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:44.457 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:17:44.457 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:44.457 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:17:44.457 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 66 k 2021-10-08T19:17:44.458 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:44.458 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:17:44.458 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:44.458 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2021-10-08T19:17:44.459 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:44.459 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 66 k 2021-10-08T19:17:44.459 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 291 k 2021-10-08T19:17:44.459 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:17:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:17:44.603 INFO:teuthology.orchestra.run.smithi196.stdout:cephadm-17.0.0-8087.g103b6cc3.el8.noarch.rpm 456 kB/s | 66 kB 00:00 2021-10-08T19:17:44.604 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:44.604 INFO:teuthology.orchestra.run.smithi196.stdout:Total 452 kB/s | 66 kB 00:00 2021-10-08T19:17:44.604 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:17:44.610 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:17:44.611 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:17:44.612 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:17:44.614 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:17:44.667 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:17:44.751 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:17:45.126 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:17:45.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:17:45.452 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:45.452 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:17:45.452 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:45.452 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:45.452 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:17:45.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr 2021-10-08T19:17:46.097 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:14 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:46.255 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:46.436 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:46.601 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:17:46.627 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:46.780 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:17:46.781 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2021-10-08T19:17:46.781 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:17:46.834 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-dashboard 2021-10-08T19:17:46.961 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:46.962 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:46.962 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:17:46.962 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:46.962 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:46.963 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:17:47.126 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-immutable-object-cache 2021-10-08T19:17:47.309 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:15 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:47.619 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:15 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:47.955 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:17:47.956 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:47.956 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:17:47.957 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:47.957 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:17:47.957 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 1.5 M 2021-10-08T19:17:47.957 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2021-10-08T19:17:47.957 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 24 k 2021-10-08T19:17:47.958 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 8.9 k 2021-10-08T19:17:47.958 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-10-08T19:17:47.958 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-10-08T19:17:47.958 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-10-08T19:17:47.959 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:47.959 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:17:47.959 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:17:47.959 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2021-10-08T19:17:47.959 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:47.960 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 1.8 M 2021-10-08T19:17:47.960 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 7.5 M 2021-10-08T19:17:47.961 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:17:48.074 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): ceph-prometheus-alerts-17.0.0-8087.g103b 77 kB/s | 8.9 kB 00:00 2021-10-08T19:17:48.121 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): ceph-grafana-dashboards-17.0.0-8087.g103 147 kB/s | 24 kB 00:00 2021-10-08T19:17:48.179 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 406 kB/s | 43 kB 00:00 2021-10-08T19:17:48.266 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 234 kB/s | 34 kB 00:00 2021-10-08T19:17:48.296 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:17:48.297 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repo Size 2021-10-08T19:17:48.297 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:48.298 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:17:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 169 k 2021-10-08T19:17:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:48.298 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:17:48.299 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:48.299 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2021-10-08T19:17:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:48.299 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 169 k 2021-10-08T19:17:48.300 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 567 k 2021-10-08T19:17:48.300 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:17:48.345 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): ceph-mgr-dashboard-17.0.0-8087.g103b6cc3 4.0 MB/s | 1.5 MB 00:00 2021-10-08T19:17:48.438 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 760 kB/s | 196 kB 00:00 2021-10-08T19:17:48.441 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:48.442 INFO:teuthology.orchestra.run.smithi157.stdout:Total 3.8 MB/s | 1.8 MB 00:00 2021-10-08T19:17:48.443 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:17:48.452 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:17:48.452 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:17:48.466 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-immutable-object-cache-17.0.0-8087.g103b6c 1.0 MB/s | 169 kB 00:00 2021-10-08T19:17:48.467 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:48.467 INFO:teuthology.orchestra.run.smithi196.stdout:Total 994 kB/s | 169 kB 00:00 2021-10-08T19:17:48.467 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:17:48.479 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:17:48.480 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:17:48.526 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:17:48.528 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:17:48.564 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:17:48.566 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:17:48.656 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:17:48.852 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:17:49.205 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:17:49.595 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:17:49.595 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:49.596 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:17:49.596 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:49.596 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:49.596 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:17:49.765 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr 2021-10-08T19:17:49.925 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:17:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-10-08T19:17:50.240 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:18 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:50.387 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-10-08T19:17:50.627 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-10-08T19:17:50.720 INFO:teuthology.orchestra.run.smithi196.stdout:Package ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:17:50.766 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 4/6 2021-10-08T19:17:50.902 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:17:50.903 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2021-10-08T19:17:50.903 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:17:50.968 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr-dashboard 2021-10-08T19:17:51.120 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 5/6 2021-10-08T19:17:51.380 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:17:51.442 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:19 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:51.643 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:17:51.644 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 1/6 2021-10-08T19:17:51.644 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 2/6 2021-10-08T19:17:51.644 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 3/6 2021-10-08T19:17:51.645 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-10-08T19:17:51.645 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-10-08T19:17:51.943 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-10-08T19:17:51.943 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:51.944 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:17:51.944 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:51.944 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:51.944 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:51.944 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-10-08T19:17:51.945 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-10-08T19:17:51.945 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.4.1-12.el8.noarch 2021-10-08T19:17:51.945 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:51.945 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:17:52.024 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-diskprediction-local 2021-10-08T19:17:52.499 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:20 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:52.786 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:17:52.787 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:52.788 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:17:52.788 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:52.788 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:17:52.788 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 1.5 M 2021-10-08T19:17:52.788 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2021-10-08T19:17:52.789 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 24 k 2021-10-08T19:17:52.789 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 8.9 k 2021-10-08T19:17:52.789 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-10-08T19:17:52.789 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-10-08T19:17:52.790 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-10-08T19:17:52.790 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:52.790 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:17:52.791 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:17:52.791 INFO:teuthology.orchestra.run.smithi196.stdout:Install 6 Packages 2021-10-08T19:17:52.791 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:52.792 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 1.8 M 2021-10-08T19:17:52.792 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 7.5 M 2021-10-08T19:17:52.793 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:17:52.902 INFO:teuthology.orchestra.run.smithi196.stdout:(1/6): ceph-prometheus-alerts-17.0.0-8087.g103b 79 kB/s | 8.9 kB 00:00 2021-10-08T19:17:52.938 INFO:teuthology.orchestra.run.smithi196.stdout:(2/6): ceph-grafana-dashboards-17.0.0-8087.g103 161 kB/s | 24 kB 00:00 2021-10-08T19:17:52.941 INFO:teuthology.orchestra.run.smithi196.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2021-10-08T19:17:53.016 INFO:teuthology.orchestra.run.smithi196.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 437 kB/s | 34 kB 00:00 2021-10-08T19:17:53.057 INFO:teuthology.orchestra.run.smithi196.stdout:(5/6): ceph-mgr-dashboard-17.0.0-8087.g103b6cc3 5.8 MB/s | 1.5 MB 00:00 2021-10-08T19:17:53.072 INFO:teuthology.orchestra.run.smithi196.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.5 MB/s | 196 kB 00:00 2021-10-08T19:17:53.075 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:53.075 INFO:teuthology.orchestra.run.smithi196.stdout:Total 6.4 MB/s | 1.8 MB 00:00 2021-10-08T19:17:53.077 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:17:53.084 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:17:53.084 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:17:53.142 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:17:53.143 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:17:53.144 INFO:teuthology.orchestra.run.smithi157.stdout:===================================================================================================== 2021-10-08T19:17:53.144 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:17:53.145 INFO:teuthology.orchestra.run.smithi157.stdout:===================================================================================================== 2021-10-08T19:17:53.145 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:17:53.145 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 7.4 M 2021-10-08T19:17:53.145 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2021-10-08T19:17:53.146 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 8.4.1-1.el8 CentOS-Base 639 k 2021-10-08T19:17:53.146 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 8.4.1-1.el8 CentOS-Base 169 k 2021-10-08T19:17:53.146 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-10-08T19:17:53.146 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-10-08T19:17:53.147 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-10-08T19:17:53.147 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-10-08T19:17:53.147 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.0.0-20.module_el8.4.0+790+083e3d81 CentOS-AppStream 15 M 2021-10-08T19:17:53.147 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:53.147 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:17:53.148 INFO:teuthology.orchestra.run.smithi157.stdout:===================================================================================================== 2021-10-08T19:17:53.148 INFO:teuthology.orchestra.run.smithi157.stdout:Install 8 Packages 2021-10-08T19:17:53.148 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:17:53.149 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:17:53.149 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 36 M 2021-10-08T19:17:53.150 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 197 M 2021-10-08T19:17:53.150 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:17:53.257 INFO:teuthology.orchestra.run.smithi157.stdout:(1/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 43 MB/s | 4.7 MB 00:00 2021-10-08T19:17:53.314 INFO:teuthology.orchestra.run.smithi157.stdout:(2/8): openblas-0.3.12-1.el8.x86_64.rpm 27 MB/s | 4.6 MB 00:00 2021-10-08T19:17:53.327 INFO:teuthology.orchestra.run.smithi157.stdout:(3/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 54 MB/s | 3.7 MB 00:00 2021-10-08T19:17:53.328 INFO:teuthology.orchestra.run.smithi157.stdout:(4/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 16 MB/s | 225 kB 00:00 2021-10-08T19:17:53.351 INFO:teuthology.orchestra.run.smithi157.stdout:(5/8): libgfortran-8.4.1-1.el8.x86_64.rpm 29 MB/s | 639 kB 00:00 2021-10-08T19:17:53.358 INFO:teuthology.orchestra.run.smithi157.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 25 MB/s | 169 kB 00:00 2021-10-08T19:17:53.435 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:17:53.566 INFO:teuthology.orchestra.run.smithi157.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.4.0+79 61 MB/s | 15 MB 00:00 2021-10-08T19:17:53.667 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-10-08T19:17:53.721 INFO:teuthology.orchestra.run.smithi157.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-808 13 MB/s | 7.4 MB 00:00 2021-10-08T19:17:53.724 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:53.725 INFO:teuthology.orchestra.run.smithi157.stdout:Total 62 MB/s | 36 MB 00:00 2021-10-08T19:17:53.733 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:17:53.752 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:17:53.753 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:17:53.878 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-10-08T19:17:54.048 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:17:54.050 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:17:54.103 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-10-08T19:17:54.216 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 4/6 2021-10-08T19:17:54.578 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 5/6 2021-10-08T19:17:54.616 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:17:54.775 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:17:54.854 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:17:54.902 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:17:55.091 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:17:55.110 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:17:55.110 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 1/6 2021-10-08T19:17:55.111 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 2/6 2021-10-08T19:17:55.111 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 3/6 2021-10-08T19:17:55.111 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-10-08T19:17:55.111 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-10-08T19:17:55.428 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-10-08T19:17:55.428 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:55.429 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:17:55.429 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:55.429 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:55.429 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:55.429 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-10-08T19:17:55.430 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-10-08T19:17:55.430 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.4.1-12.el8.noarch 2021-10-08T19:17:55.430 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:55.430 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:17:55.501 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr-diskprediction-local 2021-10-08T19:17:55.604 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:17:55.783 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:17:55.974 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:23 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:17:56.326 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:17:56.483 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:17:56.632 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:17:56.634 INFO:teuthology.orchestra.run.smithi196.stdout:===================================================================================================== 2021-10-08T19:17:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:17:56.635 INFO:teuthology.orchestra.run.smithi196.stdout:===================================================================================================== 2021-10-08T19:17:56.635 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:17:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 7.4 M 2021-10-08T19:17:56.635 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2021-10-08T19:17:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 8.4.1-1.el8 CentOS-Base 639 k 2021-10-08T19:17:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 8.4.1-1.el8 CentOS-Base 169 k 2021-10-08T19:17:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-10-08T19:17:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-10-08T19:17:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-10-08T19:17:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-10-08T19:17:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.0.0-20.module_el8.4.0+790+083e3d81 CentOS-AppStream 15 M 2021-10-08T19:17:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:56.637 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:17:56.638 INFO:teuthology.orchestra.run.smithi196.stdout:===================================================================================================== 2021-10-08T19:17:56.638 INFO:teuthology.orchestra.run.smithi196.stdout:Install 8 Packages 2021-10-08T19:17:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:17:56.638 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 36 M 2021-10-08T19:17:56.639 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 197 M 2021-10-08T19:17:56.639 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:17:56.761 INFO:teuthology.orchestra.run.smithi196.stdout:(1/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 38 MB/s | 4.7 MB 00:00 2021-10-08T19:17:56.781 INFO:teuthology.orchestra.run.smithi196.stdout:(2/8): openblas-0.3.12-1.el8.x86_64.rpm 32 MB/s | 4.6 MB 00:00 2021-10-08T19:17:56.788 INFO:teuthology.orchestra.run.smithi196.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 33 MB/s | 225 kB 00:00 2021-10-08T19:17:56.841 INFO:teuthology.orchestra.run.smithi196.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 47 MB/s | 3.7 MB 00:00 2021-10-08T19:17:56.856 INFO:teuthology.orchestra.run.smithi196.stdout:(5/8): libgfortran-8.4.1-1.el8.x86_64.rpm 41 MB/s | 639 kB 00:00 2021-10-08T19:17:56.863 INFO:teuthology.orchestra.run.smithi196.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 27 MB/s | 169 kB 00:00 2021-10-08T19:17:57.064 INFO:teuthology.orchestra.run.smithi196.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.4.0+79 53 MB/s | 15 MB 00:00 2021-10-08T19:17:57.202 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:17:57.225 INFO:teuthology.orchestra.run.smithi196.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-808 13 MB/s | 7.4 MB 00:00 2021-10-08T19:17:57.228 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:57.229 INFO:teuthology.orchestra.run.smithi196.stdout:Total 61 MB/s | 36 MB 00:00 2021-10-08T19:17:57.237 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:17:57.256 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:17:57.257 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:17:57.533 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:17:57.555 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:17:57.556 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:17:57.759 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:17:58.122 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:17:58.300 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:17:58.432 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:17:58.592 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:17:59.112 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:17:59.300 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:17:59.747 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:17:59.845 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:18:00.042 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:18:00.746 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:18:00.994 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 7/8 2021-10-08T19:18:01.090 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:18:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:18:01.349 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:18:01.474 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:18:01.474 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 1/8 2021-10-08T19:18:01.474 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/8 2021-10-08T19:18:01.475 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:18:01.475 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-10-08T19:18:01.475 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:18:01.475 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 6/8 2021-10-08T19:18:01.475 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 7/8 2021-10-08T19:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 8/8 2021-10-08T19:18:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:01.800 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:18:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-10-08T19:18:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-10-08T19:18:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.12-1.el8.x86_64 2021-10-08T19:18:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-10-08T19:18:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-10-08T19:18:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-10-08T19:18:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x86_64 2021-10-08T19:18:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:01.803 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:01.874 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-rook 2021-10-08T19:18:02.353 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:30 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:03.001 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================== 2021-10-08T19:18:03.003 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:18:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================== 2021-10-08T19:18:03.004 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:18:03.005 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 45 k 2021-10-08T19:18:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2021-10-08T19:18:03.005 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-10-08T19:18:03.005 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-10-08T19:18:03.005 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-10-08T19:18:03.006 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-10-08T19:18:03.006 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-10-08T19:18:03.006 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-10-08T19:18:03.006 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-10-08T19:18:03.007 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-10-08T19:18:03.007 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-10-08T19:18:03.007 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-10-08T19:18:03.008 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-10-08T19:18:03.008 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-10-08T19:18:03.008 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:18:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================== 2021-10-08T19:18:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:Install 13 Packages 2021-10-08T19:18:03.009 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 1.9 M 2021-10-08T19:18:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 25 M 2021-10-08T19:18:03.011 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:18:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 844 kB/s | 27 kB 00:00 2021-10-08T19:18:03.041 INFO:teuthology.orchestra.run.smithi157.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 45 MB/s | 126 kB 00:00 2021-10-08T19:18:03.042 INFO:teuthology.orchestra.run.smithi157.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 551 kB/s | 20 kB 00:00 2021-10-08T19:18:03.043 INFO:teuthology.orchestra.run.smithi157.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 47 MB/s | 110 kB 00:00 2021-10-08T19:18:03.045 INFO:teuthology.orchestra.run.smithi157.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 28 MB/s | 43 kB 00:00 2021-10-08T19:18:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 42 MB/s | 155 kB 00:00 2021-10-08T19:18:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 387 kB/s | 33 kB 00:00 2021-10-08T19:18:03.136 INFO:teuthology.orchestra.run.smithi157.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 181 kB/s | 16 kB 00:00 2021-10-08T19:18:03.150 INFO:teuthology.orchestra.run.smithi157.stdout:(9/13): ceph-mgr-rook-17.0.0-8087.g103b6cc3.el8 311 kB/s | 45 kB 00:00 2021-10-08T19:18:03.219 INFO:teuthology.orchestra.run.smithi157.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 933 kB/s | 81 kB 00:00 2021-10-08T19:18:03.244 INFO:teuthology.orchestra.run.smithi157.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.3 MB/s | 61 kB 00:00 2021-10-08T19:18:03.293 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:18:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 4.1 MB/s | 1.2 MB 00:00 2021-10-08T19:18:03.473 INFO:teuthology.orchestra.run.smithi157.stdout:(13/13): python3-rsa-4.7.2-1.el8.noarch.rpm 191 kB/s | 61 kB 00:00 2021-10-08T19:18:03.475 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:03.475 INFO:teuthology.orchestra.run.smithi157.stdout:Total 4.1 MB/s | 1.9 MB 00:00 2021-10-08T19:18:03.480 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:18:03.494 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:18:03.495 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:18:03.569 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:18:03.572 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:18:04.068 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:18:04.387 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-10-08T19:18:04.660 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-10-08T19:18:04.883 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 7/8 2021-10-08T19:18:04.893 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 3/13 2021-10-08T19:18:05.083 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:18:05.114 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-10-08T19:18:05.314 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-10-08T19:18:05.363 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:18:05.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 1/8 2021-10-08T19:18:05.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/8 2021-10-08T19:18:05.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:18:05.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-10-08T19:18:05.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:18:05.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 6/8 2021-10-08T19:18:05.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 7/8 2021-10-08T19:18:05.743 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 8/8 2021-10-08T19:18:05.743 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:05.744 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:05.744 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:18:05.744 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-10-08T19:18:05.744 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-10-08T19:18:05.745 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.12-1.el8.x86_64 2021-10-08T19:18:05.745 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-10-08T19:18:05.745 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-10-08T19:18:05.745 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-10-08T19:18:05.745 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x86_64 2021-10-08T19:18:05.746 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:05.746 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:05.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr-rook 2021-10-08T19:18:06.292 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:34 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:06.495 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-10-08T19:18:06.766 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-10-08T19:18:06.982 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:06.983 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================== 2021-10-08T19:18:06.983 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:18:06.984 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================== 2021-10-08T19:18:06.984 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:18:06.984 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 45 k 2021-10-08T19:18:06.984 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2021-10-08T19:18:06.985 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-10-08T19:18:06.985 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-10-08T19:18:06.985 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-10-08T19:18:06.985 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-10-08T19:18:06.985 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-10-08T19:18:06.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-10-08T19:18:06.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-10-08T19:18:06.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-10-08T19:18:06.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-10-08T19:18:06.987 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-10-08T19:18:06.987 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-10-08T19:18:06.987 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-10-08T19:18:06.987 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:06.988 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:18:06.988 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================== 2021-10-08T19:18:06.988 INFO:teuthology.orchestra.run.smithi196.stdout:Install 13 Packages 2021-10-08T19:18:06.988 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:06.989 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 1.9 M 2021-10-08T19:18:06.989 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 25 M 2021-10-08T19:18:06.989 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:18:06.990 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-10-08T19:18:07.019 INFO:teuthology.orchestra.run.smithi196.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 837 kB/s | 27 kB 00:00 2021-10-08T19:18:07.022 INFO:teuthology.orchestra.run.smithi196.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 35 MB/s | 126 kB 00:00 2021-10-08T19:18:07.025 INFO:teuthology.orchestra.run.smithi196.stdout:(3/13): python3-pyasn1-modules-0.3.7-6.el8.noar 44 MB/s | 110 kB 00:00 2021-10-08T19:18:07.026 INFO:teuthology.orchestra.run.smithi196.stdout:(4/13): python3-jsonpointer-1.10-11.el8.noarch. 517 kB/s | 20 kB 00:00 2021-10-08T19:18:07.028 INFO:teuthology.orchestra.run.smithi196.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 57 MB/s | 155 kB 00:00 2021-10-08T19:18:07.028 INFO:teuthology.orchestra.run.smithi196.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 14 MB/s | 43 kB 00:00 2021-10-08T19:18:07.102 INFO:teuthology.orchestra.run.smithi196.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 221 kB/s | 16 kB 00:00 2021-10-08T19:18:07.112 INFO:teuthology.orchestra.run.smithi196.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 394 kB/s | 33 kB 00:00 2021-10-08T19:18:07.132 INFO:teuthology.orchestra.run.smithi196.stdout:(9/13): ceph-mgr-rook-17.0.0-8087.g103b6cc3.el8 309 kB/s | 45 kB 00:00 2021-10-08T19:18:07.152 INFO:teuthology.orchestra.run.smithi196.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.6 MB/s | 81 kB 00:00 2021-10-08T19:18:07.177 INFO:teuthology.orchestra.run.smithi196.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.3 MB/s | 61 kB 00:00 2021-10-08T19:18:07.229 INFO:teuthology.orchestra.run.smithi196.stdout:(12/13): python3-rsa-4.7.2-1.el8.noarch.rpm 629 kB/s | 61 kB 00:00 2021-10-08T19:18:07.336 INFO:teuthology.orchestra.run.smithi196.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.2 MB/s | 1.2 MB 00:00 2021-10-08T19:18:07.338 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:07.339 INFO:teuthology.orchestra.run.smithi196.stdout:Total 5.4 MB/s | 1.9 MB 00:00 2021-10-08T19:18:07.344 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:18:07.359 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:18:07.359 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:18:07.432 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:18:07.434 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:18:07.976 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:18:08.116 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-10-08T19:18:08.295 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-10-08T19:18:08.371 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-10-08T19:18:08.518 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-10-08T19:18:08.538 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-10-08T19:18:08.732 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-10-08T19:18:08.744 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 3/13 2021-10-08T19:18:08.930 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:18:08.947 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-10-08T19:18:09.172 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:18:09.172 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 1/13 2021-10-08T19:18:09.173 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-10-08T19:18:09.173 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-10-08T19:18:09.173 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-10-08T19:18:09.173 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-10-08T19:18:09.173 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-10-08T19:18:09.174 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-10-08T19:18:09.174 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-10-08T19:18:09.174 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-10-08T19:18:09.174 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-10-08T19:18:09.174 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-10-08T19:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 12/13 2021-10-08T19:18:09.189 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-10-08T19:18:09.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-10-08T19:18:09.567 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:09.567 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:09.567 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:18:09.567 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-10-08T19:18:09.567 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-10-08T19:18:09.568 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-10-08T19:18:09.568 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-10-08T19:18:09.568 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-10-08T19:18:09.568 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-10-08T19:18:09.569 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-10-08T19:18:09.569 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-10-08T19:18:09.569 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-10-08T19:18:09.569 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-10-08T19:18:09.569 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-10-08T19:18:09.570 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-10-08T19:18:09.570 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:09.570 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:09.691 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-cephadm 2021-10-08T19:18:10.173 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:38 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:10.593 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-10-08T19:18:10.835 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:10.836 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:10.836 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:18:10.837 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:10.837 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:18:10.838 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 96 k 2021-10-08T19:18:10.838 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2021-10-08T19:18:10.838 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 3.2.1-4.el8 CentOS-Base 559 k 2021-10-08T19:18:10.839 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2021-10-08T19:18:10.839 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2021-10-08T19:18:10.840 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-10-08T19:18:10.840 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-10-08T19:18:10.841 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:10.841 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:18:10.841 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:10.842 INFO:teuthology.orchestra.run.smithi157.stdout:Install 4 Packages 2021-10-08T19:18:10.842 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 1 Package 2021-10-08T19:18:10.843 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:10.844 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 6.4 M 2021-10-08T19:18:10.844 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:18:10.886 INFO:teuthology.orchestra.run.smithi157.stdout:(1/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 11 MB/s | 538 kB 00:00 2021-10-08T19:18:10.896 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-10-08T19:18:10.944 INFO:teuthology.orchestra.run.smithi157.stdout:(2/5): python3-babel-2.5.1-5.el8.noarch.rpm 46 MB/s | 4.8 MB 00:00 2021-10-08T19:18:10.951 INFO:teuthology.orchestra.run.smithi157.stdout:(3/5): python3-cryptography-3.2.1-4.el8.x86_64. 76 MB/s | 559 kB 00:00 2021-10-08T19:18:11.016 INFO:teuthology.orchestra.run.smithi157.stdout:(4/5): ceph-mgr-cephadm-17.0.0-8087.g103b6cc3.e 538 kB/s | 96 kB 00:00 2021-10-08T19:18:11.072 INFO:teuthology.orchestra.run.smithi157.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.5 MB/s | 476 kB 00:00 2021-10-08T19:18:11.075 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:11.076 INFO:teuthology.orchestra.run.smithi157.stdout:Total 27 MB/s | 6.4 MB 00:00 2021-10-08T19:18:11.080 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:18:11.080 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-10-08T19:18:11.097 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:18:11.097 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:18:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:18:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:18:11.748 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:18:12.128 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : python3-cryptography-3.2.1-4.el8.x86_64 1/6 2021-10-08T19:18:12.161 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-10-08T19:18:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-10-08T19:18:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-10-08T19:18:12.799 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-10-08T19:18:12.947 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:18:13.075 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/6 2021-10-08T19:18:13.221 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:18:13.222 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 1/13 2021-10-08T19:18:13.222 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-10-08T19:18:13.222 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-10-08T19:18:13.223 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-10-08T19:18:13.223 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-10-08T19:18:13.223 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-10-08T19:18:13.223 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-10-08T19:18:13.224 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-10-08T19:18:13.224 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-10-08T19:18:13.224 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-10-08T19:18:13.224 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-10-08T19:18:13.225 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 12/13 2021-10-08T19:18:13.434 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 3/6 2021-10-08T19:18:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-10-08T19:18:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:13.601 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:18:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-10-08T19:18:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-10-08T19:18:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-10-08T19:18:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-10-08T19:18:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-10-08T19:18:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-10-08T19:18:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-10-08T19:18:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-10-08T19:18:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-10-08T19:18:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-10-08T19:18:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-10-08T19:18:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-10-08T19:18:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:13.606 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:13.671 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 4/6 2021-10-08T19:18:13.689 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr-cephadm 2021-10-08T19:18:13.854 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 5/6 2021-10-08T19:18:13.872 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 5/6 2021-10-08T19:18:14.045 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:18:14.164 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:42 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:14.373 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:18:14.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/6 2021-10-08T19:18:14.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-10-08T19:18:14.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-10-08T19:18:14.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/6 2021-10-08T19:18:14.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 5/6 2021-10-08T19:18:14.700 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:18:14.700 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:14.700 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2021-10-08T19:18:14.701 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-10-08T19:18:14.701 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:14.701 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:18:14.701 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2021-10-08T19:18:14.702 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.5.1-5.el8.noarch 2021-10-08T19:18:14.702 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-10-08T19:18:14.702 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:14.703 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:14.788 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-fuse 2021-10-08T19:18:14.828 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:14.829 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:14.830 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:18:14.830 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:14.830 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:18:14.831 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 96 k 2021-10-08T19:18:14.831 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2021-10-08T19:18:14.831 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 3.2.1-4.el8 CentOS-Base 559 k 2021-10-08T19:18:14.832 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2021-10-08T19:18:14.834 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2021-10-08T19:18:14.835 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-10-08T19:18:14.836 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-10-08T19:18:14.837 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:14.838 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:18:14.839 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:14.840 INFO:teuthology.orchestra.run.smithi196.stdout:Install 4 Packages 2021-10-08T19:18:14.841 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 1 Package 2021-10-08T19:18:14.842 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:14.842 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 6.4 M 2021-10-08T19:18:14.843 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:18:14.899 INFO:teuthology.orchestra.run.smithi196.stdout:(1/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 7.8 MB/s | 538 kB 00:00 2021-10-08T19:18:14.924 INFO:teuthology.orchestra.run.smithi196.stdout:(2/5): python3-babel-2.5.1-5.el8.noarch.rpm 52 MB/s | 4.8 MB 00:00 2021-10-08T19:18:14.931 INFO:teuthology.orchestra.run.smithi196.stdout:(3/5): python3-cryptography-3.2.1-4.el8.x86_64. 73 MB/s | 559 kB 00:00 2021-10-08T19:18:14.998 INFO:teuthology.orchestra.run.smithi196.stdout:(4/5): ceph-mgr-cephadm-17.0.0-8087.g103b6cc3.e 572 kB/s | 96 kB 00:00 2021-10-08T19:18:15.093 INFO:teuthology.orchestra.run.smithi196.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.4 MB/s | 476 kB 00:00 2021-10-08T19:18:15.096 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:15.097 INFO:teuthology.orchestra.run.smithi196.stdout:Total 24 MB/s | 6.4 MB 00:00 2021-10-08T19:18:15.100 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:18:15.117 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:18:15.117 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:18:15.239 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:18:15.241 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:18:15.270 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:43 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:15.770 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:18:15.932 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:15.933 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:15.934 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:18:15.934 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:15.934 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:18:15.934 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 869 k 2021-10-08T19:18:15.935 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2021-10-08T19:18:15.935 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-10-08T19:18:15.935 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:15.935 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:18:15.935 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:15.936 INFO:teuthology.orchestra.run.smithi157.stdout:Install 2 Packages 2021-10-08T19:18:15.936 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:15.936 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 952 k 2021-10-08T19:18:15.936 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 3.1 M 2021-10-08T19:18:15.937 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:18:15.967 INFO:teuthology.orchestra.run.smithi157.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 82 kB 00:00 2021-10-08T19:18:16.318 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : python3-cryptography-3.2.1-4.el8.x86_64 1/6 2021-10-08T19:18:16.749 INFO:teuthology.orchestra.run.smithi157.stdout:(2/2): ceph-fuse-17.0.0-8087.g103b6cc3.el8.x86_ 1.0 MB/s | 869 kB 00:00 2021-10-08T19:18:16.751 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:16.752 INFO:teuthology.orchestra.run.smithi157.stdout:Total 1.1 MB/s | 952 kB 00:00 2021-10-08T19:18:16.753 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:18:16.777 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:18:16.777 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:18:16.861 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:18:16.864 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:18:17.315 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/6 2021-10-08T19:18:17.348 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:18:17.596 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-10-08T19:18:17.683 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 3/6 2021-10-08T19:18:17.762 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:18:17.905 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 4/6 2021-10-08T19:18:18.063 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 5/6 2021-10-08T19:18:18.080 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 5/6 2021-10-08T19:18:18.110 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:18:18.110 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/2 2021-10-08T19:18:18.278 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:18:18.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-10-08T19:18:18.429 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:18.430 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:18.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-10-08T19:18:18.430 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:18.430 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:18.567 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:18:18.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/6 2021-10-08T19:18:18.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-10-08T19:18:18.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-10-08T19:18:18.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/6 2021-10-08T19:18:18.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 5/6 2021-10-08T19:18:18.627 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-volume 2021-10-08T19:18:18.896 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 6/6 2021-10-08T19:18:18.896 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:18.896 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2021-10-08T19:18:18.897 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-10-08T19:18:18.897 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:18.897 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:18:18.897 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2021-10-08T19:18:18.898 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.5.1-5.el8.noarch 2021-10-08T19:18:18.898 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-10-08T19:18:18.898 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:18.898 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:19.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-fuse 2021-10-08T19:18:19.107 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:47 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:19.500 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:47 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:19.780 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:19.781 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:19.781 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2021-10-08T19:18:19.782 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:19.782 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:18:19.782 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 253 k 2021-10-08T19:18:19.782 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:19.783 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:18:19.783 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:19.783 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2021-10-08T19:18:19.783 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:19.783 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 253 k 2021-10-08T19:18:19.784 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 1.2 M 2021-10-08T19:18:19.784 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:18:19.973 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-volume-17.0.0-8087.g103b6cc3.el8.noarch.rp 1.3 MB/s | 253 kB 00:00 2021-10-08T19:18:19.974 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:19.975 INFO:teuthology.orchestra.run.smithi157.stdout:Total 1.3 MB/s | 253 kB 00:00 2021-10-08T19:18:19.975 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:18:19.984 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:18:19.985 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:18:20.000 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:18:20.003 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:18:20.148 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:20.149 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:20.149 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:18:20.149 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:20.150 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:18:20.150 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 869 k 2021-10-08T19:18:20.150 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2021-10-08T19:18:20.150 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-10-08T19:18:20.151 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:20.151 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:18:20.151 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:20.151 INFO:teuthology.orchestra.run.smithi196.stdout:Install 2 Packages 2021-10-08T19:18:20.151 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:20.152 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 952 k 2021-10-08T19:18:20.152 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 3.1 M 2021-10-08T19:18:20.152 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:18:20.175 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:18:20.228 INFO:teuthology.orchestra.run.smithi196.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 1.0 MB/s | 82 kB 00:00 2021-10-08T19:18:20.388 INFO:teuthology.orchestra.run.smithi196.stdout:(2/2): ceph-fuse-17.0.0-8087.g103b6cc3.el8.x86_ 3.6 MB/s | 869 kB 00:00 2021-10-08T19:18:20.389 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:20.389 INFO:teuthology.orchestra.run.smithi196.stdout:Total 3.9 MB/s | 952 kB 00:00 2021-10-08T19:18:20.391 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:18:20.404 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:18:20.411 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:18:20.412 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:18:20.489 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:18:20.491 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:18:20.673 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:18:20.800 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:18:20.946 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-10-08T19:18:21.112 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:18:21.113 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:21.113 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:21.113 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:18:21.113 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:21.113 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:21.288 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados-devel 2021-10-08T19:18:21.295 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:18:21.712 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:18:21.712 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/2 2021-10-08T19:18:21.770 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:49 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:22.057 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-10-08T19:18:22.057 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:22.057 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:22.057 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-10-08T19:18:22.058 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:22.058 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:22.255 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-volume 2021-10-08T19:18:22.463 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:22.464 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:22.464 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2021-10-08T19:18:22.464 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:22.465 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:18:22.465 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 125 k 2021-10-08T19:18:22.465 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:22.465 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:18:22.466 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:22.466 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2021-10-08T19:18:22.466 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:22.466 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 125 k 2021-10-08T19:18:22.467 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 432 k 2021-10-08T19:18:22.467 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:18:22.633 INFO:teuthology.orchestra.run.smithi157.stdout:librados-devel-17.0.0-8087.g103b6cc3.el8.x86_64 744 kB/s | 125 kB 00:00 2021-10-08T19:18:22.634 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:22.634 INFO:teuthology.orchestra.run.smithi157.stdout:Total 737 kB/s | 125 kB 00:00 2021-10-08T19:18:22.634 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:18:22.640 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:18:22.640 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:18:22.689 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:18:22.691 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:18:22.732 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:50 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:22.803 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:18:23.043 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:23.294 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:23.431 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:23.432 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2021-10-08T19:18:23.432 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:23.432 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:18:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 253 k 2021-10-08T19:18:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:23.435 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:18:23.435 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:23.435 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2021-10-08T19:18:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:23.436 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 253 k 2021-10-08T19:18:23.436 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 1.2 M 2021-10-08T19:18:23.436 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:18:23.597 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:23.597 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:23.597 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:23.598 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:23.598 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:23.598 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:23.623 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-volume-17.0.0-8087.g103b6cc3.el8.noarch.rp 1.3 MB/s | 253 kB 00:00 2021-10-08T19:18:23.624 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:23.624 INFO:teuthology.orchestra.run.smithi196.stdout:Total 1.3 MB/s | 253 kB 00:00 2021-10-08T19:18:23.624 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:18:23.634 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:18:23.634 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:18:23.649 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:18:23.652 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:18:23.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs2 2021-10-08T19:18:23.825 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:18:24.062 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:18:24.221 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:52 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:24.428 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:18:24.728 INFO:teuthology.orchestra.run.smithi157.stdout:Package libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:24.731 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:18:24.731 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:24.731 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:24.731 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:18:24.732 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:24.732 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:24.903 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:24.904 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2021-10-08T19:18:24.904 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:24.927 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install librados-devel 2021-10-08T19:18:24.970 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs-devel 2021-10-08T19:18:25.401 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:53 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:25.443 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:53 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:26.095 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:26.098 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:26.098 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repo Size 2021-10-08T19:18:26.098 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:26.099 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:18:26.099 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 125 k 2021-10-08T19:18:26.099 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:26.099 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:18:26.100 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:26.100 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2021-10-08T19:18:26.100 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:26.101 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 125 k 2021-10-08T19:18:26.101 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 432 k 2021-10-08T19:18:26.102 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:18:26.128 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:26.129 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:26.129 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2021-10-08T19:18:26.130 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:26.130 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:18:26.130 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:18:26.130 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:26.132 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:18:26.132 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:26.132 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2021-10-08T19:18:26.133 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:26.133 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 24 k 2021-10-08T19:18:26.133 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 102 k 2021-10-08T19:18:26.133 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:18:26.251 INFO:teuthology.orchestra.run.smithi157.stdout:libcephfs-devel-17.0.0-8087.g103b6cc3.el8.x86_6 196 kB/s | 24 kB 00:00 2021-10-08T19:18:26.252 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:26.253 INFO:teuthology.orchestra.run.smithi157.stdout:Total 194 kB/s | 24 kB 00:00 2021-10-08T19:18:26.253 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:18:26.256 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:18:26.256 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:18:26.257 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:18:26.260 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:18:26.264 INFO:teuthology.orchestra.run.smithi196.stdout:librados-devel-17.0.0-8087.g103b6cc3.el8.x86_64 746 kB/s | 125 kB 00:00 2021-10-08T19:18:26.265 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:26.266 INFO:teuthology.orchestra.run.smithi196.stdout:Total 739 kB/s | 125 kB 00:00 2021-10-08T19:18:26.266 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:18:26.272 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:18:26.272 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:18:26.321 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:18:26.324 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:18:26.337 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:18:26.447 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:18:26.518 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:26.744 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:26.768 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:27.002 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:27.002 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:27.002 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:27.002 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:27.003 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:27.003 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:27.053 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:27.081 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados2 2021-10-08T19:18:27.371 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:27.371 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:27.372 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:27.372 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:27.372 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:27.372 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:27.547 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install libcephfs2 2021-10-08T19:18:27.552 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:55 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:28.026 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:56 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:28.061 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:28.237 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:28.238 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2021-10-08T19:18:28.238 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:28.300 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librbd1 2021-10-08T19:18:28.521 INFO:teuthology.orchestra.run.smithi196.stdout:Package libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:28.695 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:28.696 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2021-10-08T19:18:28.697 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:28.764 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install libcephfs-devel 2021-10-08T19:18:28.773 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:56 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:29.236 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:57 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:29.261 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:29.440 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:29.441 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2021-10-08T19:18:29.441 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:29.519 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rados 2021-10-08T19:18:29.923 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:29.924 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:29.924 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repo Size 2021-10-08T19:18:29.924 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:29.925 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:18:29.925 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:18:29.925 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:29.925 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:18:29.925 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:29.926 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2021-10-08T19:18:29.926 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:29.926 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 24 k 2021-10-08T19:18:29.926 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 102 k 2021-10-08T19:18:29.927 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:18:29.988 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:57 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:30.046 INFO:teuthology.orchestra.run.smithi196.stdout:libcephfs-devel-17.0.0-8087.g103b6cc3.el8.x86_6 197 kB/s | 24 kB 00:00 2021-10-08T19:18:30.047 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:30.047 INFO:teuthology.orchestra.run.smithi196.stdout:Total 195 kB/s | 24 kB 00:00 2021-10-08T19:18:30.047 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:18:30.050 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:18:30.051 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:18:30.052 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:18:30.054 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:18:30.112 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:18:30.301 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:30.502 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:30.520 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:30.676 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:30.678 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2021-10-08T19:18:30.678 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:30.739 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rgw 2021-10-08T19:18:30.804 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:30.804 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:30.804 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:30.804 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:30.805 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:30.805 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:30.877 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install librados2 2021-10-08T19:18:31.211 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:59 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:31.343 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:59 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:31.711 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:31.853 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:31.884 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:31.885 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2021-10-08T19:18:31.885 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:31.947 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-cephfs 2021-10-08T19:18:32.030 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:32.031 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2021-10-08T19:18:32.031 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:32.096 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install librbd1 2021-10-08T19:18:32.419 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:00 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:32.566 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:02:00 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:32.935 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:33.114 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:33.115 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2021-10-08T19:18:33.115 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:33.345 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:33.467 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rbd 2021-10-08T19:18:33.519 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:33.520 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2021-10-08T19:18:33.520 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:33.601 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install python3-rados 2021-10-08T19:18:33.946 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:01 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:34.070 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:02:02 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:34.435 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:34.570 INFO:teuthology.orchestra.run.smithi196.stdout:Package python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:34.615 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:34.615 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2021-10-08T19:18:34.616 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:34.684 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-fuse 2021-10-08T19:18:34.749 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:34.749 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2021-10-08T19:18:34.750 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:34.821 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install python3-rgw 2021-10-08T19:18:35.154 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:03 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:35.292 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:02:03 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:35.761 INFO:teuthology.orchestra.run.smithi196.stdout:Package python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:35.801 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:35.802 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:35.803 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2021-10-08T19:18:35.803 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:35.803 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:18:35.803 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 93 k 2021-10-08T19:18:35.803 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:35.804 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:18:35.804 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:35.804 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2021-10-08T19:18:35.804 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:35.805 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 93 k 2021-10-08T19:18:35.805 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 281 k 2021-10-08T19:18:35.805 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:18:35.937 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:35.938 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2021-10-08T19:18:35.938 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:36.000 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install python3-cephfs 2021-10-08T19:18:36.041 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-fuse-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 390 kB/s | 93 kB 00:00 2021-10-08T19:18:36.042 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:36.042 INFO:teuthology.orchestra.run.smithi157.stdout:Total 388 kB/s | 93 kB 00:00 2021-10-08T19:18:36.042 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:18:36.053 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:18:36.053 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:18:36.102 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:18:36.104 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:18:36.205 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:18:36.383 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:36.468 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:02:04 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:36.637 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:36.934 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:36.935 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:36.935 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:36.935 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:36.935 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:36.936 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:36.977 INFO:teuthology.orchestra.run.smithi196.stdout:Package python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:37.096 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-mirror 2021-10-08T19:18:37.152 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:37.153 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2021-10-08T19:18:37.153 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:37.241 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install python3-rbd 2021-10-08T19:18:37.575 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:05 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:37.710 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:02:05 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:38.202 INFO:teuthology.orchestra.run.smithi196.stdout:Package python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:38.240 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:38.241 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:38.241 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2021-10-08T19:18:38.242 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:38.242 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:18:38.242 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:18:38.242 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:38.242 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:18:38.243 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:38.243 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2021-10-08T19:18:38.243 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:38.243 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 3.8 M 2021-10-08T19:18:38.244 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 19 M 2021-10-08T19:18:38.244 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:18:38.379 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:38.380 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2021-10-08T19:18:38.380 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:38.626 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-mirror-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 9.8 MB/s | 3.8 MB 00:00 2021-10-08T19:18:38.626 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:38.627 INFO:teuthology.orchestra.run.smithi157.stdout:Total 9.8 MB/s | 3.8 MB 00:00 2021-10-08T19:18:38.627 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:18:38.640 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:18:38.640 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:18:38.703 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:18:38.705 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:18:38.765 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install rbd-fuse 2021-10-08T19:18:39.230 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:18:39.238 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:02:07 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:39.751 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:39.949 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:39.950 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:39.951 INFO:teuthology.orchestra.run.smithi196.stdout: Package Architecture Version Repository Size 2021-10-08T19:18:39.951 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:39.951 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:18:39.951 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 93 k 2021-10-08T19:18:39.951 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:39.952 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:18:39.952 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:39.952 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2021-10-08T19:18:39.952 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:39.953 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 93 k 2021-10-08T19:18:39.953 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 281 k 2021-10-08T19:18:39.953 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:18:40.120 INFO:teuthology.orchestra.run.smithi196.stdout:rbd-fuse-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 548 kB/s | 93 kB 00:00 2021-10-08T19:18:40.121 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:40.122 INFO:teuthology.orchestra.run.smithi196.stdout:Total 544 kB/s | 93 kB 00:00 2021-10-08T19:18:40.122 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:18:40.132 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:18:40.132 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:18:40.133 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:40.183 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:18:40.185 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:18:40.298 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:18:40.410 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:40.411 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:40.411 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:40.412 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:40.412 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:40.413 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:40.507 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:40.611 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-nbd 2021-10-08T19:18:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:41.078 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:41.079 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:41.079 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:41.079 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:41.079 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:41.080 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:41.093 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:09 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:41.228 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install rbd-mirror 2021-10-08T19:18:41.701 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:02:09 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:41.751 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2021-10-08T19:18:41.752 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:41.752 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2021-10-08T19:18:41.752 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:41.752 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2021-10-08T19:18:41.753 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 173 k 2021-10-08T19:18:41.753 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:41.753 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2021-10-08T19:18:41.753 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2021-10-08T19:18:41.753 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2021-10-08T19:18:41.754 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:41.754 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 173 k 2021-10-08T19:18:41.754 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 563 k 2021-10-08T19:18:41.755 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2021-10-08T19:18:41.921 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-nbd-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 1.0 MB/s | 173 kB 00:00 2021-10-08T19:18:41.922 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:41.923 INFO:teuthology.orchestra.run.smithi157.stdout:Total 1.0 MB/s | 173 kB 00:00 2021-10-08T19:18:41.923 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2021-10-08T19:18:41.935 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2021-10-08T19:18:41.935 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2021-10-08T19:18:41.986 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2021-10-08T19:18:41.988 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2021-10-08T19:18:42.106 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2021-10-08T19:18:42.300 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:42.364 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:42.365 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:42.365 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repo Size 2021-10-08T19:18:42.365 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:42.366 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:18:42.366 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:18:42.366 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:42.367 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:18:42.367 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:42.367 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2021-10-08T19:18:42.367 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:42.368 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 3.8 M 2021-10-08T19:18:42.368 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 19 M 2021-10-08T19:18:42.368 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:18:42.556 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:42.833 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:42.834 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:42.834 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2021-10-08T19:18:42.834 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:42.834 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:18:42.835 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2021-10-08T19:18:42.906 INFO:teuthology.orchestra.run.smithi196.stdout:rbd-mirror-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 7.0 MB/s | 3.8 MB 00:00 2021-10-08T19:18:42.907 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:42.907 INFO:teuthology.orchestra.run.smithi196.stdout:Total 7.0 MB/s | 3.8 MB 00:00 2021-10-08T19:18:42.908 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:18:42.921 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:18:42.921 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:18:42.984 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:18:42.986 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:18:43.061 DEBUG:teuthology.parallel:result is None 2021-10-08T19:18:43.460 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:18:43.667 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:44.036 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:44.807 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:44.808 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:44.808 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:44.808 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:44.808 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:44.809 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:45.155 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install rbd-nbd 2021-10-08T19:18:45.638 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:02:13 ago on Fri 08 Oct 2021 07:16:32 PM UTC. 2021-10-08T19:18:46.312 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2021-10-08T19:18:46.313 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:46.313 INFO:teuthology.orchestra.run.smithi196.stdout: Package Architecture Version Repository Size 2021-10-08T19:18:46.313 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:46.314 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2021-10-08T19:18:46.314 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 173 k 2021-10-08T19:18:46.314 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:46.314 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2021-10-08T19:18:46.314 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2021-10-08T19:18:46.315 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2021-10-08T19:18:46.315 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:46.315 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 173 k 2021-10-08T19:18:46.315 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 563 k 2021-10-08T19:18:46.316 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2021-10-08T19:18:46.483 INFO:teuthology.orchestra.run.smithi196.stdout:rbd-nbd-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 1.0 MB/s | 173 kB 00:00 2021-10-08T19:18:46.483 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:46.484 INFO:teuthology.orchestra.run.smithi196.stdout:Total 1.0 MB/s | 173 kB 00:00 2021-10-08T19:18:46.484 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2021-10-08T19:18:46.495 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2021-10-08T19:18:46.495 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2021-10-08T19:18:46.544 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2021-10-08T19:18:46.547 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2021-10-08T19:18:46.683 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2021-10-08T19:18:46.898 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:47.158 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:47.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:47.476 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:47.477 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2021-10-08T19:18:47.477 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:47.477 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:18:47.477 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2021-10-08T19:18:47.667 DEBUG:teuthology.parallel:result is None 2021-10-08T19:18:47.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo lsb_release -is 2021-10-08T19:18:47.709 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS 2021-10-08T19:18:47.711 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:18:47.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:18:47.870 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-10-08T19:18:47.892 INFO:teuthology.orchestra.run.smithi157.stdout:17.0.0-8087.g103b6cc3.el8 2021-10-08T19:18:47.893 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-8087.g103b6cc3.el8 2021-10-08T19:18:47.894 INFO:teuthology.task.install:The correct ceph version 17.0.0-8087.g103b6cc3 is installed. 2021-10-08T19:18:47.894 DEBUG:teuthology.orchestra.run.smithi196:> sudo lsb_release -is 2021-10-08T19:18:47.927 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS 2021-10-08T19:18:47.930 DEBUG:teuthology.misc:System to be installed: CentOS 2021-10-08T19:18:47.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:18:48.101 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-10-08T19:18:48.120 INFO:teuthology.orchestra.run.smithi196.stdout:17.0.0-8087.g103b6cc3.el8 2021-10-08T19:18:48.121 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-8087.g103b6cc3.el8 2021-10-08T19:18:48.122 INFO:teuthology.task.install:The correct ceph version 17.0.0-8087.g103b6cc3 is installed. 2021-10-08T19:18:48.122 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-10-08T19:18:48.123 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:18:48.123 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-08T19:18:48.152 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:18:48.152 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-08T19:18:48.183 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-10-08T19:18:48.184 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:18:48.184 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2021-10-08T19:18:48.223 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-08T19:18:48.290 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:18:48.291 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2021-10-08T19:18:48.314 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-08T19:18:48.378 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-10-08T19:18:48.378 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:18:48.379 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-08T19:18:48.405 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-08T19:18:48.471 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:18:48.471 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-08T19:18:48.495 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-08T19:18:48.558 INFO:teuthology.run_tasks:Running task cephadm... 2021-10-08T19:18:48.630 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf', 'cephadm_mode': 'cephadm-package'} 2021-10-08T19:18:48.630 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:18:48.631 INFO:tasks.cephadm:Cluster fsid is 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:18:48.631 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-10-08T19:18:48.632 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.157', 'mon.c': '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]', 'mon.b': '172.21.15.196'} 2021-10-08T19:18:48.632 INFO:tasks.cephadm:First mon is mon.a on smithi157 2021-10-08T19:18:48.633 INFO:tasks.cephadm:First mgr is y 2021-10-08T19:18:48.633 INFO:tasks.cephadm:Normalizing hostnames... 2021-10-08T19:18:48.633 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2021-10-08T19:18:48.659 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname $(hostname -s) 2021-10-08T19:18:48.698 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2021-10-08T19:18:48.725 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph 2021-10-08T19:18:48.748 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2021-10-08T19:18:48.789 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /etc/ceph 2021-10-08T19:18:48.818 INFO:tasks.cephadm:Writing seed config... 2021-10-08T19:18:48.819 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-10-08T19:18:48.820 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-10-08T19:18:48.820 INFO:tasks.cephadm: override: [client] debug ms = 1 2021-10-08T19:18:48.820 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2021-10-08T19:18:48.821 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2021-10-08T19:18:48.821 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2021-10-08T19:18:48.821 INFO:tasks.cephadm: override: [global] ms type = async 2021-10-08T19:18:48.822 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-10-08T19:18:48.822 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-10-08T19:18:48.822 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-10-08T19:18:48.823 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2021-10-08T19:18:48.823 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-10-08T19:18:48.823 INFO:tasks.cephadm: override: [osd] debug osd = 20 2021-10-08T19:18:48.823 INFO:tasks.cephadm: override: [osd] osd class default list = * 2021-10-08T19:18:48.824 INFO:tasks.cephadm: override: [osd] osd class load list = * 2021-10-08T19:18:48.824 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-10-08T19:18:48.825 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:18:48.825 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-10-08T19:18:48.843 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 906d7a14-286c-11ec-8c25-001a4aab830c mon election default strategy = 1 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2021-10-08T19:18:48.844 DEBUG:teuthology.orchestra.run.smithi157:mon.a> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a.service 2021-10-08T19:18:48.885 DEBUG:teuthology.orchestra.run.smithi157:mgr.y> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y.service 2021-10-08T19:18:48.909 INFO:journalctl@ceph.mon.a.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:18:48.910 INFO:tasks.cephadm:Bootstrapping... 2021-10-08T19:18:48.910 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -v bootstrap --fsid 906d7a14-286c-11ec-8c25-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.157 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:18:48.932 INFO:journalctl@ceph.mgr.y.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:18:49.153 INFO:teuthology.orchestra.run.smithi157.stderr:-------------------------------------------------------------------------------- 2021-10-08T19:18:49.153 INFO:teuthology.orchestra.run.smithi157.stderr:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf', '-v', 'bootstrap', '--fsid', '906d7a14-286c-11ec-8c25-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.157', '--skip-admin-label'] 2021-10-08T19:18:49.153 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-10-08T19:18:50.108 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: 3.0.2-dev 2021-10-08T19:18:50.124 INFO:teuthology.orchestra.run.smithi157.stderr:Verifying podman|docker is present... 2021-10-08T19:18:50.124 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-10-08T19:18:50.173 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: 3.0.2-dev 2021-10-08T19:18:50.192 INFO:teuthology.orchestra.run.smithi157.stderr:Verifying lvm2 is present... 2021-10-08T19:18:50.192 INFO:teuthology.orchestra.run.smithi157.stderr:Verifying time synchronization is in place... 2021-10-08T19:18:50.192 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-enabled chrony.service 2021-10-08T19:18:50.199 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-10-08T19:18:50.200 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-active chrony.service 2021-10-08T19:18:50.206 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: inactive 2021-10-08T19:18:50.206 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-enabled chronyd.service 2021-10-08T19:18:50.212 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: enabled 2021-10-08T19:18:50.212 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-active chronyd.service 2021-10-08T19:18:50.218 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: active 2021-10-08T19:18:50.218 INFO:teuthology.orchestra.run.smithi157.stderr:Unit chronyd.service is enabled and running 2021-10-08T19:18:50.219 INFO:teuthology.orchestra.run.smithi157.stderr:Repeating the final host check... 2021-10-08T19:18:50.219 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-10-08T19:18:50.263 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: 3.0.2-dev 2021-10-08T19:18:50.277 INFO:teuthology.orchestra.run.smithi157.stderr:podman (/bin/podman) version 3.0.2 is present 2021-10-08T19:18:50.277 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl is present 2021-10-08T19:18:50.278 INFO:teuthology.orchestra.run.smithi157.stderr:lvcreate is present 2021-10-08T19:18:50.278 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-enabled chrony.service 2021-10-08T19:18:50.282 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-10-08T19:18:50.283 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-active chrony.service 2021-10-08T19:18:50.288 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: inactive 2021-10-08T19:18:50.288 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-enabled chronyd.service 2021-10-08T19:18:50.294 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: enabled 2021-10-08T19:18:50.294 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-active chronyd.service 2021-10-08T19:18:50.299 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: active 2021-10-08T19:18:50.300 INFO:teuthology.orchestra.run.smithi157.stderr:Unit chronyd.service is enabled and running 2021-10-08T19:18:50.301 INFO:teuthology.orchestra.run.smithi157.stderr:Host looks OK 2021-10-08T19:18:50.301 INFO:teuthology.orchestra.run.smithi157.stderr:Cluster fsid: 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:18:50.301 INFO:teuthology.orchestra.run.smithi157.stderr:Acquiring lock 140050503006696 on /run/cephadm/906d7a14-286c-11ec-8c25-001a4aab830c.lock 2021-10-08T19:18:50.301 INFO:teuthology.orchestra.run.smithi157.stderr:Lock 140050503006696 acquired on /run/cephadm/906d7a14-286c-11ec-8c25-001a4aab830c.lock 2021-10-08T19:18:50.302 INFO:teuthology.orchestra.run.smithi157.stderr:Verifying IP 172.21.15.157 port 3300 ... 2021-10-08T19:18:50.302 INFO:teuthology.orchestra.run.smithi157.stderr:Verifying IP 172.21.15.157 port 6789 ... 2021-10-08T19:18:50.303 INFO:teuthology.orchestra.run.smithi157.stderr:Base mon IP is 172.21.15.157, final addrv is [v2:172.21.15.157:3300,v1:172.21.15.157:6789] 2021-10-08T19:18:50.303 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /sbin/ip route ls 2021-10-08T19:18:50.304 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2021-10-08T19:18:50.304 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.157 metric 100 2021-10-08T19:18:50.304 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /sbin/ip -6 route ls 2021-10-08T19:18:50.306 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-10-08T19:18:50.307 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2021-10-08T19:18:50.307 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2021-10-08T19:18:50.307 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /sbin/ip -6 addr ls 2021-10-08T19:18:50.309 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-10-08T19:18:50.309 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: inet6 ::1/128 scope host 2021-10-08T19:18:50.309 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-10-08T19:18:50.310 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2021-10-08T19:18:50.310 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link noprefixroute 2021-10-08T19:18:50.310 INFO:teuthology.orchestra.run.smithi157.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-10-08T19:18:50.311 INFO:teuthology.orchestra.run.smithi157.stderr:Mon IP `172.21.15.157` is in CIDR network `172.21.0.0/20` 2021-10-08T19:18:50.311 INFO:teuthology.orchestra.run.smithi157.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2021-10-08T19:18:50.311 INFO:teuthology.orchestra.run.smithi157.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf... 2021-10-08T19:18:50.312 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman pull quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:18:50.397 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: Trying to pull quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf... 2021-10-08T19:18:52.426 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: Getting image source signatures 2021-10-08T19:18:52.543 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: Copying blob sha256:bf399268b236a88e4db94bb617389c57056c51b9b05d91ff5b48f1ad6f845f5e 2021-10-08T19:18:52.601 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: Copying blob sha256:be118be2c7433f0fef49ac99462184a67ed6f0c5b5723500aea70f60acdb522f 2021-10-08T19:19:34.219 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: Copying config sha256:085fa9937774283f2e7d932e3f979b6814e0da92c6b18e0753c7a57d64a9fc79 2021-10-08T19:19:34.269 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: Writing manifest to image destination 2021-10-08T19:19:34.269 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: Storing signatures 2021-10-08T19:19:44.492 INFO:teuthology.orchestra.run.smithi157.stderr:/bin/podman: 085fa9937774283f2e7d932e3f979b6814e0da92c6b18e0753c7a57d64a9fc79 2021-10-08T19:19:44.510 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --version 2021-10-08T19:19:45.200 INFO:teuthology.orchestra.run.smithi157.stderr:ceph: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev) 2021-10-08T19:19:56.134 INFO:teuthology.orchestra.run.smithi157.stderr:Ceph version: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev) 2021-10-08T19:19:56.134 INFO:teuthology.orchestra.run.smithi157.stderr:Extracting ceph user uid/gid from container image... 2021-10-08T19:19:56.134 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint stat --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -c %u %g /var/lib/ceph 2021-10-08T19:19:56.629 INFO:teuthology.orchestra.run.smithi157.stderr:stat: 167 167 2021-10-08T19:19:57.089 INFO:teuthology.orchestra.run.smithi157.stderr:Creating initial keys... 2021-10-08T19:19:57.089 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --gen-print-key 2021-10-08T19:19:57.646 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph-authtool: AQDdmWBhNSAUJRAAxQVbvbsx18vXwjG5zoZQMA== 2021-10-08T19:19:58.122 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --gen-print-key 2021-10-08T19:19:58.621 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph-authtool: AQDemWBh8sUrJBAAgxuVFQNQE15OJ6ddN5QpjQ== 2021-10-08T19:19:59.089 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --gen-print-key 2021-10-08T19:19:59.604 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph-authtool: AQDfmWBhccwlIxAAX+uEuj1mWwcILgfz4H7/AQ== 2021-10-08T19:20:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:Creating initial monmap... 2021-10-08T19:20:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmpl2szbd2q:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --create --clobber --fsid 906d7a14-286c-11ec-8c25-001a4aab830c --addv a [v2:172.21.15.157:3300,v1:172.21.15.157:6789] /tmp/monmap 2021-10-08T19:20:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-10-08T19:20:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/monmaptool: setting min_mon_release = octopus 2021-10-08T19:20:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:00.624 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-10-08T19:20:01.161 INFO:teuthology.orchestra.run.smithi157.stderr:monmaptool for a [v2:172.21.15.157:3300,v1:172.21.15.157:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-10-08T19:20:01.161 INFO:teuthology.orchestra.run.smithi157.stderr:setting min_mon_release = octopus 2021-10-08T19:20:01.162 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/monmaptool: set fsid to 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:01.162 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-10-08T19:20:01.162 INFO:teuthology.orchestra.run.smithi157.stderr: 2021-10-08T19:20:01.162 INFO:teuthology.orchestra.run.smithi157.stderr:Creating mon... 2021-10-08T19:20:01.163 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpg0wghtjp:/tmp/keyring:z -v /tmp/ceph-tmpl2szbd2q:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --mkfs -i a --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false 2021-10-08T19:20:02.138 INFO:teuthology.orchestra.run.smithi157.stderr:create mon.a on 2021-10-08T19:20:02.139 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:02.145 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl disable ceph.target 2021-10-08T19:20:02.153 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-10-08T19:20:02.235 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl enable ceph.target 2021-10-08T19:20:02.241 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2021-10-08T19:20:02.314 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl start ceph.target 2021-10-08T19:20:02.321 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl enable ceph-906d7a14-286c-11ec-8c25-001a4aab830c.target 2021-10-08T19:20:02.327 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-906d7a14-286c-11ec-8c25-001a4aab830c.target → /etc/systemd/system/ceph-906d7a14-286c-11ec-8c25-001a4aab830c.target. 2021-10-08T19:20:02.327 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-906d7a14-286c-11ec-8c25-001a4aab830c.target → /etc/systemd/system/ceph-906d7a14-286c-11ec-8c25-001a4aab830c.target. 2021-10-08T19:20:02.401 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl start ceph-906d7a14-286c-11ec-8c25-001a4aab830c.target 2021-10-08T19:20:02.408 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl daemon-reload 2021-10-08T19:20:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:20:02.507 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl reset-failed ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:20:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Failed to reset failed state of unit ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a.service: Unit ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a.service not loaded. 2021-10-08T19:20:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl enable ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:20:02.519 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Created symlink /etc/systemd/system/ceph-906d7a14-286c-11ec-8c25-001a4aab830c.target.wants/ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-906d7a14-286c-11ec-8c25-001a4aab830c@.service. 2021-10-08T19:20:02.594 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl start ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:20:02.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:02 smithi157 systemd[1]: Starting Ceph mon.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:20:03.134 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:20:03.143 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: disabled 2021-10-08T19:20:03.143 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:20:03.150 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: inactive 2021-10-08T19:20:03.151 INFO:teuthology.orchestra.run.smithi157.stderr:firewalld.service is not enabled 2021-10-08T19:20:03.151 INFO:teuthology.orchestra.run.smithi157.stderr:Not possible to enable service . firewalld.service is not available 2021-10-08T19:20:03.152 INFO:teuthology.orchestra.run.smithi157.stderr:Waiting for mon to start... 2021-10-08T19:20:03.152 INFO:teuthology.orchestra.run.smithi157.stderr:Waiting for mon... 2021-10-08T19:20:03.152 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status 2021-10-08T19:20:03.413 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:03 smithi157 bash[31774]: c1ae8bcc6b60d363cc4cd2ed60c99d36456afb36a5f39f00a1ddfa11be06df3c 2021-10-08T19:20:03.414 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:03 smithi157 systemd[1]: Started Ceph mon.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:20:03.414 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:03 smithi157 ceph-mon[31986]: mkfs 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:03.414 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:03 smithi157 ceph-mon[31986]: mon.a is new leader, mons a in quorum (ranks 0) 2021-10-08T19:20:03.765 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.759+0000 7feb1e78a700 1 Processor -- start 2021-10-08T19:20:03.765 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.759+0000 7feb1e78a700 1 -- start start 2021-10-08T19:20:03.765 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.760+0000 7feb1e78a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb180fc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.760+0000 7feb1e78a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb180fcfc0 con 0x7feb180fc5e0 2021-10-08T19:20:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.760+0000 7feb17fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb180fc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.760+0000 7feb17fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb180fc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39282/0 (socket says 172.21.15.157:39282) 2021-10-08T19:20:03.767 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.760+0000 7feb17fff700 1 -- 172.21.15.157:0/724294697 learned_addr learned my addr 172.21.15.157:0/724294697 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:03.767 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.760+0000 7feb17fff700 1 -- 172.21.15.157:0/724294697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180fd100 con 0x7feb180fc5e0 2021-10-08T19:20:03.767 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb17fff700 1 --2- 172.21.15.157:0/724294697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb180fc9f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feb0800b5f0 tx=0x7feb08006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4b2fc93b336141 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:03.767 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb16ffd700 1 -- 172.21.15.157:0/724294697 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb080106d0 con 0x7feb180fc5e0 2021-10-08T19:20:03.768 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb16ffd700 1 -- 172.21.15.157:0/724294697 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08010830 con 0x7feb180fc5e0 2021-10-08T19:20:03.768 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb16ffd700 1 -- 172.21.15.157:0/724294697 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb08010ae0 con 0x7feb180fc5e0 2021-10-08T19:20:03.768 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb1e78a700 1 -- 172.21.15.157:0/724294697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 msgr2=0x7feb180fc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:03.768 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb1e78a700 1 --2- 172.21.15.157:0/724294697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb180fc9f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feb0800b5f0 tx=0x7feb08006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:03.769 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb1e78a700 1 -- 172.21.15.157:0/724294697 shutdown_connections 2021-10-08T19:20:03.769 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb1e78a700 1 --2- 172.21.15.157:0/724294697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb180fc9f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:03.769 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb1e78a700 1 -- 172.21.15.157:0/724294697 >> 172.21.15.157:0/724294697 conn(0x7feb180f7d50 msgr2=0x7feb180fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:03.769 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb1e78a700 1 -- 172.21.15.157:0/724294697 shutdown_connections 2021-10-08T19:20:03.770 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.761+0000 7feb1e78a700 1 -- 172.21.15.157:0/724294697 wait complete. 2021-10-08T19:20:03.770 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.762+0000 7feb1e78a700 1 Processor -- start 2021-10-08T19:20:03.770 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.762+0000 7feb1e78a700 1 -- start start 2021-10-08T19:20:03.770 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb1e78a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb1810a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:03.771 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb1e78a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1810af30 con 0x7feb180fc5e0 2021-10-08T19:20:03.771 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb17fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb1810a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:03.771 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb17fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb1810a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39284/0 (socket says 172.21.15.157:39284) 2021-10-08T19:20:03.771 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb17fff700 1 -- 172.21.15.157:0/3487562849 learned_addr learned my addr 172.21.15.157:0/3487562849 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:03.772 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb17fff700 1 -- 172.21.15.157:0/3487562849 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0800b200 con 0x7feb180fc5e0 2021-10-08T19:20:03.772 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb17fff700 1 --2- 172.21.15.157:0/3487562849 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb1810a9f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7feb08006f20 tx=0x7feb08015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:03.772 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb14ff9700 1 -- 172.21.15.157:0/3487562849 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb0801d430 con 0x7feb180fc5e0 2021-10-08T19:20:03.773 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb14ff9700 1 -- 172.21.15.157:0/3487562849 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0801d590 con 0x7feb180fc5e0 2021-10-08T19:20:03.773 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb1e78a700 1 -- 172.21.15.157:0/3487562849 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1810b130 con 0x7feb180fc5e0 2021-10-08T19:20:03.773 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb14ff9700 1 -- 172.21.15.157:0/3487562849 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb0801d740 con 0x7feb180fc5e0 2021-10-08T19:20:03.773 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.763+0000 7feb1e78a700 1 -- 172.21.15.157:0/3487562849 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1810bdd0 con 0x7feb180fc5e0 2021-10-08T19:20:03.774 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.764+0000 7feb14ff9700 1 -- 172.21.15.157:0/3487562849 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7feb0800f070 con 0x7feb180fc5e0 2021-10-08T19:20:03.774 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.764+0000 7feb14ff9700 1 -- 172.21.15.157:0/3487562849 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7feb080257a0 con 0x7feb180fc5e0 2021-10-08T19:20:03.774 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.764+0000 7feb1e78a700 1 -- 172.21.15.157:0/3487562849 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1810b5c0 con 0x7feb180fc5e0 2021-10-08T19:20:03.775 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.767+0000 7feb14ff9700 1 -- 172.21.15.157:0/3487562849 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7feb0801dcb0 con 0x7feb180fc5e0 2021-10-08T19:20:03.839 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.835+0000 7feb1e78a700 1 -- 172.21.15.157:0/3487562849 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7feb18047350 con 0x7feb180fc5e0 2021-10-08T19:20:03.839 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.836+0000 7feb14ff9700 1 -- 172.21.15.157:0/3487562849 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7feb0801de50 con 0x7feb180fc5e0 2021-10-08T19:20:03.839 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: cluster: 2021-10-08T19:20:03.839 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: id: 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:03.840 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-10-08T19:20:03.840 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.840 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: services: 2021-10-08T19:20:03.840 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 698327399) 2021-10-08T19:20:03.841 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mgr: no daemons active 2021-10-08T19:20:03.841 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-10-08T19:20:03.841 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.841 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: data: 2021-10-08T19:20:03.842 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-10-08T19:20:03.842 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-10-08T19:20:03.842 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-10-08T19:20:03.842 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: pgs: 2021-10-08T19:20:03.843 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.843 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.837+0000 7feb1e78a700 1 -- 172.21.15.157:0/3487562849 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 msgr2=0x7feb1810a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:03.843 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.837+0000 7feb1e78a700 1 --2- 172.21.15.157:0/3487562849 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb1810a9f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7feb08006f20 tx=0x7feb08015000 comp rx=0 tx=0).stop 2021-10-08T19:20:03.843 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.837+0000 7feb1e78a700 1 -- 172.21.15.157:0/3487562849 shutdown_connections 2021-10-08T19:20:03.843 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.837+0000 7feb1e78a700 1 --2- 172.21.15.157:0/3487562849 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb180fc5e0 0x7feb1810a9f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:03.844 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.837+0000 7feb1e78a700 1 -- 172.21.15.157:0/3487562849 >> 172.21.15.157:0/3487562849 conn(0x7feb180f7d50 msgr2=0x7feb180ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:03.844 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.837+0000 7feb1e78a700 1 -- 172.21.15.157:0/3487562849 shutdown_connections 2021-10-08T19:20:03.844 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:03.837+0000 7feb1e78a700 1 -- 172.21.15.157:0/3487562849 wait complete. 2021-10-08T19:20:04.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:04 smithi157 ceph-mon[31986]: mon.a is new leader, mons a in quorum (ranks 0) 2021-10-08T19:20:04.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:04 smithi157 ceph-mon[31986]: monmap e1: 1 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} 2021-10-08T19:20:04.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:04 smithi157 ceph-mon[31986]: fsmap 2021-10-08T19:20:04.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:04 smithi157 ceph-mon[31986]: osdmap e1: 0 total, 0 up, 0 in 2021-10-08T19:20:04.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:04 smithi157 ceph-mon[31986]: mgrmap e1: no daemons active 2021-10-08T19:20:04.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:04 smithi157 ceph-mon[31986]: from='client.? 172.21.15.157:0/3487562849' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-10-08T19:20:04.588 INFO:teuthology.orchestra.run.smithi157.stderr:mon is available 2021-10-08T19:20:04.589 INFO:teuthology.orchestra.run.smithi157.stderr:Assimilating anything we can from ceph.conf... 2021-10-08T19:20:04.589 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z -v /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-10-08T19:20:05.202 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.200+0000 7f0dc8f40700 1 Processor -- start 2021-10-08T19:20:05.202 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.200+0000 7f0dc8f40700 1 -- start start 2021-10-08T19:20:05.204 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.200+0000 7f0dc8f40700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc40fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:05.204 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.200+0000 7f0dc8f40700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40fbec0 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.205 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.200+0000 7f0dc259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc40fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:05.205 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.201+0000 7f0dc259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc40fb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39286/0 (socket says 172.21.15.157:39286) 2021-10-08T19:20:05.205 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.201+0000 7f0dc259c700 1 -- 172.21.15.157:0/684421351 learned_addr learned my addr 172.21.15.157:0/684421351 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:05.206 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.201+0000 7f0dc259c700 1 -- 172.21.15.157:0/684421351 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc40fc000 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.206 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.201+0000 7f0dc259c700 1 --2- 172.21.15.157:0/684421351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc40fb8f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009960 tx=0x7f0db40092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f37de629d16753 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:05.206 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.201+0000 7f0dc159a700 1 -- 172.21.15.157:0/684421351 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0db400b860 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.206 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.201+0000 7f0dc159a700 1 -- 172.21.15.157:0/684421351 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db400b9c0 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.207 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.201+0000 7f0dc159a700 1 -- 172.21.15.157:0/684421351 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0db400bb50 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.207 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 -- 172.21.15.157:0/684421351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 msgr2=0x7f0dc40fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:05.207 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 --2- 172.21.15.157:0/684421351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc40fb8f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009960 tx=0x7f0db40092d0 comp rx=0 tx=0).stop 2021-10-08T19:20:05.207 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 -- 172.21.15.157:0/684421351 shutdown_connections 2021-10-08T19:20:05.207 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 --2- 172.21.15.157:0/684421351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc40fb8f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:05.208 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 -- 172.21.15.157:0/684421351 >> 172.21.15.157:0/684421351 conn(0x7f0dc40f6c30 msgr2=0x7f0dc40f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:05.208 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 -- 172.21.15.157:0/684421351 shutdown_connections 2021-10-08T19:20:05.208 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 -- 172.21.15.157:0/684421351 wait complete. 2021-10-08T19:20:05.208 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 Processor -- start 2021-10-08T19:20:05.209 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 -- start start 2021-10-08T19:20:05.209 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc41087f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:05.209 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc8f40700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4108d30 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.209 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc41087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:05.209 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc41087f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39288/0 (socket says 172.21.15.157:39288) 2021-10-08T19:20:05.210 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.202+0000 7f0dc259c700 1 -- 172.21.15.157:0/1993518272 learned_addr learned my addr 172.21.15.157:0/1993518272 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:05.210 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.203+0000 7f0dc259c700 1 -- 172.21.15.157:0/1993518272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4009570 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.210 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.203+0000 7f0dc259c700 1 --2- 172.21.15.157:0/1993518272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc41087f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0db40090b0 tx=0x7f0db4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:05.210 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.203+0000 7f0dbaffd700 1 -- 172.21.15.157:0/1993518272 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0db400be60 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.211 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.203+0000 7f0dbaffd700 1 -- 172.21.15.157:0/1993518272 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db401a650 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.211 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.203+0000 7f0dc8f40700 1 -- 172.21.15.157:0/1993518272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc4108f30 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.211 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.203+0000 7f0dbaffd700 1 -- 172.21.15.157:0/1993518272 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0db401a900 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.211 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.203+0000 7f0dc8f40700 1 -- 172.21.15.157:0/1993518272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc4109360 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.211 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.203+0000 7f0dbaffd700 1 -- 172.21.15.157:0/1993518272 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f0db4017020 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.212 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.203+0000 7f0dbaffd700 1 -- 172.21.15.157:0/1993518272 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0db402fa20 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.212 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.204+0000 7f0dc8f40700 1 -- 172.21.15.157:0/1993518272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc405a9f0 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.212 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.206+0000 7f0dbaffd700 1 -- 172.21.15.157:0/1993518272 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7f0db402fd00 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.273 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.272+0000 7f0dc8f40700 1 -- 172.21.15.157:0/1993518272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f0dc40472f0 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.278 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.275+0000 7f0dbaffd700 1 -- 172.21.15.157:0/1993518272 <== mon.0 v2:172.21.15.157:3300/0 7 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f0db4011880 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.278 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.275+0000 7f0dbaffd700 1 -- 172.21.15.157:0/1993518272 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+340 (secure 0 0 0) 0x7f0db4037460 con 0x7f0dc40fb4e0 2021-10-08T19:20:05.278 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.279 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: [global] 2021-10-08T19:20:05.279 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: fsid = 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:05.279 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.157:3300,v1:172.21.15.157:6789] 2021-10-08T19:20:05.279 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-10-08T19:20:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-10-08T19:20:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-10-08T19:20:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-10-08T19:20:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: [mgr] 2021-10-08T19:20:05.281 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-10-08T19:20:05.281 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.281 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: [osd] 2021-10-08T19:20:05.281 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-10-08T19:20:05.282 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-10-08T19:20:05.282 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.276+0000 7f0dc8f40700 1 -- 172.21.15.157:0/1993518272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 msgr2=0x7f0dc41087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:05.282 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.276+0000 7f0dc8f40700 1 --2- 172.21.15.157:0/1993518272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc41087f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0db40090b0 tx=0x7f0db4016000 comp rx=0 tx=0).stop 2021-10-08T19:20:05.282 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.276+0000 7f0dc8f40700 1 -- 172.21.15.157:0/1993518272 shutdown_connections 2021-10-08T19:20:05.282 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.276+0000 7f0dc8f40700 1 --2- 172.21.15.157:0/1993518272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc40fb4e0 0x7f0dc41087f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:05.283 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.276+0000 7f0dc8f40700 1 -- 172.21.15.157:0/1993518272 >> 172.21.15.157:0/1993518272 conn(0x7f0dc40f6c30 msgr2=0x7f0dc40f8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:05.283 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.276+0000 7f0dc8f40700 1 -- 172.21.15.157:0/1993518272 shutdown_connections 2021-10-08T19:20:05.283 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:05.276+0000 7f0dc8f40700 1 -- 172.21.15.157:0/1993518272 wait complete. 2021-10-08T19:20:05.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:05 smithi157 ceph-mon[31986]: from='client.? 172.21.15.157:0/1993518272' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-10-08T19:20:05.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:05 smithi157 ceph-mon[31986]: from='client.? 172.21.15.157:0/1993518272' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-10-08T19:20:05.894 INFO:teuthology.orchestra.run.smithi157.stderr:Generating new minimal ceph.conf... 2021-10-08T19:20:05.894 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z -v /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-10-08T19:20:06.478 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.474+0000 7f84c3fff700 1 Processor -- start 2021-10-08T19:20:06.479 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.474+0000 7f84c3fff700 1 -- start start 2021-10-08T19:20:06.479 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.474+0000 7f84c3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40ff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:06.479 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.474+0000 7f84c3fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40ff5f0 con 0x7f84c4070530 2021-10-08T19:20:06.479 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.474+0000 7f84c2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:06.480 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.474+0000 7f84c2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40ff020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39290/0 (socket says 172.21.15.157:39290) 2021-10-08T19:20:06.480 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.474+0000 7f84c2ffd700 1 -- 172.21.15.157:0/1532824802 learned_addr learned my addr 172.21.15.157:0/1532824802 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:06.480 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c2ffd700 1 -- 172.21.15.157:0/1532824802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c40ff730 con 0x7f84c4070530 2021-10-08T19:20:06.480 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c2ffd700 1 --2- 172.21.15.157:0/1532824802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40ff020 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f84b400b5f0 tx=0x7f84b4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93dd557880b9c18c server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:06.481 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c1ffb700 1 -- 172.21.15.157:0/1532824802 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84b40106d0 con 0x7f84c4070530 2021-10-08T19:20:06.481 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c1ffb700 1 -- 172.21.15.157:0/1532824802 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f84b4010c90 con 0x7f84c4070530 2021-10-08T19:20:06.481 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c1ffb700 1 -- 172.21.15.157:0/1532824802 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84b4011c00 con 0x7f84c4070530 2021-10-08T19:20:06.481 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c3fff700 1 -- 172.21.15.157:0/1532824802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 msgr2=0x7f84c40ff020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:06.481 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c3fff700 1 --2- 172.21.15.157:0/1532824802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40ff020 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f84b400b5f0 tx=0x7f84b4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:06.482 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c3fff700 1 -- 172.21.15.157:0/1532824802 shutdown_connections 2021-10-08T19:20:06.482 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c3fff700 1 --2- 172.21.15.157:0/1532824802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40ff020 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:06.482 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c3fff700 1 -- 172.21.15.157:0/1532824802 >> 172.21.15.157:0/1532824802 conn(0x7f84c40f6ab0 msgr2=0x7f84c40f8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:06.482 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c3fff700 1 -- 172.21.15.157:0/1532824802 shutdown_connections 2021-10-08T19:20:06.483 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.475+0000 7f84c3fff700 1 -- 172.21.15.157:0/1532824802 wait complete. 2021-10-08T19:20:06.483 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.476+0000 7f84c3fff700 1 Processor -- start 2021-10-08T19:20:06.483 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.476+0000 7f84c3fff700 1 -- start start 2021-10-08T19:20:06.483 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.476+0000 7f84c3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40fcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:06.483 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.476+0000 7f84c3fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40faf20 con 0x7f84c4070530 2021-10-08T19:20:06.484 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.476+0000 7f84c2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40fcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:06.484 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.476+0000 7f84c2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40fcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39292/0 (socket says 172.21.15.157:39292) 2021-10-08T19:20:06.484 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.476+0000 7f84c2ffd700 1 -- 172.21.15.157:0/444285856 learned_addr learned my addr 172.21.15.157:0/444285856 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:06.484 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.477+0000 7f84c2ffd700 1 -- 172.21.15.157:0/444285856 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b400b200 con 0x7f84c4070530 2021-10-08T19:20:06.485 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.477+0000 7f84c2ffd700 1 --2- 172.21.15.157:0/444285856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40fcaa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c010 tx=0x7f84b4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:06.485 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.477+0000 7f84ab7fe700 1 -- 172.21.15.157:0/444285856 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84b4011440 con 0x7f84c4070530 2021-10-08T19:20:06.485 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.477+0000 7f84c3fff700 1 -- 172.21.15.157:0/444285856 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c40fb120 con 0x7f84c4070530 2021-10-08T19:20:06.485 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.477+0000 7f84ab7fe700 1 -- 172.21.15.157:0/444285856 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f84b401ba80 con 0x7f84c4070530 2021-10-08T19:20:06.485 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.477+0000 7f84ab7fe700 1 -- 172.21.15.157:0/444285856 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84b4023830 con 0x7f84c4070530 2021-10-08T19:20:06.486 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.477+0000 7f84c3fff700 1 -- 172.21.15.157:0/444285856 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c40fb5b0 con 0x7f84c4070530 2021-10-08T19:20:06.486 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.477+0000 7f84ab7fe700 1 -- 172.21.15.157:0/444285856 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f84b400f070 con 0x7f84c4070530 2021-10-08T19:20:06.486 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.477+0000 7f84ab7fe700 1 -- 172.21.15.157:0/444285856 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f84b402d7e0 con 0x7f84c4070530 2021-10-08T19:20:06.486 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.478+0000 7f84c3fff700 1 -- 172.21.15.157:0/444285856 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c405a9f0 con 0x7f84c4070530 2021-10-08T19:20:06.487 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.480+0000 7f84ab7fe700 1 -- 172.21.15.157:0/444285856 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7f84b401bbf0 con 0x7f84c4070530 2021-10-08T19:20:06.548 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.547+0000 7f84c3fff700 1 -- 172.21.15.157:0/444285856 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f84c4100550 con 0x7f84c4070530 2021-10-08T19:20:06.548 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.548+0000 7f84ab7fe700 1 -- 172.21.15.157:0/444285856 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f84b4023b40 con 0x7f84c4070530 2021-10-08T19:20:06.550 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.548+0000 7f84c3fff700 1 -- 172.21.15.157:0/444285856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 msgr2=0x7f84c40fcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:06.550 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.548+0000 7f84c3fff700 1 --2- 172.21.15.157:0/444285856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40fcaa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c010 tx=0x7f84b4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:06.550 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.548+0000 7f84c3fff700 1 -- 172.21.15.157:0/444285856 shutdown_connections 2021-10-08T19:20:06.550 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.548+0000 7f84c3fff700 1 --2- 172.21.15.157:0/444285856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c4070530 0x7f84c40fcaa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:06.551 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.548+0000 7f84c3fff700 1 -- 172.21.15.157:0/444285856 >> 172.21.15.157:0/444285856 conn(0x7f84c40f6ab0 msgr2=0x7f84c40f77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:06.551 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.549+0000 7f84c3fff700 1 -- 172.21.15.157:0/444285856 shutdown_connections 2021-10-08T19:20:06.551 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:06.549+0000 7f84c3fff700 1 -- 172.21.15.157:0/444285856 wait complete. 2021-10-08T19:20:06.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:06 smithi157 ceph-mon[31986]: from='client.? 172.21.15.157:0/444285856' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:20:07.122 INFO:teuthology.orchestra.run.smithi157.stderr:Restarting the monitor... 2021-10-08T19:20:07.122 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl restart ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:20:07.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:07 smithi157 systemd[1]: Stopping Ceph mon.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:20:07.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:07 smithi157 bash[32460]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mon.a found: no such container 2021-10-08T19:20:07.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:07 smithi157 conmon[31963]: 2021-10-08T19:20:07.284+0000 7fcb4a6f0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:20:07.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:07 smithi157 conmon[31963]: 2021-10-08T19:20:07.284+0000 7fcb4a6f0700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-10-08T19:20:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:07 smithi157 bash[32460]: c1ae8bcc6b60d363cc4cd2ed60c99d36456afb36a5f39f00a1ddfa11be06df3c 2021-10-08T19:20:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 bash[32460]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mon.a found: no such container 2021-10-08T19:20:08.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 systemd[1]: Stopped Ceph mon.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:20:08.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 systemd[1]: Starting Ceph mon.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:20:08.558 INFO:teuthology.orchestra.run.smithi157.stderr:Setting mon public_network to 172.21.0.0/20 2021-10-08T19:20:08.559 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config set mon public_network 172.21.0.0/20 2021-10-08T19:20:08.814 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: set uid:gid to 167:167 (ceph:ceph) 2021-10-08T19:20:08.814 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev), process ceph-mon, pid 7 2021-10-08T19:20:08.814 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: pidfile_write: ignore empty --pid-file 2021-10-08T19:20:08.815 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: load: jerasure load: lrc 2021-10-08T19:20:08.815 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: RocksDB version: 6.15.5 2021-10-08T19:20:08.815 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-10-08T19:20:08.815 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Compile date Oct 7 2021 2021-10-08T19:20:08.815 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: DB SUMMARY 2021-10-08T19:20:08.816 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: DB Session ID: EW7JP1MGWNYSZXKUC3JM 2021-10-08T19:20:08.816 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: CURRENT file: CURRENT 2021-10-08T19:20:08.816 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: IDENTITY file: IDENTITY 2021-10-08T19:20:08.816 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2021-10-08T19:20:08.817 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2021-10-08T19:20:08.817 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 85401 ; 2021-10-08T19:20:08.817 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.error_if_exists: 0 2021-10-08T19:20:08.817 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.create_if_missing: 0 2021-10-08T19:20:08.817 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.paranoid_checks: 1 2021-10-08T19:20:08.818 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-10-08T19:20:08.818 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.env: 0x5617566c2b60 2021-10-08T19:20:08.818 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.fs: Posix File System 2021-10-08T19:20:08.819 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.info_log: 0x561757eac120 2021-10-08T19:20:08.819 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_file_opening_threads: 16 2021-10-08T19:20:08.819 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.statistics: (nil) 2021-10-08T19:20:08.819 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.use_fsync: 0 2021-10-08T19:20:08.819 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_log_file_size: 0 2021-10-08T19:20:08.820 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-10-08T19:20:08.820 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.log_file_time_to_roll: 0 2021-10-08T19:20:08.820 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.keep_log_file_num: 1000 2021-10-08T19:20:08.820 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.recycle_log_file_num: 0 2021-10-08T19:20:08.820 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.allow_fallocate: 1 2021-10-08T19:20:08.821 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.allow_mmap_reads: 0 2021-10-08T19:20:08.821 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.allow_mmap_writes: 0 2021-10-08T19:20:08.821 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.use_direct_reads: 0 2021-10-08T19:20:08.821 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-10-08T19:20:08.822 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.create_missing_column_families: 0 2021-10-08T19:20:08.822 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.db_log_dir: 2021-10-08T19:20:08.822 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-10-08T19:20:08.822 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.table_cache_numshardbits: 6 2021-10-08T19:20:08.822 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.WAL_ttl_seconds: 0 2021-10-08T19:20:08.823 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.WAL_size_limit_MB: 0 2021-10-08T19:20:08.823 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-10-08T19:20:08.823 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-10-08T19:20:08.823 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.is_fd_close_on_exec: 1 2021-10-08T19:20:08.824 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.advise_random_on_open: 1 2021-10-08T19:20:08.824 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.db_write_buffer_size: 0 2021-10-08T19:20:08.824 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.write_buffer_manager: 0x561757f21dd0 2021-10-08T19:20:08.824 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-10-08T19:20:08.824 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-10-08T19:20:08.825 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-10-08T19:20:08.825 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.use_adaptive_mutex: 0 2021-10-08T19:20:08.825 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.rate_limiter: (nil) 2021-10-08T19:20:08.825 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-10-08T19:20:08.826 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.wal_recovery_mode: 2 2021-10-08T19:20:08.826 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.enable_thread_tracking: 0 2021-10-08T19:20:08.826 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.enable_pipelined_write: 0 2021-10-08T19:20:08.826 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.unordered_write: 0 2021-10-08T19:20:08.826 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-10-08T19:20:08.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-10-08T19:20:08.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-10-08T19:20:08.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-10-08T19:20:08.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.row_cache: None 2021-10-08T19:20:08.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.wal_filter: None 2021-10-08T19:20:08.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-10-08T19:20:08.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.allow_ingest_behind: 0 2021-10-08T19:20:08.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.preserve_deletes: 0 2021-10-08T19:20:08.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.two_write_queues: 0 2021-10-08T19:20:08.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.manual_wal_flush: 0 2021-10-08T19:20:08.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.atomic_flush: 0 2021-10-08T19:20:08.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-10-08T19:20:08.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.persist_stats_to_disk: 0 2021-10-08T19:20:08.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.write_dbid_to_manifest: 0 2021-10-08T19:20:08.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.log_readahead_size: 0 2021-10-08T19:20:08.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-10-08T19:20:08.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.best_efforts_recovery: 0 2021-10-08T19:20:08.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-10-08T19:20:08.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-10-08T19:20:08.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.allow_data_in_errors: 0 2021-10-08T19:20:08.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.db_host_id: __hostname__ 2021-10-08T19:20:08.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_background_jobs: 2 2021-10-08T19:20:08.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_background_compactions: -1 2021-10-08T19:20:08.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_subcompactions: 1 2021-10-08T19:20:08.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-10-08T19:20:08.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-10-08T19:20:08.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.delayed_write_rate : 16777216 2021-10-08T19:20:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_total_wal_size: 0 2021-10-08T19:20:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-10-08T19:20:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.stats_dump_period_sec: 600 2021-10-08T19:20:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.stats_persist_period_sec: 600 2021-10-08T19:20:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-10-08T19:20:08.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_open_files: -1 2021-10-08T19:20:08.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bytes_per_sync: 0 2021-10-08T19:20:08.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.wal_bytes_per_sync: 0 2021-10-08T19:20:08.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.strict_bytes_per_sync: 0 2021-10-08T19:20:08.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_readahead_size: 0 2021-10-08T19:20:08.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_background_flushes: -1 2021-10-08T19:20:08.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Compression algorithms supported: 2021-10-08T19:20:08.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-10-08T19:20:08.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: kZSTD supported: 0 2021-10-08T19:20:08.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: kXpressCompression supported: 0 2021-10-08T19:20:08.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: kLZ4HCCompression supported: 1 2021-10-08T19:20:08.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: kLZ4Compression supported: 1 2021-10-08T19:20:08.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: kBZip2Compression supported: 0 2021-10-08T19:20:08.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: kZlibCompression supported: 1 2021-10-08T19:20:08.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: kSnappyCompression supported: 1 2021-10-08T19:20:08.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Fast CRC32 supported: Supported on x86 2021-10-08T19:20:08.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2021-10-08T19:20:08.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-10-08T19:20:08.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-10-08T19:20:08.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.merge_operator: 2021-10-08T19:20:08.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_filter: None 2021-10-08T19:20:08.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_filter_factory: None 2021-10-08T19:20:08.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.sst_partitioner_factory: None 2021-10-08T19:20:08.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.memtable_factory: SkipListFactory 2021-10-08T19:20:08.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.table_factory: BlockBasedTable 2021-10-08T19:20:08.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561757e75b80) 2021-10-08T19:20:08.839 INFO:journalctl@ceph.mon.a.smithi157.stdout: cache_index_and_filter_blocks: 1 2021-10-08T19:20:08.840 INFO:journalctl@ceph.mon.a.smithi157.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-10-08T19:20:08.840 INFO:journalctl@ceph.mon.a.smithi157.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-10-08T19:20:08.840 INFO:journalctl@ceph.mon.a.smithi157.stdout: pin_top_level_index_and_filter: 1 2021-10-08T19:20:08.840 INFO:journalctl@ceph.mon.a.smithi157.stdout: index_type: 0 2021-10-08T19:20:08.840 INFO:journalctl@ceph.mon.a.smithi157.stdout: data_block_index_type: 0 2021-10-08T19:20:08.841 INFO:journalctl@ceph.mon.a.smithi157.stdout: index_shortening: 1 2021-10-08T19:20:08.841 INFO:journalctl@ceph.mon.a.smithi157.stdout: data_block_hash_table_util_ratio: 0.750000 2021-10-08T19:20:08.841 INFO:journalctl@ceph.mon.a.smithi157.stdout: hash_index_allow_collision: 1 2021-10-08T19:20:08.841 INFO:journalctl@ceph.mon.a.smithi157.stdout: checksum: 1 2021-10-08T19:20:08.841 INFO:journalctl@ceph.mon.a.smithi157.stdout: no_block_cache: 0 2021-10-08T19:20:08.842 INFO:journalctl@ceph.mon.a.smithi157.stdout: block_cache: 0x561757eaad10 2021-10-08T19:20:08.842 INFO:journalctl@ceph.mon.a.smithi157.stdout: block_cache_name: BinnedLRUCache 2021-10-08T19:20:08.842 INFO:journalctl@ceph.mon.a.smithi157.stdout: block_cache_options: 2021-10-08T19:20:08.842 INFO:journalctl@ceph.mon.a.smithi157.stdout: capacity : 536870912 2021-10-08T19:20:08.843 INFO:journalctl@ceph.mon.a.smithi157.stdout: num_shard_bits : 4 2021-10-08T19:20:08.843 INFO:journalctl@ceph.mon.a.smithi157.stdout: strict_capacity_limit : 0 2021-10-08T19:20:08.843 INFO:journalctl@ceph.mon.a.smithi157.stdout: high_pri_pool_ratio: 0.000 2021-10-08T19:20:08.843 INFO:journalctl@ceph.mon.a.smithi157.stdout: block_cache_compressed: (nil) 2021-10-08T19:20:08.843 INFO:journalctl@ceph.mon.a.smithi157.stdout: persistent_cache: (nil) 2021-10-08T19:20:08.844 INFO:journalctl@ceph.mon.a.smithi157.stdout: block_size: 4096 2021-10-08T19:20:08.844 INFO:journalctl@ceph.mon.a.smithi157.stdout: block_size_deviation: 10 2021-10-08T19:20:08.844 INFO:journalctl@ceph.mon.a.smithi157.stdout: block_restart_interval: 16 2021-10-08T19:20:08.844 INFO:journalctl@ceph.mon.a.smithi157.stdout: index_block_restart_interval: 1 2021-10-08T19:20:08.844 INFO:journalctl@ceph.mon.a.smithi157.stdout: metadata_block_size: 4096 2021-10-08T19:20:08.845 INFO:journalctl@ceph.mon.a.smithi157.stdout: partition_filters: 0 2021-10-08T19:20:08.845 INFO:journalctl@ceph.mon.a.smithi157.stdout: use_delta_encoding: 1 2021-10-08T19:20:08.845 INFO:journalctl@ceph.mon.a.smithi157.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-10-08T19:20:08.845 INFO:journalctl@ceph.mon.a.smithi157.stdout: whole_key_filtering: 1 2021-10-08T19:20:08.846 INFO:journalctl@ceph.mon.a.smithi157.stdout: verify_compression: 0 2021-10-08T19:20:08.846 INFO:journalctl@ceph.mon.a.smithi157.stdout: read_amp_bytes_per_bit: 0 2021-10-08T19:20:08.846 INFO:journalctl@ceph.mon.a.smithi157.stdout: format_version: 4 2021-10-08T19:20:08.846 INFO:journalctl@ceph.mon.a.smithi157.stdout: enable_index_compression: 1 2021-10-08T19:20:08.846 INFO:journalctl@ceph.mon.a.smithi157.stdout: block_align: 0 2021-10-08T19:20:08.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.write_buffer_size: 33554432 2021-10-08T19:20:08.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_write_buffer_number: 2 2021-10-08T19:20:08.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compression: NoCompression 2021-10-08T19:20:08.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bottommost_compression: Disabled 2021-10-08T19:20:08.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.prefix_extractor: nullptr 2021-10-08T19:20:08.848 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-10-08T19:20:08.848 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.num_levels: 7 2021-10-08T19:20:08.848 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-10-08T19:20:08.848 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-10-08T19:20:08.848 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-10-08T19:20:08.849 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-10-08T19:20:08.849 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-10-08T19:20:08.849 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-10-08T19:20:08.850 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-10-08T19:20:08.850 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:20:08.850 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-10-08T19:20:08.850 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-10-08T19:20:08.850 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compression_opts.window_bits: -14 2021-10-08T19:20:08.851 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compression_opts.level: 32767 2021-10-08T19:20:08.851 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compression_opts.strategy: 0 2021-10-08T19:20:08.851 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-10-08T19:20:08.852 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:20:08.852 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-10-08T19:20:08.852 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compression_opts.enabled: false 2021-10-08T19:20:08.852 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-10-08T19:20:08.852 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-10-08T19:20:08.853 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-10-08T19:20:08.853 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.target_file_size_base: 67108864 2021-10-08T19:20:08.853 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.target_file_size_multiplier: 1 2021-10-08T19:20:08.853 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-10-08T19:20:08.853 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-10-08T19:20:08.854 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-10-08T19:20:08.854 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-10-08T19:20:08.854 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-10-08T19:20:08.854 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-10-08T19:20:08.855 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-10-08T19:20:08.855 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-10-08T19:20:08.855 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-10-08T19:20:08.855 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-10-08T19:20:08.855 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-10-08T19:20:08.856 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-10-08T19:20:08.856 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.arena_block_size: 4194304 2021-10-08T19:20:08.856 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-10-08T19:20:08.856 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-10-08T19:20:08.856 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-10-08T19:20:08.857 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.disable_auto_compactions: 0 2021-10-08T19:20:08.857 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-10-08T19:20:08.857 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-10-08T19:20:08.857 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-10-08T19:20:08.857 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-10-08T19:20:08.858 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-10-08T19:20:08.858 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-10-08T19:20:08.858 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-10-08T19:20:08.858 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-10-08T19:20:08.859 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-10-08T19:20:08.859 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-10-08T19:20:08.859 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.table_properties_collectors: 2021-10-08T19:20:08.859 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.inplace_update_support: 0 2021-10-08T19:20:08.859 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.inplace_update_num_locks: 10000 2021-10-08T19:20:08.860 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-10-08T19:20:08.860 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-10-08T19:20:08.860 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.memtable_huge_page_size: 0 2021-10-08T19:20:08.860 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.bloom_locality: 0 2021-10-08T19:20:08.861 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.max_successive_merges: 0 2021-10-08T19:20:08.861 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.optimize_filters_for_hits: 0 2021-10-08T19:20:08.861 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.paranoid_file_checks: 0 2021-10-08T19:20:08.861 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.force_consistency_checks: 1 2021-10-08T19:20:08.861 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.report_bg_io_stats: 0 2021-10-08T19:20:08.862 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.ttl: 2592000 2021-10-08T19:20:08.862 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.periodic_compaction_seconds: 0 2021-10-08T19:20:08.862 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.enable_blob_files: false 2021-10-08T19:20:08.862 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.min_blob_size: 0 2021-10-08T19:20:08.862 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.blob_file_size: 268435456 2021-10-08T19:20:08.863 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.blob_compression_type: NoCompression 2021-10-08T19:20:08.863 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.enable_blob_garbage_collection: false 2021-10-08T19:20:08.863 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-10-08T19:20:08.863 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-10-08T19:20:08.864 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 5 2021-10-08T19:20:08.864 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2021-10-08T19:20:08.864 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720808544830, "job": 1, "event": "recovery_started", "wal_files": [10]} 2021-10-08T19:20:08.864 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #10 mode 2 2021-10-08T19:20:08.864 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-10-08T19:20:08.865 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720808545542, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 81671, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 79934, "index_size": 225, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10637, "raw_average_key_size": 47, "raw_value_size": 73967, "raw_average_value_size": 333, "num_data_blocks": 10, "num_entries": 222, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720808, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "2b0aba78-c7ce-444e-a1bd-c64057fa9848", "db_session_id": "EW7JP1MGWNYSZXKUC3JM"}} 2021-10-08T19:20:08.865 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2021-10-08T19:20:08.865 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720808545881, "job": 1, "event": "recovery_finished"} 2021-10-08T19:20:08.865 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-10-08T19:20:08.865 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x561757ec6a80 2021-10-08T19:20:08.866 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: DB pointer 0x561757ed6000 2021-10-08T19:20:08.866 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-10-08T19:20:08.866 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-10-08T19:20:08.866 INFO:journalctl@ceph.mon.a.smithi157.stdout: ** DB Stats ** 2021-10-08T19:20:08.867 INFO:journalctl@ceph.mon.a.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:20:08.867 INFO:journalctl@ceph.mon.a.smithi157.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-10-08T19:20:08.867 INFO:journalctl@ceph.mon.a.smithi157.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-10-08T19:20:08.867 INFO:journalctl@ceph.mon.a.smithi157.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:20:08.867 INFO:journalctl@ceph.mon.a.smithi157.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-10-08T19:20:08.868 INFO:journalctl@ceph.mon.a.smithi157.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-10-08T19:20:08.868 INFO:journalctl@ceph.mon.a.smithi157.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:20:08.868 INFO:journalctl@ceph.mon.a.smithi157.stdout: 2021-10-08T19:20:08.868 INFO:journalctl@ceph.mon.a.smithi157.stdout: ** Compaction Stats [default] ** 2021-10-08T19:20:08.868 INFO:journalctl@ceph.mon.a.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:20:08.869 INFO:journalctl@ceph.mon.a.smithi157.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:20:08.869 INFO:journalctl@ceph.mon.a.smithi157.stdout: L0 2/0 81.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:20:08.869 INFO:journalctl@ceph.mon.a.smithi157.stdout: Sum 2/0 81.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:20:08.869 INFO:journalctl@ceph.mon.a.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:20:08.870 INFO:journalctl@ceph.mon.a.smithi157.stdout: 2021-10-08T19:20:08.870 INFO:journalctl@ceph.mon.a.smithi157.stdout: ** Compaction Stats [default] ** 2021-10-08T19:20:08.870 INFO:journalctl@ceph.mon.a.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:20:08.870 INFO:journalctl@ceph.mon.a.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:20:08.870 INFO:journalctl@ceph.mon.a.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 162.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:20:08.871 INFO:journalctl@ceph.mon.a.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:20:08.871 INFO:journalctl@ceph.mon.a.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:20:08.871 INFO:journalctl@ceph.mon.a.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:20:08.871 INFO:journalctl@ceph.mon.a.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:20:08.871 INFO:journalctl@ceph.mon.a.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:20:08.872 INFO:journalctl@ceph.mon.a.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:20:08.872 INFO:journalctl@ceph.mon.a.smithi157.stdout: Cumulative compaction: 0.00 GB write, 27.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:20:08.872 INFO:journalctl@ceph.mon.a.smithi157.stdout: Interval compaction: 0.00 GB write, 27.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:20:08.872 INFO:journalctl@ceph.mon.a.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:20:08.873 INFO:journalctl@ceph.mon.a.smithi157.stdout: 2021-10-08T19:20:08.873 INFO:journalctl@ceph.mon.a.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:20:08.873 INFO:journalctl@ceph.mon.a.smithi157.stdout: 2021-10-08T19:20:08.873 INFO:journalctl@ceph.mon.a.smithi157.stdout: ** Compaction Stats [default] ** 2021-10-08T19:20:08.873 INFO:journalctl@ceph.mon.a.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:20:08.874 INFO:journalctl@ceph.mon.a.smithi157.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:20:08.874 INFO:journalctl@ceph.mon.a.smithi157.stdout: L0 2/0 81.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:20:08.874 INFO:journalctl@ceph.mon.a.smithi157.stdout: Sum 2/0 81.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:20:08.874 INFO:journalctl@ceph.mon.a.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-10-08T19:20:08.875 INFO:journalctl@ceph.mon.a.smithi157.stdout: 2021-10-08T19:20:08.875 INFO:journalctl@ceph.mon.a.smithi157.stdout: ** Compaction Stats [default] ** 2021-10-08T19:20:08.875 INFO:journalctl@ceph.mon.a.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:20:08.875 INFO:journalctl@ceph.mon.a.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:20:08.875 INFO:journalctl@ceph.mon.a.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 162.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:20:08.876 INFO:journalctl@ceph.mon.a.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:20:08.876 INFO:journalctl@ceph.mon.a.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:20:08.876 INFO:journalctl@ceph.mon.a.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:20:08.876 INFO:journalctl@ceph.mon.a.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:20:08.876 INFO:journalctl@ceph.mon.a.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:20:08.877 INFO:journalctl@ceph.mon.a.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:20:08.877 INFO:journalctl@ceph.mon.a.smithi157.stdout: Cumulative compaction: 0.00 GB write, 27.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:20:08.877 INFO:journalctl@ceph.mon.a.smithi157.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:20:08.877 INFO:journalctl@ceph.mon.a.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:20:08.878 INFO:journalctl@ceph.mon.a.smithi157.stdout: 2021-10-08T19:20:08.878 INFO:journalctl@ceph.mon.a.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:20:08.878 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: starting mon.a rank 0 at public addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] at bind addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:08.879 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mon.a@-1(???) e1 preinit fsid 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:08.879 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mon.a@-1(???).mds e1 new map 2021-10-08T19:20:08.879 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mon.a@-1(???).mds e1 print_map 2021-10-08T19:20:08.879 INFO:journalctl@ceph.mon.a.smithi157.stdout: e1 2021-10-08T19:20:08.880 INFO:journalctl@ceph.mon.a.smithi157.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-10-08T19:20:08.880 INFO:journalctl@ceph.mon.a.smithi157.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-10-08T19:20:08.880 INFO:journalctl@ceph.mon.a.smithi157.stdout: legacy client fscid: -1 2021-10-08T19:20:08.880 INFO:journalctl@ceph.mon.a.smithi157.stdout: 2021-10-08T19:20:08.880 INFO:journalctl@ceph.mon.a.smithi157.stdout: No filesystems configured 2021-10-08T19:20:08.881 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-10-08T19:20:08.881 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:20:08.881 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:20:08.881 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:20:08.882 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-10-08T19:20:08.882 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta expand map: {default=false} 2021-10-08T19:20:08.882 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta from 'false' to 'false' 2021-10-08T19:20:08.882 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta expanded map: {default=false} 2021-10-08T19:20:08.882 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta expand map: {default=info} 2021-10-08T19:20:08.883 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta from 'info' to 'info' 2021-10-08T19:20:08.883 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta expanded map: {default=info} 2021-10-08T19:20:08.883 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta expand map: {default=daemon} 2021-10-08T19:20:08.883 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta from 'daemon' to 'daemon' 2021-10-08T19:20:08.883 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta expanded map: {default=daemon} 2021-10-08T19:20:08.884 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta expand map: {default=debug} 2021-10-08T19:20:08.884 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta from 'debug' to 'debug' 2021-10-08T19:20:08.884 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: expand_channel_meta expanded map: {default=debug} 2021-10-08T19:20:08.884 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 bash[32632]: ce1f928ac9f4694c781dfaf1c902a8311d36dcbc8e1883ce7a7f76d0971d9fa6 2021-10-08T19:20:08.885 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 systemd[1]: Started Ceph mon.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:20:08.885 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mon.a is new leader, mons a in quorum (ranks 0) 2021-10-08T19:20:08.885 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: monmap e1: 1 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} 2021-10-08T19:20:08.885 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: fsmap 2021-10-08T19:20:08.885 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: osdmap e1: 0 total, 0 up, 0 in 2021-10-08T19:20:08.886 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:08 smithi157 ceph-mon[32847]: mgrmap e1: no daemons active 2021-10-08T19:20:09.206 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.204+0000 7f1ed2855700 1 Processor -- start 2021-10-08T19:20:09.211 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.205+0000 7f1ed2855700 1 -- start start 2021-10-08T19:20:09.211 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.205+0000 7f1ed2855700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc0ff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:09.212 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.205+0000 7f1ed2855700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0ff5f0 con 0x7f1ecc070530 2021-10-08T19:20:09.212 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.205+0000 7f1ed1853700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc0ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:09.212 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.205+0000 7f1ed1853700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc0ff020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39294/0 (socket says 172.21.15.157:39294) 2021-10-08T19:20:09.212 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.205+0000 7f1ed1853700 1 -- 172.21.15.157:0/3235919206 learned_addr learned my addr 172.21.15.157:0/3235919206 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:09.212 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed1853700 1 -- 172.21.15.157:0/3235919206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc0ff730 con 0x7f1ecc070530 2021-10-08T19:20:09.213 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed1853700 1 --2- 172.21.15.157:0/3235919206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc0ff020 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800b5f0 tx=0x7f1ec8006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c774062c86b5eb71 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:09.213 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed0851700 1 -- 172.21.15.157:0/3235919206 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ec80106d0 con 0x7f1ecc070530 2021-10-08T19:20:09.213 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed0851700 1 -- 172.21.15.157:0/3235919206 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f1ec8010c90 con 0x7f1ecc070530 2021-10-08T19:20:09.213 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed0851700 1 -- 172.21.15.157:0/3235919206 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ec8011c00 con 0x7f1ecc070530 2021-10-08T19:20:09.214 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed2855700 1 -- 172.21.15.157:0/3235919206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 msgr2=0x7f1ecc0ff020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:09.214 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed2855700 1 --2- 172.21.15.157:0/3235919206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc0ff020 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800b5f0 tx=0x7f1ec8006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:09.214 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed2855700 1 -- 172.21.15.157:0/3235919206 shutdown_connections 2021-10-08T19:20:09.214 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed2855700 1 --2- 172.21.15.157:0/3235919206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc0ff020 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:09.215 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.206+0000 7f1ed2855700 1 -- 172.21.15.157:0/3235919206 >> 172.21.15.157:0/3235919206 conn(0x7f1ecc0f6ab0 msgr2=0x7f1ecc0f8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:09.215 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.207+0000 7f1ed2855700 1 -- 172.21.15.157:0/3235919206 shutdown_connections 2021-10-08T19:20:09.215 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.207+0000 7f1ed2855700 1 -- 172.21.15.157:0/3235919206 wait complete. 2021-10-08T19:20:09.215 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.207+0000 7f1ed2855700 1 Processor -- start 2021-10-08T19:20:09.215 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.207+0000 7f1ed2855700 1 -- start start 2021-10-08T19:20:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.207+0000 7f1ed2855700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc10af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1ed2855700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc10b4a0 con 0x7f1ecc070530 2021-10-08T19:20:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1ed1853700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc10af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1ed1853700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc10af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39296/0 (socket says 172.21.15.157:39296) 2021-10-08T19:20:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1ed1853700 1 -- 172.21.15.157:0/2056191638 learned_addr learned my addr 172.21.15.157:0/2056191638 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:09.217 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1ed1853700 1 -- 172.21.15.157:0/2056191638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec800b200 con 0x7f1ecc070530 2021-10-08T19:20:09.217 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1ed1853700 1 --2- 172.21.15.157:0/2056191638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc10af60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800b5c0 tx=0x7f1ec8006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:09.217 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1eba7fc700 1 -- 172.21.15.157:0/2056191638 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ec801b620 con 0x7f1ecc070530 2021-10-08T19:20:09.217 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1eba7fc700 1 -- 172.21.15.157:0/2056191638 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f1ec801bbe0 con 0x7f1ecc070530 2021-10-08T19:20:09.218 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1ed2855700 1 -- 172.21.15.157:0/2056191638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc10b6a0 con 0x7f1ecc070530 2021-10-08T19:20:09.218 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1ed2855700 1 -- 172.21.15.157:0/2056191638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc10c340 con 0x7f1ecc070530 2021-10-08T19:20:09.218 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1eba7fc700 1 -- 172.21.15.157:0/2056191638 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ec8023880 con 0x7f1ecc070530 2021-10-08T19:20:09.218 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.208+0000 7f1eba7fc700 1 -- 172.21.15.157:0/2056191638 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f1ec800f070 con 0x7f1ecc070530 2021-10-08T19:20:09.218 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.209+0000 7f1eba7fc700 1 -- 172.21.15.157:0/2056191638 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1ec802d790 con 0x7f1ecc070530 2021-10-08T19:20:09.219 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.210+0000 7f1ed2855700 1 -- 172.21.15.157:0/2056191638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac004de0 con 0x7f1ecc070530 2021-10-08T19:20:09.219 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.212+0000 7f1eba7fc700 1 -- 172.21.15.157:0/2056191638 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7f1ec801b780 con 0x7f1ecc070530 2021-10-08T19:20:09.279 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.278+0000 7f1ed2855700 1 -- 172.21.15.157:0/2056191638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f1eac005360 con 0x7f1ecc070530 2021-10-08T19:20:09.281 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.280+0000 7f1eba7fc700 1 -- 172.21.15.157:0/2056191638 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1ec801b920 con 0x7f1ecc070530 2021-10-08T19:20:09.282 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.281+0000 7f1ed2855700 1 -- 172.21.15.157:0/2056191638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 msgr2=0x7f1ecc10af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:09.282 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.281+0000 7f1ed2855700 1 --2- 172.21.15.157:0/2056191638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc10af60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800b5c0 tx=0x7f1ec8006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:09.283 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.281+0000 7f1ed2855700 1 -- 172.21.15.157:0/2056191638 shutdown_connections 2021-10-08T19:20:09.283 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.281+0000 7f1ed2855700 1 --2- 172.21.15.157:0/2056191638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc070530 0x7f1ecc10af60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:09.283 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.281+0000 7f1ed2855700 1 -- 172.21.15.157:0/2056191638 >> 172.21.15.157:0/2056191638 conn(0x7f1ecc0f6ab0 msgr2=0x7f1ecc0f77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:09.283 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.281+0000 7f1ed2855700 1 -- 172.21.15.157:0/2056191638 shutdown_connections 2021-10-08T19:20:09.283 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:09.281+0000 7f1ed2855700 1 -- 172.21.15.157:0/2056191638 wait complete. 2021-10-08T19:20:09.863 INFO:teuthology.orchestra.run.smithi157.stderr:Wrote config to /etc/ceph/ceph.conf 2021-10-08T19:20:09.863 INFO:teuthology.orchestra.run.smithi157.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:20:09.864 INFO:teuthology.orchestra.run.smithi157.stderr:Creating mgr... 2021-10-08T19:20:09.864 INFO:teuthology.orchestra.run.smithi157.stderr:Verifying port 9283 ... 2021-10-08T19:20:09.865 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl daemon-reload 2021-10-08T19:20:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:20:09.968 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl reset-failed ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:20:09.974 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Failed to reset failed state of unit ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y.service: Unit ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y.service not loaded. 2021-10-08T19:20:09.974 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl enable ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:20:09.980 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: Created symlink /etc/systemd/system/ceph-906d7a14-286c-11ec-8c25-001a4aab830c.target.wants/ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y.service → /etc/systemd/system/ceph-906d7a14-286c-11ec-8c25-001a4aab830c@.service. 2021-10-08T19:20:10.055 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl start ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:20:10.280 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:10 smithi157 systemd[1]: Starting Ceph mgr.y for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:20:10.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2056191638' entity='client.admin' 2021-10-08T19:20:10.783 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:20:10.792 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: disabled 2021-10-08T19:20:10.792 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:20:10.799 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: inactive 2021-10-08T19:20:10.800 INFO:teuthology.orchestra.run.smithi157.stderr:firewalld.service is not enabled 2021-10-08T19:20:10.800 INFO:teuthology.orchestra.run.smithi157.stderr:Not possible to enable service . firewalld.service is not available 2021-10-08T19:20:10.800 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:20:10.808 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: disabled 2021-10-08T19:20:10.808 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:20:10.814 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: inactive 2021-10-08T19:20:10.815 INFO:teuthology.orchestra.run.smithi157.stderr:firewalld.service is not enabled 2021-10-08T19:20:10.816 INFO:teuthology.orchestra.run.smithi157.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-10-08T19:20:10.816 INFO:teuthology.orchestra.run.smithi157.stderr:Waiting for mgr to start... 2021-10-08T19:20:10.816 INFO:teuthology.orchestra.run.smithi157.stderr:Waiting for mgr... 2021-10-08T19:20:10.816 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status -f json-pretty 2021-10-08T19:20:11.044 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:10 smithi157 bash[33082]: df2c79e71429f3f3e3dc19339e598fa797852ace372ddeb6ed556264969f1cad 2021-10-08T19:20:11.045 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:10 smithi157 systemd[1]: Started Ceph mgr.y for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:20:11.405 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.403+0000 7f12b7939700 1 Processor -- start 2021-10-08T19:20:11.406 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.404+0000 7f12b7939700 1 -- start start 2021-10-08T19:20:11.406 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.404+0000 7f12b7939700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b00fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:11.406 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.404+0000 7f12b7939700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00fbc90 con 0x7f12b00fb2b0 2021-10-08T19:20:11.406 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.404+0000 7f12b56d5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b00fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:11.407 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.404+0000 7f12b56d5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b00fb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39302/0 (socket says 172.21.15.157:39302) 2021-10-08T19:20:11.407 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.404+0000 7f12b56d5700 1 -- 172.21.15.157:0/1312555283 learned_addr learned my addr 172.21.15.157:0/1312555283 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:11.407 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.404+0000 7f12b56d5700 1 -- 172.21.15.157:0/1312555283 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00fbdd0 con 0x7f12b00fb2b0 2021-10-08T19:20:11.410 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f12b56d5700 1 --2- 172.21.15.157:0/1312555283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b00fb6c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f12a000b870 tx=0x7f12a0006f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1813e9e92677883 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:11.411 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f129ffff700 1 -- 172.21.15.157:0/1312555283 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a000d8c0 con 0x7f12b00fb2b0 2021-10-08T19:20:11.411 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f129ffff700 1 -- 172.21.15.157:0/1312555283 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f12a000de80 con 0x7f12b00fb2b0 2021-10-08T19:20:11.411 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f129ffff700 1 -- 172.21.15.157:0/1312555283 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a0010e80 con 0x7f12b00fb2b0 2021-10-08T19:20:11.411 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f12b7939700 1 -- 172.21.15.157:0/1312555283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 msgr2=0x7f12b00fb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:11.412 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f12b7939700 1 --2- 172.21.15.157:0/1312555283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b00fb6c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f12a000b870 tx=0x7f12a0006f70 comp rx=0 tx=0).stop 2021-10-08T19:20:11.412 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f12b7939700 1 -- 172.21.15.157:0/1312555283 shutdown_connections 2021-10-08T19:20:11.412 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f12b7939700 1 --2- 172.21.15.157:0/1312555283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b00fb6c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:11.412 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f12b7939700 1 -- 172.21.15.157:0/1312555283 >> 172.21.15.157:0/1312555283 conn(0x7f12b00f6a20 msgr2=0x7f12b00f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:11.412 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f12b7939700 1 -- 172.21.15.157:0/1312555283 shutdown_connections 2021-10-08T19:20:11.413 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.405+0000 7f12b7939700 1 -- 172.21.15.157:0/1312555283 wait complete. 2021-10-08T19:20:11.413 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.406+0000 7f12b7939700 1 Processor -- start 2021-10-08T19:20:11.413 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.406+0000 7f12b7939700 1 -- start start 2021-10-08T19:20:11.413 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.406+0000 7f12b7939700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b0108d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:11.414 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.406+0000 7f12b7939700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01092d0 con 0x7f12b00fb2b0 2021-10-08T19:20:11.414 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.406+0000 7f12b56d5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b0108d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:11.414 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.406+0000 7f12b56d5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b0108d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39304/0 (socket says 172.21.15.157:39304) 2021-10-08T19:20:11.414 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.406+0000 7f12b56d5700 1 -- 172.21.15.157:0/1523768762 learned_addr learned my addr 172.21.15.157:0/1523768762 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:11.415 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.406+0000 7f12b56d5700 1 -- 172.21.15.157:0/1523768762 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a000b480 con 0x7f12b00fb2b0 2021-10-08T19:20:11.415 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.407+0000 7f12b56d5700 1 --2- 172.21.15.157:0/1523768762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b0108d90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f12a000e010 tx=0x7f12a001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:11.415 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.407+0000 7f129dffb700 1 -- 172.21.15.157:0/1523768762 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a001f040 con 0x7f12b00fb2b0 2021-10-08T19:20:11.415 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.407+0000 7f129dffb700 1 -- 172.21.15.157:0/1523768762 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f12a0010470 con 0x7f12b00fb2b0 2021-10-08T19:20:11.415 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.407+0000 7f129dffb700 1 -- 172.21.15.157:0/1523768762 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a0024a60 con 0x7f12b00fb2b0 2021-10-08T19:20:11.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.407+0000 7f12b7939700 1 -- 172.21.15.157:0/1523768762 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b01094d0 con 0x7f12b00fb2b0 2021-10-08T19:20:11.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.407+0000 7f12b7939700 1 -- 172.21.15.157:0/1523768762 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b010a0c0 con 0x7f12b00fb2b0 2021-10-08T19:20:11.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.407+0000 7f129dffb700 1 -- 172.21.15.157:0/1523768762 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f12a002b030 con 0x7f12b00fb2b0 2021-10-08T19:20:11.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.407+0000 7f129dffb700 1 -- 172.21.15.157:0/1523768762 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f12a0014070 con 0x7f12b00fb2b0 2021-10-08T19:20:11.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.408+0000 7f12b7939700 1 -- 172.21.15.157:0/1523768762 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b005a9f0 con 0x7f12b00fb2b0 2021-10-08T19:20:11.417 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.410+0000 7f129dffb700 1 -- 172.21.15.157:0/1523768762 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7f12a0029070 con 0x7f12b00fb2b0 2021-10-08T19:20:11.487 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.479+0000 7f12b7939700 1 -- 172.21.15.157:0/1523768762 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f12b00fd2c0 con 0x7f12b00fb2b0 2021-10-08T19:20:11.488 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.480+0000 7f129dffb700 1 -- 172.21.15.157:0/1523768762 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1250 (secure 0 0 0) 0x7f12a0010650 con 0x7f12b00fb2b0 2021-10-08T19:20:11.488 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.488 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: { 2021-10-08T19:20:11.488 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "fsid": "906d7a14-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:20:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "health": { 2021-10-08T19:20:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-10-08T19:20:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "checks": {}, 2021-10-08T19:20:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "mutes": [] 2021-10-08T19:20:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:11.490 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-10-08T19:20:11.490 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "quorum": [ 2021-10-08T19:20:11.490 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 0 2021-10-08T19:20:11.490 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ], 2021-10-08T19:20:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "quorum_names": [ 2021-10-08T19:20:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "a" 2021-10-08T19:20:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ], 2021-10-08T19:20:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "quorum_age": -1365740991, 2021-10-08T19:20:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "monmap": { 2021-10-08T19:20:11.492 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:11.492 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-10-08T19:20:11.492 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_mons": 1 2021-10-08T19:20:11.492 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:11.493 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "osdmap": { 2021-10-08T19:20:11.493 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:11.493 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_osds": 0, 2021-10-08T19:20:11.493 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-10-08T19:20:11.493 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-10-08T19:20:11.494 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-10-08T19:20:11.494 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-10-08T19:20:11.494 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-10-08T19:20:11.494 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:11.494 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "pgmap": { 2021-10-08T19:20:11.495 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-10-08T19:20:11.495 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-10-08T19:20:11.495 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_pools": 0, 2021-10-08T19:20:11.495 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_objects": 0, 2021-10-08T19:20:11.496 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-10-08T19:20:11.496 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-10-08T19:20:11.496 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-10-08T19:20:11.496 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "bytes_total": 0 2021-10-08T19:20:11.496 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "fsmap": { 2021-10-08T19:20:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "by_rank": [], 2021-10-08T19:20:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "up:standby": 0 2021-10-08T19:20:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:11.498 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "mgrmap": { 2021-10-08T19:20:11.498 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "available": false, 2021-10-08T19:20:11.498 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-10-08T19:20:11.498 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "modules": [ 2021-10-08T19:20:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "iostat", 2021-10-08T19:20:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "nfs", 2021-10-08T19:20:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "restful" 2021-10-08T19:20:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ], 2021-10-08T19:20:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:20:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "servicemap": { 2021-10-08T19:20:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "modified": "2021-10-08T19:20:03.139383+0000", 2021-10-08T19:20:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:20:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "progress_events": {} 2021-10-08T19:20:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: } 2021-10-08T19:20:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.481+0000 7f12b7939700 1 -- 172.21.15.157:0/1523768762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 msgr2=0x7f12b0108d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.481+0000 7f12b7939700 1 --2- 172.21.15.157:0/1523768762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b0108d90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f12a000e010 tx=0x7f12a001c040 comp rx=0 tx=0).stop 2021-10-08T19:20:11.502 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.481+0000 7f12b7939700 1 -- 172.21.15.157:0/1523768762 shutdown_connections 2021-10-08T19:20:11.502 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.481+0000 7f12b7939700 1 --2- 172.21.15.157:0/1523768762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12b00fb2b0 0x7f12b0108d90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:11.502 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.481+0000 7f12b7939700 1 -- 172.21.15.157:0/1523768762 >> 172.21.15.157:0/1523768762 conn(0x7f12b00f6a20 msgr2=0x7f12b00f8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:11.502 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.481+0000 7f12b7939700 1 -- 172.21.15.157:0/1523768762 shutdown_connections 2021-10-08T19:20:11.503 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:11.481+0000 7f12b7939700 1 -- 172.21.15.157:0/1523768762 wait complete. 2021-10-08T19:20:11.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1523768762' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-10-08T19:20:12.129 INFO:teuthology.orchestra.run.smithi157.stderr:mgr not available, waiting (1/15)... 2021-10-08T19:20:14.131 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status -f json-pretty 2021-10-08T19:20:14.729 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.724+0000 7f8219d87700 1 Processor -- start 2021-10-08T19:20:14.730 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.724+0000 7f8219d87700 1 -- start start 2021-10-08T19:20:14.730 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.724+0000 7f8219d87700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f82140ff280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:14.730 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.724+0000 7f8219d87700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140ff7c0 con 0x7f8214070490 2021-10-08T19:20:14.731 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.724+0000 7f82137fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f82140ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:14.731 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.724+0000 7f82137fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f82140ff280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39306/0 (socket says 172.21.15.157:39306) 2021-10-08T19:20:14.731 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.724+0000 7f82137fe700 1 -- 172.21.15.157:0/3160971668 learned_addr learned my addr 172.21.15.157:0/3160971668 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:14.731 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.725+0000 7f82137fe700 1 -- 172.21.15.157:0/3160971668 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140ff900 con 0x7f8214070490 2021-10-08T19:20:14.731 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.725+0000 7f82137fe700 1 --2- 172.21.15.157:0/3160971668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f82140ff280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f820800b5f0 tx=0x7f8208006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20eeeb11c795c97 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:14.732 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.725+0000 7f82127fc700 1 -- 172.21.15.157:0/3160971668 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82080106d0 con 0x7f8214070490 2021-10-08T19:20:14.732 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.725+0000 7f82127fc700 1 -- 172.21.15.157:0/3160971668 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f8208010c90 con 0x7f8214070490 2021-10-08T19:20:14.732 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.725+0000 7f82127fc700 1 -- 172.21.15.157:0/3160971668 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8208011c00 con 0x7f8214070490 2021-10-08T19:20:14.732 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 -- 172.21.15.157:0/3160971668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 msgr2=0x7f82140ff280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:14.733 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 --2- 172.21.15.157:0/3160971668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f82140ff280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f820800b5f0 tx=0x7f8208006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:14.733 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 -- 172.21.15.157:0/3160971668 shutdown_connections 2021-10-08T19:20:14.733 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 --2- 172.21.15.157:0/3160971668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f82140ff280 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:14.733 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 -- 172.21.15.157:0/3160971668 >> 172.21.15.157:0/3160971668 conn(0x7f82140f6c30 msgr2=0x7f82140f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:14.733 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 -- 172.21.15.157:0/3160971668 shutdown_connections 2021-10-08T19:20:14.734 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 -- 172.21.15.157:0/3160971668 wait complete. 2021-10-08T19:20:14.734 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 Processor -- start 2021-10-08T19:20:14.734 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 -- start start 2021-10-08T19:20:14.734 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f821410d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:14.734 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.726+0000 7f8219d87700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821410d830 con 0x7f8214070490 2021-10-08T19:20:14.735 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f82137fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f821410d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:14.735 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f82137fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f821410d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39308/0 (socket says 172.21.15.157:39308) 2021-10-08T19:20:14.735 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f82137fe700 1 -- 172.21.15.157:0/819685136 learned_addr learned my addr 172.21.15.157:0/819685136 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:14.735 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f82137fe700 1 -- 172.21.15.157:0/819685136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820800b200 con 0x7f8214070490 2021-10-08T19:20:14.736 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f82137fe700 1 --2- 172.21.15.157:0/819685136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f821410d2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f820800b5c0 tx=0x7f8208006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:14.736 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f81fbfff700 1 -- 172.21.15.157:0/819685136 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8208011440 con 0x7f8214070490 2021-10-08T19:20:14.736 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f81fbfff700 1 -- 172.21.15.157:0/819685136 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f820801ba80 con 0x7f8214070490 2021-10-08T19:20:14.736 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f8219d87700 1 -- 172.21.15.157:0/819685136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821410da30 con 0x7f8214070490 2021-10-08T19:20:14.736 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f81fbfff700 1 -- 172.21.15.157:0/819685136 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8208023870 con 0x7f8214070490 2021-10-08T19:20:14.737 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f8219d87700 1 -- 172.21.15.157:0/819685136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821410e6d0 con 0x7f8214070490 2021-10-08T19:20:14.737 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f81fbfff700 1 -- 172.21.15.157:0/819685136 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f820800f070 con 0x7f8214070490 2021-10-08T19:20:14.737 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.727+0000 7f81fbfff700 1 -- 172.21.15.157:0/819685136 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f820802d750 con 0x7f8214070490 2021-10-08T19:20:14.737 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.728+0000 7f8219d87700 1 -- 172.21.15.157:0/819685136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821410dec0 con 0x7f8214070490 2021-10-08T19:20:14.738 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.731+0000 7f81fbfff700 1 -- 172.21.15.157:0/819685136 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7f820801b620 con 0x7f8214070490 2021-10-08T19:20:14.808 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.800+0000 7f8219d87700 1 -- 172.21.15.157:0/819685136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8214047390 con 0x7f8214070490 2021-10-08T19:20:14.809 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.801+0000 7f81fbfff700 1 -- 172.21.15.157:0/819685136 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f8214047390 con 0x7f8214070490 2021-10-08T19:20:14.809 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.809 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: { 2021-10-08T19:20:14.809 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "fsid": "906d7a14-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:20:14.810 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "health": { 2021-10-08T19:20:14.810 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-10-08T19:20:14.810 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "checks": {}, 2021-10-08T19:20:14.810 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "mutes": [] 2021-10-08T19:20:14.811 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:14.811 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-10-08T19:20:14.811 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "quorum": [ 2021-10-08T19:20:14.811 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 0 2021-10-08T19:20:14.811 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ], 2021-10-08T19:20:14.812 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "quorum_names": [ 2021-10-08T19:20:14.812 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "a" 2021-10-08T19:20:14.812 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ], 2021-10-08T19:20:14.812 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "quorum_age": 1955199687, 2021-10-08T19:20:14.813 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "monmap": { 2021-10-08T19:20:14.813 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:14.813 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-10-08T19:20:14.813 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_mons": 1 2021-10-08T19:20:14.813 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:14.814 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "osdmap": { 2021-10-08T19:20:14.814 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:14.814 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_osds": 0, 2021-10-08T19:20:14.814 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-10-08T19:20:14.815 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-10-08T19:20:14.815 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-10-08T19:20:14.815 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-10-08T19:20:14.815 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-10-08T19:20:14.815 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:14.816 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "pgmap": { 2021-10-08T19:20:14.816 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-10-08T19:20:14.816 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-10-08T19:20:14.816 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_pools": 0, 2021-10-08T19:20:14.817 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_objects": 0, 2021-10-08T19:20:14.817 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-10-08T19:20:14.817 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-10-08T19:20:14.817 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-10-08T19:20:14.817 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "bytes_total": 0 2021-10-08T19:20:14.818 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:14.818 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "fsmap": { 2021-10-08T19:20:14.818 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:14.818 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "by_rank": [], 2021-10-08T19:20:14.819 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "up:standby": 0 2021-10-08T19:20:14.819 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:14.819 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "mgrmap": { 2021-10-08T19:20:14.819 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "available": false, 2021-10-08T19:20:14.820 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-10-08T19:20:14.820 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "modules": [ 2021-10-08T19:20:14.820 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "iostat", 2021-10-08T19:20:14.820 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "nfs", 2021-10-08T19:20:14.821 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "restful" 2021-10-08T19:20:14.821 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ], 2021-10-08T19:20:14.821 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:20:14.821 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:14.822 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "servicemap": { 2021-10-08T19:20:14.822 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:14.822 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "modified": "2021-10-08T19:20:03.139383+0000", 2021-10-08T19:20:14.822 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:20:14.823 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:14.823 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "progress_events": {} 2021-10-08T19:20:14.823 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: } 2021-10-08T19:20:14.823 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.802+0000 7f8219d87700 1 -- 172.21.15.157:0/819685136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 msgr2=0x7f821410d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:14.823 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.802+0000 7f8219d87700 1 --2- 172.21.15.157:0/819685136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f821410d2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f820800b5c0 tx=0x7f8208006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:14.824 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.802+0000 7f8219d87700 1 -- 172.21.15.157:0/819685136 shutdown_connections 2021-10-08T19:20:14.824 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.802+0000 7f8219d87700 1 --2- 172.21.15.157:0/819685136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8214070490 0x7f821410d2f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:14.824 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.802+0000 7f8219d87700 1 -- 172.21.15.157:0/819685136 >> 172.21.15.157:0/819685136 conn(0x7f82140f6c30 msgr2=0x7f82140f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:14.824 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.802+0000 7f8219d87700 1 -- 172.21.15.157:0/819685136 shutdown_connections 2021-10-08T19:20:14.825 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:14.802+0000 7f8219d87700 1 -- 172.21.15.157:0/819685136 wait complete. 2021-10-08T19:20:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/819685136' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-10-08T19:20:15.261 INFO:teuthology.orchestra.run.smithi157.stderr:mgr not available, waiting (2/15)... 2021-10-08T19:20:16.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: Activating manager daemon y 2021-10-08T19:20:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: mgrmap e2: y(active, starting, since 0.0025947s) 2021-10-08T19:20:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: from='mgr.14100 172.21.15.157:0/3921422890' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:20:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: from='mgr.14100 172.21.15.157:0/3921422890' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:20:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: from='mgr.14100 172.21.15.157:0/3921422890' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:20:16.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: from='mgr.14100 172.21.15.157:0/3921422890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:20:16.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: from='mgr.14100 172.21.15.157:0/3921422890' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:20:16.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: Manager daemon y is now available 2021-10-08T19:20:16.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: from='mgr.14100 172.21.15.157:0/3921422890' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:20:16.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: from='mgr.14100 172.21.15.157:0/3921422890' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:20:16.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: from='mgr.14100 172.21.15.157:0/3921422890' entity='mgr.y' 2021-10-08T19:20:16.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:16 smithi157 ceph-mon[32847]: from='mgr.14100 172.21.15.157:0/3921422890' entity='mgr.y' 2021-10-08T19:20:17.264 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status -f json-pretty 2021-10-08T19:20:17.867 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.863+0000 7fa326258700 1 Processor -- start 2021-10-08T19:20:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.863+0000 7fa326258700 1 -- start start 2021-10-08T19:20:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.863+0000 7fa326258700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa3200fc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.863+0000 7fa326258700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200fcdf0 con 0x7fa3200fc410 2021-10-08T19:20:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.863+0000 7fa325256700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa3200fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.863+0000 7fa325256700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa3200fc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39334/0 (socket says 172.21.15.157:39334) 2021-10-08T19:20:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.863+0000 7fa325256700 1 -- 172.21.15.157:0/1008911447 learned_addr learned my addr 172.21.15.157:0/1008911447 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.863+0000 7fa325256700 1 -- 172.21.15.157:0/1008911447 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200fcf30 con 0x7fa3200fc410 2021-10-08T19:20:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.864+0000 7fa325256700 1 --2- 172.21.15.157:0/1008911447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa3200fc820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b5f0 tx=0x7fa31c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db36967e4cf1d5e server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.864+0000 7fa30ffff700 1 -- 172.21.15.157:0/1008911447 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa31c0106d0 con 0x7fa3200fc410 2021-10-08T19:20:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.864+0000 7fa30ffff700 1 -- 172.21.15.157:0/1008911447 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fa31c010c90 con 0x7fa3200fc410 2021-10-08T19:20:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.864+0000 7fa30ffff700 1 -- 172.21.15.157:0/1008911447 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa31c011c00 con 0x7fa3200fc410 2021-10-08T19:20:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.864+0000 7fa326258700 1 -- 172.21.15.157:0/1008911447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 msgr2=0x7fa3200fc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.864+0000 7fa326258700 1 --2- 172.21.15.157:0/1008911447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa3200fc820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b5f0 tx=0x7fa31c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa326258700 1 -- 172.21.15.157:0/1008911447 shutdown_connections 2021-10-08T19:20:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa326258700 1 --2- 172.21.15.157:0/1008911447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa3200fc820 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa326258700 1 -- 172.21.15.157:0/1008911447 >> 172.21.15.157:0/1008911447 conn(0x7fa3200f7b80 msgr2=0x7fa3200f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa326258700 1 -- 172.21.15.157:0/1008911447 shutdown_connections 2021-10-08T19:20:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa326258700 1 -- 172.21.15.157:0/1008911447 wait complete. 2021-10-08T19:20:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa326258700 1 Processor -- start 2021-10-08T19:20:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa326258700 1 -- start start 2021-10-08T19:20:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa326258700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa32010af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa326258700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32010b480 con 0x7fa3200fc410 2021-10-08T19:20:17.873 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.865+0000 7fa325256700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa32010af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:17.873 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.866+0000 7fa325256700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa32010af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39336/0 (socket says 172.21.15.157:39336) 2021-10-08T19:20:17.873 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.866+0000 7fa325256700 1 -- 172.21.15.157:0/3098948317 learned_addr learned my addr 172.21.15.157:0/3098948317 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:17.873 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.866+0000 7fa325256700 1 -- 172.21.15.157:0/3098948317 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c00b200 con 0x7fa3200fc410 2021-10-08T19:20:17.874 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.866+0000 7fa325256700 1 --2- 172.21.15.157:0/3098948317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa32010af40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b5c0 tx=0x7fa31c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:17.874 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.866+0000 7fa30dffb700 1 -- 172.21.15.157:0/3098948317 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa31c01b620 con 0x7fa3200fc410 2021-10-08T19:20:17.874 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.866+0000 7fa30dffb700 1 -- 172.21.15.157:0/3098948317 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fa31c01bbe0 con 0x7fa3200fc410 2021-10-08T19:20:17.874 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.866+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32010b680 con 0x7fa3200fc410 2021-10-08T19:20:17.874 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.866+0000 7fa30dffb700 1 -- 172.21.15.157:0/3098948317 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa31c023890 con 0x7fa3200fc410 2021-10-08T19:20:17.875 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.866+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32010c320 con 0x7fa3200fc410 2021-10-08T19:20:17.876 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.867+0000 7fa30dffb700 1 -- 172.21.15.157:0/3098948317 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 3) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fa31c00f070 con 0x7fa3200fc410 2021-10-08T19:20:17.876 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.867+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32010bb10 con 0x7fa3200fc410 2021-10-08T19:20:17.876 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.867+0000 7fa30dffb700 1 --2- 172.21.15.157:0/3098948317 >> v2:172.21.15.157:6800/3137430012 conn(0x7fa3080334f0 0x7fa3080359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:17.877 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.867+0000 7fa30dffb700 1 -- 172.21.15.157:0/3098948317 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa31c046630 con 0x7fa3200fc410 2021-10-08T19:20:17.877 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.867+0000 7fa324a55700 1 --2- 172.21.15.157:0/3098948317 >> v2:172.21.15.157:6800/3137430012 conn(0x7fa3080334f0 0x7fa3080359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:17.877 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.868+0000 7fa324a55700 1 --2- 172.21.15.157:0/3098948317 >> v2:172.21.15.157:6800/3137430012 conn(0x7fa3080334f0 0x7fa3080359a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa3100096a0 tx=0x7fa310006b40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:17.877 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:17.872+0000 7fa30dffb700 1 -- 172.21.15.157:0/3098948317 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fa31c02d960 con 0x7fa3200fc410 2021-10-08T19:20:18.095 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.087+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa32005f450 con 0x7fa3200fc410 2021-10-08T19:20:18.095 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.088+0000 7fa30dffb700 1 -- 172.21.15.157:0/3098948317 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7fa31c01ab90 con 0x7fa3200fc410 2021-10-08T19:20:18.096 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.096 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: { 2021-10-08T19:20:18.096 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "fsid": "906d7a14-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:20:18.096 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "health": { 2021-10-08T19:20:18.096 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-10-08T19:20:18.097 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "checks": {}, 2021-10-08T19:20:18.097 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "mutes": [] 2021-10-08T19:20:18.097 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:18.097 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-10-08T19:20:18.097 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "quorum": [ 2021-10-08T19:20:18.098 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 0 2021-10-08T19:20:18.098 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ], 2021-10-08T19:20:18.098 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "quorum_names": [ 2021-10-08T19:20:18.098 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "a" 2021-10-08T19:20:18.099 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ], 2021-10-08T19:20:18.099 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "quorum_age": 947283714, 2021-10-08T19:20:18.099 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "monmap": { 2021-10-08T19:20:18.099 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:18.099 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-10-08T19:20:18.100 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_mons": 1 2021-10-08T19:20:18.100 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:18.100 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "osdmap": { 2021-10-08T19:20:18.100 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:18.100 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_osds": 0, 2021-10-08T19:20:18.101 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-10-08T19:20:18.101 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-10-08T19:20:18.101 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-10-08T19:20:18.101 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-10-08T19:20:18.102 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-10-08T19:20:18.102 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:18.102 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "pgmap": { 2021-10-08T19:20:18.102 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-10-08T19:20:18.102 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-10-08T19:20:18.103 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_pools": 0, 2021-10-08T19:20:18.103 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_objects": 0, 2021-10-08T19:20:18.103 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-10-08T19:20:18.103 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-10-08T19:20:18.103 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-10-08T19:20:18.104 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "bytes_total": 0 2021-10-08T19:20:18.104 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:18.104 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "fsmap": { 2021-10-08T19:20:18.104 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:18.104 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "by_rank": [], 2021-10-08T19:20:18.105 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "up:standby": 0 2021-10-08T19:20:18.105 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:18.105 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "mgrmap": { 2021-10-08T19:20:18.105 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "available": true, 2021-10-08T19:20:18.106 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-10-08T19:20:18.106 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "modules": [ 2021-10-08T19:20:18.106 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "iostat", 2021-10-08T19:20:18.106 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "nfs", 2021-10-08T19:20:18.106 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "restful" 2021-10-08T19:20:18.107 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ], 2021-10-08T19:20:18.107 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:20:18.107 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:18.107 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "servicemap": { 2021-10-08T19:20:18.107 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:20:18.108 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "modified": "2021-10-08T19:20:03.139383+0000", 2021-10-08T19:20:18.108 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:20:18.108 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: }, 2021-10-08T19:20:18.108 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "progress_events": {} 2021-10-08T19:20:18.108 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: } 2021-10-08T19:20:18.109 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 >> v2:172.21.15.157:6800/3137430012 conn(0x7fa3080334f0 msgr2=0x7fa3080359a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:18.109 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 --2- 172.21.15.157:0/3098948317 >> v2:172.21.15.157:6800/3137430012 conn(0x7fa3080334f0 0x7fa3080359a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa3100096a0 tx=0x7fa310006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:18.109 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 msgr2=0x7fa32010af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:18.109 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 --2- 172.21.15.157:0/3098948317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa32010af40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b5c0 tx=0x7fa31c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:18.109 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 shutdown_connections 2021-10-08T19:20:18.110 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 --2- 172.21.15.157:0/3098948317 >> v2:172.21.15.157:6800/3137430012 conn(0x7fa3080334f0 0x7fa3080359a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:18.110 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 --2- 172.21.15.157:0/3098948317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3200fc410 0x7fa32010af40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:18.110 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 >> 172.21.15.157:0/3098948317 conn(0x7fa3200f7b80 msgr2=0x7fa3200f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:18.110 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 shutdown_connections 2021-10-08T19:20:18.110 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:18.090+0000 7fa326258700 1 -- 172.21.15.157:0/3098948317 wait complete. 2021-10-08T19:20:18.594 INFO:teuthology.orchestra.run.smithi157.stderr:mgr is available 2021-10-08T19:20:18.595 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z -v /tmp/tmp2xmsy22t:/var/lib/ceph/user.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config assimilate-conf -i /var/lib/ceph/user.conf 2021-10-08T19:20:18.792 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:18 smithi157 ceph-mon[32847]: mgrmap e3: y(active, since 1.0065s) 2021-10-08T19:20:18.792 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3098948317' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-10-08T19:20:19.167 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.163+0000 7fc4dcfda700 1 Processor -- start 2021-10-08T19:20:19.168 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.163+0000 7fc4dcfda700 1 -- start start 2021-10-08T19:20:19.168 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.163+0000 7fc4dcfda700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d80fceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:19.168 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.163+0000 7fc4dcfda700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d80fd480 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.169 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.164+0000 7fc4d659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d80fceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:19.169 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.164+0000 7fc4d659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d80fceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39340/0 (socket says 172.21.15.157:39340) 2021-10-08T19:20:19.169 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.164+0000 7fc4d659c700 1 -- 172.21.15.157:0/672981030 learned_addr learned my addr 172.21.15.157:0/672981030 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:19.169 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.164+0000 7fc4d659c700 1 -- 172.21.15.157:0/672981030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d80fd5c0 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.164+0000 7fc4d659c700 1 --2- 172.21.15.157:0/672981030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d80fceb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800b5f0 tx=0x7fc4c8006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28aae959370c2a3 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.164+0000 7fc4d5d9b700 1 -- 172.21.15.157:0/672981030 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4c80106d0 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.164+0000 7fc4d5d9b700 1 -- 172.21.15.157:0/672981030 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fc4c8010c90 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.164+0000 7fc4d5d9b700 1 -- 172.21.15.157:0/672981030 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4c8011c00 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.165+0000 7fc4dcfda700 1 -- 172.21.15.157:0/672981030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 msgr2=0x7fc4d80fceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:19.171 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.165+0000 7fc4dcfda700 1 --2- 172.21.15.157:0/672981030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d80fceb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800b5f0 tx=0x7fc4c8006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:19.171 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.165+0000 7fc4dcfda700 1 -- 172.21.15.157:0/672981030 shutdown_connections 2021-10-08T19:20:19.171 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.165+0000 7fc4dcfda700 1 --2- 172.21.15.157:0/672981030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d80fceb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:19.171 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.165+0000 7fc4dcfda700 1 -- 172.21.15.157:0/672981030 >> 172.21.15.157:0/672981030 conn(0x7fc4d80f63a0 msgr2=0x7fc4d80f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:19.172 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.165+0000 7fc4dcfda700 1 -- 172.21.15.157:0/672981030 shutdown_connections 2021-10-08T19:20:19.172 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.165+0000 7fc4dcfda700 1 -- 172.21.15.157:0/672981030 wait complete. 2021-10-08T19:20:19.172 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.166+0000 7fc4dcfda700 1 Processor -- start 2021-10-08T19:20:19.172 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.166+0000 7fc4dcfda700 1 -- start start 2021-10-08T19:20:19.172 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.166+0000 7fc4dcfda700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d810b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:19.173 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.166+0000 7fc4dcfda700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d810b600 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.173 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.166+0000 7fc4d659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d810b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:19.173 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.166+0000 7fc4d659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d810b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39342/0 (socket says 172.21.15.157:39342) 2021-10-08T19:20:19.173 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.166+0000 7fc4d659c700 1 -- 172.21.15.157:0/2401663473 learned_addr learned my addr 172.21.15.157:0/2401663473 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:19.173 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.166+0000 7fc4d659c700 1 -- 172.21.15.157:0/2401663473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c800b200 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.174 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.166+0000 7fc4d659c700 1 --2- 172.21.15.157:0/2401663473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d810b0c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800c010 tx=0x7fc4c8006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:19.174 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.167+0000 7fc4cf7fe700 1 -- 172.21.15.157:0/2401663473 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4c801b620 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.174 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.167+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d810b860 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.174 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.167+0000 7fc4cf7fe700 1 -- 172.21.15.157:0/2401663473 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fc4c801bbe0 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.174 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.167+0000 7fc4cf7fe700 1 -- 172.21.15.157:0/2401663473 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4c8023840 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.175 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.167+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d810c4a0 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.176 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.167+0000 7fc4cf7fe700 1 -- 172.21.15.157:0/2401663473 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 40409+0+0 (secure 0 0 0) 0x7fc4c800f070 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.176 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.168+0000 7fc4cf7fe700 1 --2- 172.21.15.157:0/2401663473 >> v2:172.21.15.157:6800/3137430012 conn(0x7fc4b8033510 0x7fc4b80359c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:19.176 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.168+0000 7fc4cf7fe700 1 -- 172.21.15.157:0/2401663473 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc4c8046620 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.176 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.168+0000 7fc4cdd9b700 1 --2- 172.21.15.157:0/2401663473 >> v2:172.21.15.157:6800/3137430012 conn(0x7fc4b8033510 0x7fc4b80359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:19.177 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.168+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d805a9f0 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.177 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.168+0000 7fc4cdd9b700 1 --2- 172.21.15.157:0/2401663473 >> v2:172.21.15.157:6800/3137430012 conn(0x7fc4b8033510 0x7fc4b80359c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00096a0 tx=0x7fc4c0006b40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:19.177 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.172+0000 7fc4cf7fe700 1 -- 172.21.15.157:0/2401663473 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fc4c802bb80 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.333 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.333+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fc4d80fc370 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.334+0000 7fc4cf7fe700 1 -- 172.21.15.157:0/2401663473 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+282 (secure 0 0 0) 0x7fc4c8045020 con 0x7fc4d80fcaa0 2021-10-08T19:20:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: [global] 2021-10-08T19:20:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: fsid = 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-10-08T19:20:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-10-08T19:20:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-10-08T19:20:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-10-08T19:20:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: [mgr] 2021-10-08T19:20:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-10-08T19:20:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: [osd] 2021-10-08T19:20:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-10-08T19:20:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-10-08T19:20:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.335+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 >> v2:172.21.15.157:6800/3137430012 conn(0x7fc4b8033510 msgr2=0x7fc4b80359c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.335+0000 7fc4dcfda700 1 --2- 172.21.15.157:0/2401663473 >> v2:172.21.15.157:6800/3137430012 conn(0x7fc4b8033510 0x7fc4b80359c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00096a0 tx=0x7fc4c0006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.335+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 msgr2=0x7fc4d810b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.335+0000 7fc4dcfda700 1 --2- 172.21.15.157:0/2401663473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d810b0c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800c010 tx=0x7fc4c8006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.336+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 shutdown_connections 2021-10-08T19:20:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.336+0000 7fc4dcfda700 1 --2- 172.21.15.157:0/2401663473 >> v2:172.21.15.157:6800/3137430012 conn(0x7fc4b8033510 0x7fc4b80359c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.336+0000 7fc4dcfda700 1 --2- 172.21.15.157:0/2401663473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4d80fcaa0 0x7fc4d810b0c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.336+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 >> 172.21.15.157:0/2401663473 conn(0x7fc4d80f63a0 msgr2=0x7fc4d80f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.336+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 shutdown_connections 2021-10-08T19:20:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:19.336+0000 7fc4dcfda700 1 -- 172.21.15.157:0/2401663473 wait complete. 2021-10-08T19:20:19.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:19 smithi157 ceph-mon[32847]: mgrmap e4: y(active, since 2s) 2021-10-08T19:20:19.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2401663473' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-10-08T19:20:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:Enabling cephadm module... 2021-10-08T19:20:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr module enable cephadm 2021-10-08T19:20:20.453 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.449+0000 7fee3cdcd700 1 Processor -- start 2021-10-08T19:20:20.453 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.449+0000 7fee3cdcd700 1 -- start start 2021-10-08T19:20:20.454 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.449+0000 7fee3cdcd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee380fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:20.454 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.449+0000 7fee3cdcd700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee380fbec0 con 0x7fee380fb4e0 2021-10-08T19:20:20.454 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.449+0000 7fee3659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee380fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:20.454 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.449+0000 7fee3659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee380fb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39346/0 (socket says 172.21.15.157:39346) 2021-10-08T19:20:20.455 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.449+0000 7fee3659c700 1 -- 172.21.15.157:0/3877795655 learned_addr learned my addr 172.21.15.157:0/3877795655 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:20.455 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.450+0000 7fee3659c700 1 -- 172.21.15.157:0/3877795655 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee380fc000 con 0x7fee380fb4e0 2021-10-08T19:20:20.455 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.450+0000 7fee3659c700 1 --2- 172.21.15.157:0/3877795655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee380fb8f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee2800b5f0 tx=0x7fee28006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0effa92529add11 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:20.455 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.450+0000 7fee3559a700 1 -- 172.21.15.157:0/3877795655 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee280106d0 con 0x7fee380fb4e0 2021-10-08T19:20:20.455 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.450+0000 7fee3559a700 1 -- 172.21.15.157:0/3877795655 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fee28010c90 con 0x7fee380fb4e0 2021-10-08T19:20:20.456 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.450+0000 7fee3559a700 1 -- 172.21.15.157:0/3877795655 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee28011c00 con 0x7fee380fb4e0 2021-10-08T19:20:20.456 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 -- 172.21.15.157:0/3877795655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 msgr2=0x7fee380fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:20.456 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 --2- 172.21.15.157:0/3877795655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee380fb8f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee2800b5f0 tx=0x7fee28006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:20.456 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 -- 172.21.15.157:0/3877795655 shutdown_connections 2021-10-08T19:20:20.456 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 --2- 172.21.15.157:0/3877795655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee380fb8f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:20.457 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 -- 172.21.15.157:0/3877795655 >> 172.21.15.157:0/3877795655 conn(0x7fee380f6c30 msgr2=0x7fee380f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:20.457 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 -- 172.21.15.157:0/3877795655 shutdown_connections 2021-10-08T19:20:20.457 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 -- 172.21.15.157:0/3877795655 wait complete. 2021-10-08T19:20:20.457 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 Processor -- start 2021-10-08T19:20:20.457 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 -- start start 2021-10-08T19:20:20.458 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee381018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:20.458 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3cdcd700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee380ffd70 con 0x7fee380fb4e0 2021-10-08T19:20:20.458 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee381018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:20.458 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee381018f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39348/0 (socket says 172.21.15.157:39348) 2021-10-08T19:20:20.459 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.451+0000 7fee3659c700 1 -- 172.21.15.157:0/544575257 learned_addr learned my addr 172.21.15.157:0/544575257 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:20.459 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.452+0000 7fee3659c700 1 -- 172.21.15.157:0/544575257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2800b200 con 0x7fee380fb4e0 2021-10-08T19:20:20.459 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.452+0000 7fee3659c700 1 --2- 172.21.15.157:0/544575257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee381018f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee2800c010 tx=0x7fee28006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:20.460 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.452+0000 7fee26ffd700 1 -- 172.21.15.157:0/544575257 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee28011440 con 0x7fee380fb4e0 2021-10-08T19:20:20.460 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.452+0000 7fee26ffd700 1 -- 172.21.15.157:0/544575257 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fee2801ba80 con 0x7fee380fb4e0 2021-10-08T19:20:20.460 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.452+0000 7fee26ffd700 1 -- 172.21.15.157:0/544575257 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee280237e0 con 0x7fee380fb4e0 2021-10-08T19:20:20.460 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.452+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee380fff70 con 0x7fee380fb4e0 2021-10-08T19:20:20.460 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.452+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee38100400 con 0x7fee380fb4e0 2021-10-08T19:20:20.462 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.453+0000 7fee26ffd700 1 -- 172.21.15.157:0/544575257 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 40409+0+0 (secure 0 0 0) 0x7fee2800f070 con 0x7fee380fb4e0 2021-10-08T19:20:20.462 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.453+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3805a9f0 con 0x7fee380fb4e0 2021-10-08T19:20:20.462 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.453+0000 7fee26ffd700 1 --2- 172.21.15.157:0/544575257 >> v2:172.21.15.157:6800/3137430012 conn(0x7fee1c0335b0 0x7fee1c035a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:20.462 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.453+0000 7fee26ffd700 1 -- 172.21.15.157:0/544575257 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fee28046500 con 0x7fee380fb4e0 2021-10-08T19:20:20.463 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.453+0000 7fee35d9b700 1 --2- 172.21.15.157:0/544575257 >> v2:172.21.15.157:6800/3137430012 conn(0x7fee1c0335b0 0x7fee1c035a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:20.463 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.454+0000 7fee35d9b700 1 --2- 172.21.15.157:0/544575257 >> v2:172.21.15.157:6800/3137430012 conn(0x7fee1c0335b0 0x7fee1c035a60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0096a0 tx=0x7fee2c006b40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:20.463 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.457+0000 7fee26ffd700 1 -- 172.21.15.157:0/544575257 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fee2801bbf0 con 0x7fee380fb4e0 2021-10-08T19:20:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.660+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fee380fd4f0 con 0x7fee380fb4e0 2021-10-08T19:20:20.714 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.713+0000 7fee26ffd700 1 -- 172.21.15.157:0/544575257 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 5) v1 ==== 40420+0+0 (secure 0 0 0) 0x7fee2802d960 con 0x7fee380fb4e0 2021-10-08T19:20:20.715 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.714+0000 7fee26ffd700 1 -- 172.21.15.157:0/544575257 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fee28019810 con 0x7fee380fb4e0 2021-10-08T19:20:20.718 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.716+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 >> v2:172.21.15.157:6800/3137430012 conn(0x7fee1c0335b0 msgr2=0x7fee1c035a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:20.718 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.716+0000 7fee3cdcd700 1 --2- 172.21.15.157:0/544575257 >> v2:172.21.15.157:6800/3137430012 conn(0x7fee1c0335b0 0x7fee1c035a60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0096a0 tx=0x7fee2c006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:20.719 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.716+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 msgr2=0x7fee381018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:20.719 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.716+0000 7fee3cdcd700 1 --2- 172.21.15.157:0/544575257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee381018f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee2800c010 tx=0x7fee28006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:20.719 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.716+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 shutdown_connections 2021-10-08T19:20:20.720 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.716+0000 7fee3cdcd700 1 --2- 172.21.15.157:0/544575257 >> v2:172.21.15.157:6800/3137430012 conn(0x7fee1c0335b0 0x7fee1c035a60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:20.720 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.716+0000 7fee3cdcd700 1 --2- 172.21.15.157:0/544575257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee380fb4e0 0x7fee381018f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:20.720 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.716+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 >> 172.21.15.157:0/544575257 conn(0x7fee380f6c30 msgr2=0x7fee380f78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:20.721 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.718+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 shutdown_connections 2021-10-08T19:20:20.721 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:20.718+0000 7fee3cdcd700 1 -- 172.21.15.157:0/544575257 wait complete. 2021-10-08T19:20:21.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/544575257' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-10-08T19:20:21.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:20 smithi157 conmon[33269]: ignoring --setuser ceph since I am not root 2021-10-08T19:20:21.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:20 smithi157 conmon[33269]: ignoring --setgroup ceph since I am not root 2021-10-08T19:20:21.261 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr stat 2021-10-08T19:20:21.849 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.845+0000 7fd359757700 1 Processor -- start 2021-10-08T19:20:21.850 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.845+0000 7fd359757700 1 -- start start 2021-10-08T19:20:21.850 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.845+0000 7fd359757700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd3540facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:21.850 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.845+0000 7fd359757700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540fb2c0 con 0x7fd3540fa8e0 2021-10-08T19:20:21.851 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.845+0000 7fd352ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd3540facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:21.851 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.845+0000 7fd352ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd3540facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39362/0 (socket says 172.21.15.157:39362) 2021-10-08T19:20:21.851 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.845+0000 7fd352ffd700 1 -- 172.21.15.157:0/3531449308 learned_addr learned my addr 172.21.15.157:0/3531449308 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:21.851 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.845+0000 7fd352ffd700 1 -- 172.21.15.157:0/3531449308 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540fb400 con 0x7fd3540fa8e0 2021-10-08T19:20:21.852 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd352ffd700 1 --2- 172.21.15.157:0/3531449308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd3540facf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd34400b5f0 tx=0x7fd344006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9356a24d6c1af594 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:21.852 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd351ffb700 1 -- 172.21.15.157:0/3531449308 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3440106d0 con 0x7fd3540fa8e0 2021-10-08T19:20:21.852 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd351ffb700 1 -- 172.21.15.157:0/3531449308 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fd344010c90 con 0x7fd3540fa8e0 2021-10-08T19:20:21.852 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd351ffb700 1 -- 172.21.15.157:0/3531449308 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd344011c00 con 0x7fd3540fa8e0 2021-10-08T19:20:21.852 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd359757700 1 -- 172.21.15.157:0/3531449308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 msgr2=0x7fd3540facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:21.853 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd359757700 1 --2- 172.21.15.157:0/3531449308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd3540facf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd34400b5f0 tx=0x7fd344006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:21.853 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd359757700 1 -- 172.21.15.157:0/3531449308 shutdown_connections 2021-10-08T19:20:21.853 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd359757700 1 --2- 172.21.15.157:0/3531449308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd3540facf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:21.853 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd359757700 1 -- 172.21.15.157:0/3531449308 >> 172.21.15.157:0/3531449308 conn(0x7fd3540f63a0 msgr2=0x7fd3540f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:21.853 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd359757700 1 -- 172.21.15.157:0/3531449308 shutdown_connections 2021-10-08T19:20:21.854 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.846+0000 7fd359757700 1 -- 172.21.15.157:0/3531449308 wait complete. 2021-10-08T19:20:21.854 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.847+0000 7fd359757700 1 Processor -- start 2021-10-08T19:20:21.854 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.847+0000 7fd359757700 1 -- start start 2021-10-08T19:20:21.854 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.847+0000 7fd359757700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd35410b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:21.855 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.847+0000 7fd359757700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35410b690 con 0x7fd3540fa8e0 2021-10-08T19:20:21.855 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.847+0000 7fd352ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd35410b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:21.855 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.847+0000 7fd352ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd35410b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39364/0 (socket says 172.21.15.157:39364) 2021-10-08T19:20:21.855 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.847+0000 7fd352ffd700 1 -- 172.21.15.157:0/304780668 learned_addr learned my addr 172.21.15.157:0/304780668 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:21.856 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.848+0000 7fd352ffd700 1 -- 172.21.15.157:0/304780668 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34400b200 con 0x7fd3540fa8e0 2021-10-08T19:20:21.856 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.848+0000 7fd352ffd700 1 --2- 172.21.15.157:0/304780668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd35410b150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd34400b5c0 tx=0x7fd344006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:21.856 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.848+0000 7fd33b7fe700 1 -- 172.21.15.157:0/304780668 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd34401b620 con 0x7fd3540fa8e0 2021-10-08T19:20:21.856 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.848+0000 7fd33b7fe700 1 -- 172.21.15.157:0/304780668 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fd34401bbe0 con 0x7fd3540fa8e0 2021-10-08T19:20:21.856 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.848+0000 7fd33b7fe700 1 -- 172.21.15.157:0/304780668 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd344023890 con 0x7fd3540fa8e0 2021-10-08T19:20:21.857 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.849+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35410b890 con 0x7fd3540fa8e0 2021-10-08T19:20:21.857 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.849+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35410c530 con 0x7fd3540fa8e0 2021-10-08T19:20:21.858 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.849+0000 7fd33b7fe700 1 -- 172.21.15.157:0/304780668 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 40420+0+0 (secure 0 0 0) 0x7fd34400f070 con 0x7fd3540fa8e0 2021-10-08T19:20:21.859 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.850+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35410bd20 con 0x7fd3540fa8e0 2021-10-08T19:20:21.859 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.850+0000 7fd33b7fe700 1 --2- 172.21.15.157:0/304780668 >> v2:172.21.15.157:6800/3137430012 conn(0x7fd3400335b0 0x7fd340035a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:21.859 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.850+0000 7fd33b7fe700 1 -- 172.21.15.157:0/304780668 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd3440462c0 con 0x7fd3540fa8e0 2021-10-08T19:20:21.859 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.850+0000 7fd3527fc700 1 -- 172.21.15.157:0/304780668 >> v2:172.21.15.157:6800/3137430012 conn(0x7fd3400335b0 msgr2=0x7fd340035a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3137430012 2021-10-08T19:20:21.860 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.850+0000 7fd3527fc700 1 --2- 172.21.15.157:0/304780668 >> v2:172.21.15.157:6800/3137430012 conn(0x7fd3400335b0 0x7fd340035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:20:21.860 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:21.858+0000 7fd33b7fe700 1 -- 172.21.15.157:0/304780668 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fd34401a760 con 0x7fd3540fa8e0 2021-10-08T19:20:22.052 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.051+0000 7fd3527fc700 1 -- 172.21.15.157:0/304780668 >> v2:172.21.15.157:6800/3137430012 conn(0x7fd3400335b0 msgr2=0x7fd340035a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3137430012 2021-10-08T19:20:22.052 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.051+0000 7fd3527fc700 1 --2- 172.21.15.157:0/304780668 >> v2:172.21.15.157:6800/3137430012 conn(0x7fd3400335b0 0x7fd340035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:20:22.066 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.065+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd35405f450 con 0x7fd3540fa8e0 2021-10-08T19:20:22.067 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.066+0000 7fd33b7fe700 1 -- 172.21.15.157:0/304780668 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fd3440193a0 con 0x7fd3540fa8e0 2021-10-08T19:20:22.067 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: { 2021-10-08T19:20:22.067 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 5, 2021-10-08T19:20:22.068 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "available": true, 2021-10-08T19:20:22.068 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "active_name": "y", 2021-10-08T19:20:22.068 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_standby": 0 2021-10-08T19:20:22.068 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: } 2021-10-08T19:20:22.070 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 >> v2:172.21.15.157:6800/3137430012 conn(0x7fd3400335b0 msgr2=0x7fd340035a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:20:22.070 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 --2- 172.21.15.157:0/304780668 >> v2:172.21.15.157:6800/3137430012 conn(0x7fd3400335b0 0x7fd340035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:22.070 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 msgr2=0x7fd35410b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:22.071 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 --2- 172.21.15.157:0/304780668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd35410b150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd34400b5c0 tx=0x7fd344006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:22.071 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 shutdown_connections 2021-10-08T19:20:22.071 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 --2- 172.21.15.157:0/304780668 >> v2:172.21.15.157:6800/3137430012 conn(0x7fd3400335b0 0x7fd340035a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:22.071 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 --2- 172.21.15.157:0/304780668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3540fa8e0 0x7fd35410b150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:22.071 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 >> 172.21.15.157:0/304780668 conn(0x7fd3540f63a0 msgr2=0x7fd3540f7040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:22.072 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 shutdown_connections 2021-10-08T19:20:22.072 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:22.068+0000 7fd359757700 1 -- 172.21.15.157:0/304780668 wait complete. 2021-10-08T19:20:22.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/544575257' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-10-08T19:20:22.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:21 smithi157 ceph-mon[32847]: mgrmap e5: y(active, since 4s) 2021-10-08T19:20:22.571 INFO:teuthology.orchestra.run.smithi157.stderr:Waiting for the mgr to restart... 2021-10-08T19:20:22.572 INFO:teuthology.orchestra.run.smithi157.stderr:Waiting for mgr epoch 5... 2021-10-08T19:20:22.572 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf tell mgr mgr_status 2021-10-08T19:20:23.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/304780668' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-10-08T19:20:23.176 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.174+0000 7f7eced8b700 1 Processor -- start 2021-10-08T19:20:23.176 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.174+0000 7f7eced8b700 1 -- start start 2021-10-08T19:20:23.177 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.174+0000 7f7eced8b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec80fb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:23.177 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.174+0000 7f7eced8b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec80fbaf0 con 0x7f7ec80fb110 2021-10-08T19:20:23.177 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.174+0000 7f7ecdd89700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec80fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:23.183 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.174+0000 7f7ecdd89700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec80fb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39372/0 (socket says 172.21.15.157:39372) 2021-10-08T19:20:23.183 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.174+0000 7f7ecdd89700 1 -- 172.21.15.157:0/1778621383 learned_addr learned my addr 172.21.15.157:0/1778621383 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:23.183 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.175+0000 7f7ecdd89700 1 -- 172.21.15.157:0/1778621383 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec80fbc30 con 0x7f7ec80fb110 2021-10-08T19:20:23.184 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.175+0000 7f7ecdd89700 1 --2- 172.21.15.157:0/1778621383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec80fb520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400b5f0 tx=0x7f7ec4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea1b8ba5c4798f4 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:23.184 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.175+0000 7f7eccd87700 1 -- 172.21.15.157:0/1778621383 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ec40106d0 con 0x7f7ec80fb110 2021-10-08T19:20:23.184 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.175+0000 7f7eccd87700 1 -- 172.21.15.157:0/1778621383 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f7ec4010c90 con 0x7f7ec80fb110 2021-10-08T19:20:23.185 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.175+0000 7f7eccd87700 1 -- 172.21.15.157:0/1778621383 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ec4011c00 con 0x7f7ec80fb110 2021-10-08T19:20:23.185 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.175+0000 7f7eced8b700 1 -- 172.21.15.157:0/1778621383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 msgr2=0x7f7ec80fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:23.185 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.175+0000 7f7eced8b700 1 --2- 172.21.15.157:0/1778621383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec80fb520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400b5f0 tx=0x7f7ec4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:23.185 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7eced8b700 1 -- 172.21.15.157:0/1778621383 shutdown_connections 2021-10-08T19:20:23.186 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7eced8b700 1 --2- 172.21.15.157:0/1778621383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec80fb520 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:23.186 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7eced8b700 1 -- 172.21.15.157:0/1778621383 >> 172.21.15.157:0/1778621383 conn(0x7f7ec80f68a0 msgr2=0x7f7ec80f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:23.186 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7eced8b700 1 -- 172.21.15.157:0/1778621383 shutdown_connections 2021-10-08T19:20:23.186 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7eced8b700 1 -- 172.21.15.157:0/1778621383 wait complete. 2021-10-08T19:20:23.186 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7eced8b700 1 Processor -- start 2021-10-08T19:20:23.187 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7eced8b700 1 -- start start 2021-10-08T19:20:23.187 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7eced8b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec810cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:23.187 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7eced8b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec810d4c0 con 0x7f7ec80fb110 2021-10-08T19:20:23.187 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7ecdd89700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec810cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:23.188 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7ecdd89700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec810cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39374/0 (socket says 172.21.15.157:39374) 2021-10-08T19:20:23.188 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.176+0000 7f7ecdd89700 1 -- 172.21.15.157:0/4075654738 learned_addr learned my addr 172.21.15.157:0/4075654738 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:23.188 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.177+0000 7f7ecdd89700 1 -- 172.21.15.157:0/4075654738 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec400b200 con 0x7f7ec80fb110 2021-10-08T19:20:23.188 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.177+0000 7f7ecdd89700 1 --2- 172.21.15.157:0/4075654738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec810cf80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400b5c0 tx=0x7f7ec4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:23.188 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.177+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ec401b620 con 0x7f7ec80fb110 2021-10-08T19:20:23.189 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.177+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f7ec401bbe0 con 0x7f7ec80fb110 2021-10-08T19:20:23.189 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.177+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec810d6c0 con 0x7f7ec80fb110 2021-10-08T19:20:23.189 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.177+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ec4023890 con 0x7f7ec80fb110 2021-10-08T19:20:23.189 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.177+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec810e360 con 0x7f7ec80fb110 2021-10-08T19:20:23.189 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.178+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 40420+0+0 (secure 0 0 0) 0x7f7ec400f070 con 0x7f7ec80fb110 2021-10-08T19:20:23.190 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.178+0000 7f7eb67fc700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 0x7f7eb0035a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:23.190 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.178+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 --> v2:172.21.15.157:6800/3137430012 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ec805a9f0 con 0x7f7eb00335b0 2021-10-08T19:20:23.190 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.178+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7ec4046750 con 0x7f7ec80fb110 2021-10-08T19:20:23.190 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.178+0000 7f7ecd588700 1 -- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 msgr2=0x7f7eb0035a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3137430012 2021-10-08T19:20:23.191 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.178+0000 7f7ecd588700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 0x7f7eb0035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:20:23.381 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.379+0000 7f7ecd588700 1 -- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 msgr2=0x7f7eb0035a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3137430012 2021-10-08T19:20:23.381 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.379+0000 7f7ecd588700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 0x7f7eb0035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:20:23.782 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.780+0000 7f7ecd588700 1 -- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 msgr2=0x7f7eb0035a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3137430012 2021-10-08T19:20:23.782 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:23.780+0000 7f7ecd588700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 0x7f7eb0035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2021-10-08T19:20:24.583 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:24.581+0000 7f7ecd588700 1 -- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 msgr2=0x7f7eb0035a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3137430012 2021-10-08T19:20:24.583 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:24.581+0000 7f7ecd588700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 0x7f7eb0035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2021-10-08T19:20:26.184 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:26.182+0000 7f7ecd588700 1 -- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 msgr2=0x7f7eb0035a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3137430012 2021-10-08T19:20:26.185 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:26.182+0000 7f7ecd588700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 0x7f7eb0035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2021-10-08T19:20:26.372 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:26.370+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mgrmap(e 6) v1 ==== 40265+0+0 (secure 0 0 0) 0x7f7ec402d960 con 0x7f7ec80fb110 2021-10-08T19:20:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:26.370+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 msgr2=0x7f7eb0035a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:20:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:26.370+0000 7f7eb67fc700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 0x7f7eb0035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:27.374 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.371+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 7) v1 ==== 40340+0+0 (secure 0 0 0) 0x7f7ec401a3a0 con 0x7f7ec80fb110 2021-10-08T19:20:27.374 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.371+0000 7f7eb67fc700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/4161241346 conn(0x7f7eb0036db0 0x7f7eb0039190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:27.374 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.371+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 --> v2:172.21.15.157:6800/4161241346 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ec805a9f0 con 0x7f7eb0036db0 2021-10-08T19:20:27.375 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.372+0000 7f7ecd588700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/4161241346 conn(0x7f7eb0036db0 0x7f7eb0039190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:27.375 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.372+0000 7f7ecd588700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/4161241346 conn(0x7f7eb0036db0 0x7f7eb0039190 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8006fd0 tx=0x7f7eb8006d70 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:27.375 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.373+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 <== mgr.14118 v2:172.21.15.157:6800/4161241346 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6424 (secure 0 0 0) 0x7f7ec805a9f0 con 0x7f7eb0036db0 2021-10-08T19:20:27.382 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 --> v2:172.21.15.157:6800/4161241346 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7ec810db50 con 0x7f7eb0036db0 2021-10-08T19:20:27.382 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eb67fc700 1 -- 172.21.15.157:0/4075654738 <== mgr.14118 v2:172.21.15.157:6800/4161241346 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7ec810db50 con 0x7f7eb0036db0 2021-10-08T19:20:27.382 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: { 2021-10-08T19:20:27.382 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-10-08T19:20:27.383 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "initialized": true 2021-10-08T19:20:27.383 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: } 2021-10-08T19:20:27.383 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/4161241346 conn(0x7f7eb0036db0 msgr2=0x7f7eb0039190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:27.383 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/4161241346 conn(0x7f7eb0036db0 0x7f7eb0039190 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8006fd0 tx=0x7f7eb8006d70 comp rx=0 tx=0).stop 2021-10-08T19:20:27.383 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 msgr2=0x7f7ec810cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 --2- 172.21.15.157:0/4075654738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec810cf80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400b5c0 tx=0x7f7ec4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 shutdown_connections 2021-10-08T19:20:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/4161241346 conn(0x7f7eb0036db0 0x7f7eb0039190 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 --2- 172.21.15.157:0/4075654738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ec80fb110 0x7f7ec810cf80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:27.385 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 --2- 172.21.15.157:0/4075654738 >> v2:172.21.15.157:6800/3137430012 conn(0x7f7eb00335b0 0x7f7eb0035a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:27.385 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 >> 172.21.15.157:0/4075654738 conn(0x7f7ec80f68a0 msgr2=0x7f7ec80f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:27.385 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 shutdown_connections 2021-10-08T19:20:27.385 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:27.379+0000 7f7eced8b700 1 -- 172.21.15.157:0/4075654738 wait complete. 2021-10-08T19:20:27.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:27 smithi157 conmon[33269]: [08/Oct/2021:19:20:27] ENGINE Bus STARTING 2021-10-08T19:20:27.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:27 smithi157 conmon[33269]: [08/Oct/2021:19:20:27] ENGINE Serving on https://172.21.15.157:8499 2021-10-08T19:20:27.579 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:27 smithi157 conmon[33269]: [08/Oct/2021:19:20:27] ENGINE Bus STARTED 2021-10-08T19:20:27.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: Active manager daemon y restarted 2021-10-08T19:20:27.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: Activating manager daemon y 2021-10-08T19:20:27.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: osdmap e2: 0 total, 0 up, 0 in 2021-10-08T19:20:27.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: mgrmap e6: y(active, starting, since 0.0530388s) 2021-10-08T19:20:27.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:20:27.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:20:27.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:20:27.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:20:27.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:20:27.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: Manager daemon y is now available 2021-10-08T19:20:27.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:27.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:27.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:27.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:27.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:27.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:27.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:20:27.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:27 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:20:27.968 INFO:teuthology.orchestra.run.smithi157.stderr:mgr epoch 5 is available 2021-10-08T19:20:27.969 INFO:teuthology.orchestra.run.smithi157.stderr:Setting orchestrator backend to cephadm... 2021-10-08T19:20:27.969 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch set backend cephadm 2021-10-08T19:20:28.577 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f271d031700 1 Processor -- start 2021-10-08T19:20:28.577 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f271d031700 1 -- start start 2021-10-08T19:20:28.577 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f271d031700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f2718070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:28.578 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f271d031700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718071050 con 0x7f2718072610 2021-10-08T19:20:28.578 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f2716d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f2718070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:28.578 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f2716d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f2718070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39420/0 (socket says 172.21.15.157:39420) 2021-10-08T19:20:28.578 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f2716d9d700 1 -- 172.21.15.157:0/3811558111 learned_addr learned my addr 172.21.15.157:0/3811558111 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f2716d9d700 1 -- 172.21.15.157:0/3811558111 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718071190 con 0x7f2718072610 2021-10-08T19:20:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f2716d9d700 1 --2- 172.21.15.157:0/3811558111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f2718070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f270800b5f0 tx=0x7f2708006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edf755805a4f8e0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.571+0000 7f2715d9b700 1 -- 172.21.15.157:0/3811558111 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27080106d0 con 0x7f2718072610 2021-10-08T19:20:28.580 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.572+0000 7f2715d9b700 1 -- 172.21.15.157:0/3811558111 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f2708010c90 con 0x7f2718072610 2021-10-08T19:20:28.580 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.572+0000 7f2715d9b700 1 -- 172.21.15.157:0/3811558111 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2708011c00 con 0x7f2718072610 2021-10-08T19:20:28.580 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.572+0000 7f271d031700 1 -- 172.21.15.157:0/3811558111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 msgr2=0x7f2718070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:28.580 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.572+0000 7f271d031700 1 --2- 172.21.15.157:0/3811558111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f2718070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f270800b5f0 tx=0x7f2708006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:28.580 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.572+0000 7f271d031700 1 -- 172.21.15.157:0/3811558111 shutdown_connections 2021-10-08T19:20:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.572+0000 7f271d031700 1 --2- 172.21.15.157:0/3811558111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f2718070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.572+0000 7f271d031700 1 -- 172.21.15.157:0/3811558111 >> 172.21.15.157:0/3811558111 conn(0x7f27180f7d50 msgr2=0x7f27180fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.572+0000 7f271d031700 1 -- 172.21.15.157:0/3811558111 shutdown_connections 2021-10-08T19:20:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.572+0000 7f271d031700 1 -- 172.21.15.157:0/3811558111 wait complete. 2021-10-08T19:20:28.582 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.573+0000 7f271d031700 1 Processor -- start 2021-10-08T19:20:28.582 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.573+0000 7f271d031700 1 -- start start 2021-10-08T19:20:28.582 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.573+0000 7f271d031700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f271810d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:28.582 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.573+0000 7f271d031700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271810d870 con 0x7f2718072610 2021-10-08T19:20:28.583 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.573+0000 7f2716d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f271810d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:28.583 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.573+0000 7f2716d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f271810d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39422/0 (socket says 172.21.15.157:39422) 2021-10-08T19:20:28.583 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.573+0000 7f2716d9d700 1 -- 172.21.15.157:0/2562307457 learned_addr learned my addr 172.21.15.157:0/2562307457 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:28.583 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.573+0000 7f2716d9d700 1 -- 172.21.15.157:0/2562307457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270800b200 con 0x7f2718072610 2021-10-08T19:20:28.583 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.574+0000 7f2716d9d700 1 --2- 172.21.15.157:0/2562307457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f271810d330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f270800b5c0 tx=0x7f2708006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:28.584 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.574+0000 7f26ff7fe700 1 -- 172.21.15.157:0/2562307457 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2708011440 con 0x7f2718072610 2021-10-08T19:20:28.584 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.574+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271810da70 con 0x7f2718072610 2021-10-08T19:20:28.584 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.574+0000 7f26ff7fe700 1 -- 172.21.15.157:0/2562307457 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f270801ba80 con 0x7f2718072610 2021-10-08T19:20:28.584 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.574+0000 7f26ff7fe700 1 -- 172.21.15.157:0/2562307457 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2708023870 con 0x7f2718072610 2021-10-08T19:20:28.585 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.574+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271810e710 con 0x7f2718072610 2021-10-08T19:20:28.585 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.574+0000 7f26ff7fe700 1 -- 172.21.15.157:0/2562307457 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7f270800f070 con 0x7f2718072610 2021-10-08T19:20:28.585 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.575+0000 7f26ff7fe700 1 --2- 172.21.15.157:0/2562307457 >> v2:172.21.15.157:6800/4161241346 conn(0x7f2704033600 0x7f2704035ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:28.585 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.575+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271810df00 con 0x7f2718072610 2021-10-08T19:20:28.585 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.575+0000 7f26ff7fe700 1 -- 172.21.15.157:0/2562307457 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f2708046db0 con 0x7f2718072610 2021-10-08T19:20:28.586 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.575+0000 7f271659c700 1 --2- 172.21.15.157:0/2562307457 >> v2:172.21.15.157:6800/4161241346 conn(0x7f2704033600 0x7f2704035ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:28.586 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.575+0000 7f271659c700 1 --2- 172.21.15.157:0/2562307457 >> v2:172.21.15.157:6800/4161241346 conn(0x7f2704033600 0x7f2704035ab0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f270c0096a0 tx=0x7f270c006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:28.586 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:28 smithi157 ceph-mon[32847]: Starting cherrypy engine... 2021-10-08T19:20:28.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:28 smithi157 ceph-mon[32847]: [08/Oct/2021:19:20:27] ENGINE Bus STARTING 2021-10-08T19:20:28.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:28 smithi157 ceph-mon[32847]: [08/Oct/2021:19:20:27] ENGINE Serving on https://172.21.15.157:8499 2021-10-08T19:20:28.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:28 smithi157 ceph-mon[32847]: [08/Oct/2021:19:20:27] ENGINE Bus STARTED 2021-10-08T19:20:28.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:28 smithi157 ceph-mon[32847]: Cherrypy engine started. 2021-10-08T19:20:28.588 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:28 smithi157 ceph-mon[32847]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-10-08T19:20:28.588 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:28 smithi157 ceph-mon[32847]: mgrmap e7: y(active, since 1.05511s) 2021-10-08T19:20:28.588 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:28 smithi157 ceph-mon[32847]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-10-08T19:20:28.588 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.579+0000 7f26ff7fe700 1 -- 172.21.15.157:0/2562307457 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f270801ad70 con 0x7f2718072610 2021-10-08T19:20:28.750 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.748+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 --> v2:172.21.15.157:6800/4161241346 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f27181028e0 con 0x7f2704033600 2021-10-08T19:20:28.755 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.754+0000 7f26ff7fe700 1 -- 172.21.15.157:0/2562307457 <== mgr.14118 v2:172.21.15.157:6800/4161241346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f27181028e0 con 0x7f2704033600 2021-10-08T19:20:28.758 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 >> v2:172.21.15.157:6800/4161241346 conn(0x7f2704033600 msgr2=0x7f2704035ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:28.758 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 --2- 172.21.15.157:0/2562307457 >> v2:172.21.15.157:6800/4161241346 conn(0x7f2704033600 0x7f2704035ab0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f270c0096a0 tx=0x7f270c006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:28.760 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 msgr2=0x7f271810d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:28.760 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 --2- 172.21.15.157:0/2562307457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f271810d330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f270800b5c0 tx=0x7f2708006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:28.760 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 shutdown_connections 2021-10-08T19:20:28.760 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 --2- 172.21.15.157:0/2562307457 >> v2:172.21.15.157:6800/4161241346 conn(0x7f2704033600 0x7f2704035ab0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:28.760 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 --2- 172.21.15.157:0/2562307457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718072610 0x7f271810d330 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:28.761 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 >> 172.21.15.157:0/2562307457 conn(0x7f27180f7d50 msgr2=0x7f27180f8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:28.761 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 shutdown_connections 2021-10-08T19:20:28.761 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:28.756+0000 7f271d031700 1 -- 172.21.15.157:0/2562307457 wait complete. 2021-10-08T19:20:29.314 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf cephadm set-user root 2021-10-08T19:20:29.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:29 smithi157 ceph-mon[32847]: mgrmap e8: y(active, since 2s) 2021-10-08T19:20:29.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:29 smithi157 ceph-mon[32847]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:29.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:29 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:29.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:29 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:29.897 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.891+0000 7fbc7bf22700 1 Processor -- start 2021-10-08T19:20:29.898 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.891+0000 7fbc7bf22700 1 -- start start 2021-10-08T19:20:29.898 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc7bf22700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc741013d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:29.898 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc7bf22700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740fce50 con 0x7fbc740704f0 2021-10-08T19:20:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc79cbe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc741013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc79cbe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc741013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39426/0 (socket says 172.21.15.157:39426) 2021-10-08T19:20:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc79cbe700 1 -- 172.21.15.157:0/1342131462 learned_addr learned my addr 172.21.15.157:0/1342131462 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc79cbe700 1 -- 172.21.15.157:0/1342131462 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74101910 con 0x7fbc740704f0 2021-10-08T19:20:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc79cbe700 1 --2- 172.21.15.157:0/1342131462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc741013d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000b5f0 tx=0x7fbc70006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8641e3a18689c671 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc78cbc700 1 -- 172.21.15.157:0/1342131462 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc700106d0 con 0x7fbc740704f0 2021-10-08T19:20:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc78cbc700 1 -- 172.21.15.157:0/1342131462 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fbc70010c90 con 0x7fbc740704f0 2021-10-08T19:20:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.892+0000 7fbc78cbc700 1 -- 172.21.15.157:0/1342131462 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc70011c00 con 0x7fbc740704f0 2021-10-08T19:20:29.901 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.893+0000 7fbc7bf22700 1 -- 172.21.15.157:0/1342131462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 msgr2=0x7fbc741013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:29.901 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.893+0000 7fbc7bf22700 1 --2- 172.21.15.157:0/1342131462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc741013d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000b5f0 tx=0x7fbc70006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:29.901 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.893+0000 7fbc7bf22700 1 -- 172.21.15.157:0/1342131462 shutdown_connections 2021-10-08T19:20:29.902 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.893+0000 7fbc7bf22700 1 --2- 172.21.15.157:0/1342131462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc741013d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:29.902 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.893+0000 7fbc7bf22700 1 -- 172.21.15.157:0/1342131462 >> 172.21.15.157:0/1342131462 conn(0x7fbc740f6a20 msgr2=0x7fbc740f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:29.902 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.893+0000 7fbc7bf22700 1 -- 172.21.15.157:0/1342131462 shutdown_connections 2021-10-08T19:20:29.903 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.893+0000 7fbc7bf22700 1 -- 172.21.15.157:0/1342131462 wait complete. 2021-10-08T19:20:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.893+0000 7fbc7bf22700 1 Processor -- start 2021-10-08T19:20:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc7bf22700 1 -- start start 2021-10-08T19:20:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc7bf22700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc7410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc7bf22700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7410d5e0 con 0x7fbc740704f0 2021-10-08T19:20:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc79cbe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc7410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc79cbe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc7410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39428/0 (socket says 172.21.15.157:39428) 2021-10-08T19:20:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc79cbe700 1 -- 172.21.15.157:0/465032805 learned_addr learned my addr 172.21.15.157:0/465032805 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc79cbe700 1 -- 172.21.15.157:0/465032805 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7000b200 con 0x7fbc740704f0 2021-10-08T19:20:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc79cbe700 1 --2- 172.21.15.157:0/465032805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc7410d0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000b1d0 tx=0x7fbc70006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc627fc700 1 -- 172.21.15.157:0/465032805 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc70011440 con 0x7fbc740704f0 2021-10-08T19:20:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc627fc700 1 -- 172.21.15.157:0/465032805 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fbc7001ba80 con 0x7fbc740704f0 2021-10-08T19:20:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc627fc700 1 -- 172.21.15.157:0/465032805 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc70023830 con 0x7fbc740704f0 2021-10-08T19:20:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7410d7e0 con 0x7fbc740704f0 2021-10-08T19:20:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.894+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7410e480 con 0x7fbc740704f0 2021-10-08T19:20:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.895+0000 7fbc627fc700 1 -- 172.21.15.157:0/465032805 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7fbc7000f070 con 0x7fbc740704f0 2021-10-08T19:20:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.895+0000 7fbc627fc700 1 --2- 172.21.15.157:0/465032805 >> v2:172.21.15.157:6800/4161241346 conn(0x7fbc5c0336b0 0x7fbc5c035b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.895+0000 7fbc627fc700 1 -- 172.21.15.157:0/465032805 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fbc70046a40 con 0x7fbc740704f0 2021-10-08T19:20:29.908 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.895+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7410dc70 con 0x7fbc740704f0 2021-10-08T19:20:29.908 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.895+0000 7fbc794bd700 1 --2- 172.21.15.157:0/465032805 >> v2:172.21.15.157:6800/4161241346 conn(0x7fbc5c0336b0 0x7fbc5c035b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:29.908 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.896+0000 7fbc794bd700 1 --2- 172.21.15.157:0/465032805 >> v2:172.21.15.157:6800/4161241346 conn(0x7fbc5c0336b0 0x7fbc5c035b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbc640096a0 tx=0x7fbc64006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:29.909 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:29.900+0000 7fbc627fc700 1 -- 172.21.15.157:0/465032805 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fbc70023aa0 con 0x7fbc740704f0 2021-10-08T19:20:30.060 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.057+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 --> v2:172.21.15.157:6800/4161241346 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc741027b0 con 0x7fbc5c0336b0 2021-10-08T19:20:30.060 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.058+0000 7fbc627fc700 1 -- 172.21.15.157:0/465032805 <== mgr.14118 v2:172.21.15.157:6800/4161241346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fbc741027b0 con 0x7fbc5c0336b0 2021-10-08T19:20:30.060 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: value unchanged 2021-10-08T19:20:30.062 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 >> v2:172.21.15.157:6800/4161241346 conn(0x7fbc5c0336b0 msgr2=0x7fbc5c035b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:30.063 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 --2- 172.21.15.157:0/465032805 >> v2:172.21.15.157:6800/4161241346 conn(0x7fbc5c0336b0 0x7fbc5c035b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbc640096a0 tx=0x7fbc64006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:30.063 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 msgr2=0x7fbc7410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:30.063 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 --2- 172.21.15.157:0/465032805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc7410d0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000b1d0 tx=0x7fbc70006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:30.063 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 shutdown_connections 2021-10-08T19:20:30.064 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 --2- 172.21.15.157:0/465032805 >> v2:172.21.15.157:6800/4161241346 conn(0x7fbc5c0336b0 0x7fbc5c035b60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:30.064 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 --2- 172.21.15.157:0/465032805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc740704f0 0x7fbc7410d0a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:30.064 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 >> 172.21.15.157:0/465032805 conn(0x7fbc740f6a20 msgr2=0x7fbc740f76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:30.064 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 shutdown_connections 2021-10-08T19:20:30.064 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:30.060+0000 7fbc7bf22700 1 -- 172.21.15.157:0/465032805 wait complete. 2021-10-08T19:20:30.555 INFO:teuthology.orchestra.run.smithi157.stderr:Generating ssh key... 2021-10-08T19:20:30.555 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf cephadm generate-key 2021-10-08T19:20:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:30 smithi157 ceph-mon[32847]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.127+0000 7f628ffca700 1 Processor -- start 2021-10-08T19:20:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628ffca700 1 -- start start 2021-10-08T19:20:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628ffca700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f62881015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628ffca700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62880fd060 con 0x7f6288070530 2021-10-08T19:20:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628dd66700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f62881015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628dd66700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f62881015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39432/0 (socket says 172.21.15.157:39432) 2021-10-08T19:20:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628dd66700 1 -- 172.21.15.157:0/4123845537 learned_addr learned my addr 172.21.15.157:0/4123845537 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628dd66700 1 -- 172.21.15.157:0/4123845537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6288101b20 con 0x7f6288070530 2021-10-08T19:20:31.138 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628dd66700 1 --2- 172.21.15.157:0/4123845537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f62881015e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f628400b5f0 tx=0x7f6284006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0317c31c0de3e60 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:31.138 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628cd64700 1 -- 172.21.15.157:0/4123845537 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62840106d0 con 0x7f6288070530 2021-10-08T19:20:31.138 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628cd64700 1 -- 172.21.15.157:0/4123845537 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f6284010c90 con 0x7f6288070530 2021-10-08T19:20:31.138 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.128+0000 7f628cd64700 1 -- 172.21.15.157:0/4123845537 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6284011c00 con 0x7f6288070530 2021-10-08T19:20:31.139 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.129+0000 7f628ffca700 1 -- 172.21.15.157:0/4123845537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 msgr2=0x7f62881015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:31.139 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.129+0000 7f628ffca700 1 --2- 172.21.15.157:0/4123845537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f62881015e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f628400b5f0 tx=0x7f6284006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:31.139 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.129+0000 7f628ffca700 1 -- 172.21.15.157:0/4123845537 shutdown_connections 2021-10-08T19:20:31.139 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.129+0000 7f628ffca700 1 --2- 172.21.15.157:0/4123845537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f62881015e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:31.140 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.129+0000 7f628ffca700 1 -- 172.21.15.157:0/4123845537 >> 172.21.15.157:0/4123845537 conn(0x7f62880f6c30 msgr2=0x7f62880f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:31.141 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.129+0000 7f628ffca700 1 -- 172.21.15.157:0/4123845537 shutdown_connections 2021-10-08T19:20:31.141 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.129+0000 7f628ffca700 1 -- 172.21.15.157:0/4123845537 wait complete. 2021-10-08T19:20:31.142 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628ffca700 1 Processor -- start 2021-10-08T19:20:31.142 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628ffca700 1 -- start start 2021-10-08T19:20:31.143 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628ffca700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f628810d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:31.143 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628ffca700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628810d930 con 0x7f6288070530 2021-10-08T19:20:31.144 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628dd66700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f628810d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:31.144 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628dd66700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f628810d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39434/0 (socket says 172.21.15.157:39434) 2021-10-08T19:20:31.144 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628dd66700 1 -- 172.21.15.157:0/3532639659 learned_addr learned my addr 172.21.15.157:0/3532639659 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:31.145 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628dd66700 1 -- 172.21.15.157:0/3532639659 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628400b200 con 0x7f6288070530 2021-10-08T19:20:31.145 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628dd66700 1 --2- 172.21.15.157:0/3532639659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f628810d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f628400bdc0 tx=0x7f6284006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:31.146 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f62767fc700 1 -- 172.21.15.157:0/3532639659 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6284011630 con 0x7f6288070530 2021-10-08T19:20:31.146 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f62767fc700 1 -- 172.21.15.157:0/3532639659 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f628401ba80 con 0x7f6288070530 2021-10-08T19:20:31.146 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628810db30 con 0x7f6288070530 2021-10-08T19:20:31.147 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f62767fc700 1 -- 172.21.15.157:0/3532639659 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62840237d0 con 0x7f6288070530 2021-10-08T19:20:31.147 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.130+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628810e7d0 con 0x7f6288070530 2021-10-08T19:20:31.147 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.131+0000 7f62767fc700 1 -- 172.21.15.157:0/3532639659 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7f628400f070 con 0x7f6288070530 2021-10-08T19:20:31.147 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.131+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628810dfc0 con 0x7f6288070530 2021-10-08T19:20:31.148 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.131+0000 7f62767fc700 1 --2- 172.21.15.157:0/3532639659 >> v2:172.21.15.157:6800/4161241346 conn(0x7f62700336b0 0x7f6270035b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:31.148 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.132+0000 7f62767fc700 1 -- 172.21.15.157:0/3532639659 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f6284046a40 con 0x7f6288070530 2021-10-08T19:20:31.148 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.132+0000 7f628d565700 1 --2- 172.21.15.157:0/3532639659 >> v2:172.21.15.157:6800/4161241346 conn(0x7f62700336b0 0x7f6270035b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:31.148 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.132+0000 7f628d565700 1 --2- 172.21.15.157:0/3532639659 >> v2:172.21.15.157:6800/4161241346 conn(0x7f62700336b0 0x7f6270035b60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f62780096a0 tx=0x7f6278006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:31.149 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.136+0000 7f62767fc700 1 -- 172.21.15.157:0/3532639659 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f628401ac20 con 0x7f6288070530 2021-10-08T19:20:31.295 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.293+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 --> v2:172.21.15.157:6800/4161241346 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f62881028a0 con 0x7f62700336b0 2021-10-08T19:20:31.679 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.677+0000 7f62767fc700 1 -- 172.21.15.157:0/3532639659 <== mgr.14118 v2:172.21.15.157:6800/4161241346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f62881028a0 con 0x7f62700336b0 2021-10-08T19:20:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.679+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 >> v2:172.21.15.157:6800/4161241346 conn(0x7f62700336b0 msgr2=0x7f6270035b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:31.682 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.679+0000 7f628ffca700 1 --2- 172.21.15.157:0/3532639659 >> v2:172.21.15.157:6800/4161241346 conn(0x7f62700336b0 0x7f6270035b60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f62780096a0 tx=0x7f6278006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:31.682 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.679+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 msgr2=0x7f628810d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:31.682 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.679+0000 7f628ffca700 1 --2- 172.21.15.157:0/3532639659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f628810d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f628400bdc0 tx=0x7f6284006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:31.683 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.679+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 shutdown_connections 2021-10-08T19:20:31.683 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.679+0000 7f628ffca700 1 --2- 172.21.15.157:0/3532639659 >> v2:172.21.15.157:6800/4161241346 conn(0x7f62700336b0 0x7f6270035b60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:31.683 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.679+0000 7f628ffca700 1 --2- 172.21.15.157:0/3532639659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6288070530 0x7f628810d3f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:31.683 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.679+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 >> 172.21.15.157:0/3532639659 conn(0x7f62880f6c30 msgr2=0x7f62880f79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:31.683 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.680+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 shutdown_connections 2021-10-08T19:20:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:31.680+0000 7f628ffca700 1 -- 172.21.15.157:0/3532639659 wait complete. 2021-10-08T19:20:32.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: Generating public/private rsa key pair. 2021-10-08T19:20:32.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: Your identification has been saved in /tmp/tmp099dsnur/key. 2021-10-08T19:20:32.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: Your public key has been saved in /tmp/tmp099dsnur/key.pub. 2021-10-08T19:20:32.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: The key fingerprint is: 2021-10-08T19:20:32.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: SHA256:RWoBNL16dSFxE7RENc4tix2syzaQcVxMR6hnBhHi3bQ ceph-906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:32.080 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: The key's randomart image is: 2021-10-08T19:20:32.080 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: +---[RSA 3072]----+ 2021-10-08T19:20:32.081 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: | .+o. ++XB*oo| 2021-10-08T19:20:32.081 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: | ..=.*oXo= | 2021-10-08T19:20:32.081 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: | o.+.=+E .| 2021-10-08T19:20:32.081 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: | ....+o+++ | 2021-10-08T19:20:32.081 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: | .S.o.o+o | 2021-10-08T19:20:32.082 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: | . . o . | 2021-10-08T19:20:32.082 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: | . = | 2021-10-08T19:20:32.082 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: | . . | 2021-10-08T19:20:32.082 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: | | 2021-10-08T19:20:32.083 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:31 smithi157 conmon[33269]: +----[SHA256]-----+ 2021-10-08T19:20:32.201 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf cephadm get-pub-key 2021-10-08T19:20:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.785+0000 7fb0fd2be700 1 Processor -- start 2021-10-08T19:20:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.785+0000 7fb0fd2be700 1 -- start start 2021-10-08T19:20:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.785+0000 7fb0fd2be700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f80fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.785+0000 7fb0fd2be700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f80fbc90 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.794 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.786+0000 7fb0f6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f80fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:32.794 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.786+0000 7fb0f6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f80fb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39438/0 (socket says 172.21.15.157:39438) 2021-10-08T19:20:32.794 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.786+0000 7fb0f6ffd700 1 -- 172.21.15.157:0/3016932198 learned_addr learned my addr 172.21.15.157:0/3016932198 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:32.794 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.786+0000 7fb0f6ffd700 1 -- 172.21.15.157:0/3016932198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80fbdd0 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.786+0000 7fb0f6ffd700 1 --2- 172.21.15.157:0/3016932198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f80fb6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009960 tx=0x7fb0e80092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfc4d54b28137ee server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:32.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.786+0000 7fb0f5ffb700 1 -- 172.21.15.157:0/3016932198 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0e800b860 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.786+0000 7fb0f5ffb700 1 -- 172.21.15.157:0/3016932198 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fb0e800be20 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.786+0000 7fb0f5ffb700 1 -- 172.21.15.157:0/3016932198 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0e8011cf0 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.796 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.787+0000 7fb0fd2be700 1 -- 172.21.15.157:0/3016932198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 msgr2=0x7fb0f80fb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:32.796 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.787+0000 7fb0fd2be700 1 --2- 172.21.15.157:0/3016932198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f80fb6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009960 tx=0x7fb0e80092d0 comp rx=0 tx=0).stop 2021-10-08T19:20:32.796 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.787+0000 7fb0fd2be700 1 -- 172.21.15.157:0/3016932198 shutdown_connections 2021-10-08T19:20:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.787+0000 7fb0fd2be700 1 --2- 172.21.15.157:0/3016932198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f80fb6c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.787+0000 7fb0fd2be700 1 -- 172.21.15.157:0/3016932198 >> 172.21.15.157:0/3016932198 conn(0x7fb0f80f6a20 msgr2=0x7fb0f80f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:32.798 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.787+0000 7fb0fd2be700 1 -- 172.21.15.157:0/3016932198 shutdown_connections 2021-10-08T19:20:32.798 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.787+0000 7fb0fd2be700 1 -- 172.21.15.157:0/3016932198 wait complete. 2021-10-08T19:20:32.798 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0fd2be700 1 Processor -- start 2021-10-08T19:20:32.798 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0fd2be700 1 -- start start 2021-10-08T19:20:32.799 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0fd2be700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f810af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:32.799 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0fd2be700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f810b490 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.799 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0f6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f810af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:32.799 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0f6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f810af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39440/0 (socket says 172.21.15.157:39440) 2021-10-08T19:20:32.800 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0f6ffd700 1 -- 172.21.15.157:0/2526041958 learned_addr learned my addr 172.21.15.157:0/2526041958 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:32.800 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0f6ffd700 1 -- 172.21.15.157:0/2526041958 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009570 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.800 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0f6ffd700 1 --2- 172.21.15.157:0/2526041958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f810af50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8011ea0 tx=0x7fb0e80092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:32.800 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0ef7fe700 1 -- 172.21.15.157:0/2526041958 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0e801a670 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.801 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0ef7fe700 1 -- 172.21.15.157:0/2526041958 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fb0e801ac30 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.801 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.788+0000 7fb0ef7fe700 1 -- 172.21.15.157:0/2526041958 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0e8022980 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.801 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.789+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f810b690 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.801 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.789+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f810c330 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.801 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.789+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f810bb20 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.802 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.790+0000 7fb0ef7fe700 1 -- 172.21.15.157:0/2526041958 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7fb0e802a070 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.802 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.790+0000 7fb0ef7fe700 1 --2- 172.21.15.157:0/2526041958 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb0d8033600 0x7fb0d8035ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:32.802 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.790+0000 7fb0ef7fe700 1 -- 172.21.15.157:0/2526041958 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fb0e8046290 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.802 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.790+0000 7fb0f67fc700 1 --2- 172.21.15.157:0/2526041958 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb0d8033600 0x7fb0d8035ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:32.803 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.791+0000 7fb0f67fc700 1 --2- 172.21.15.157:0/2526041958 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb0d8033600 0x7fb0d8035ab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00096a0 tx=0x7fb0e0006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:32.804 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.794+0000 7fb0ef7fe700 1 -- 172.21.15.157:0/2526041958 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fb0e801ada0 con 0x7fb0f80fb2b0 2021-10-08T19:20:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.952+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 --> v2:172.21.15.157:6800/4161241346 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0f80f7e30 con 0x7fb0d8033600 2021-10-08T19:20:32.955 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.953+0000 7fb0ef7fe700 1 -- 172.21.15.157:0/2526041958 <== mgr.14118 v2:172.21.15.157:6800/4161241346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fb0f80f7e30 con 0x7fb0d8033600 2021-10-08T19:20:32.955 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcCKL7KURkNC1cNPa0lXcCTQv33ACm+ns7YCQQ5T7OGHze4iBsUJopXO0CnZs4YacbCu2lFvfmEkKagIul7SV/glsamUDOpXCIPXnBfhnCsF4UQ1mwLlXD94+xE7jquTj2qt6KruC451Xumy65RuR82YBgS0YDJEPPQZJYjZBWtYdrV4h0UuNYKsm2SUo3xXGMFE7KGWq1XrhgKQu69hfBrkBUKjjQC72xcyc80AI/nAraQZF15iGx5rLhstVWT8YMeLh91wwlmqkMCtSsZ+q4bqXr3A0FPIYhSB8CIj06YqV/elSPUVXlywhcJZ/HbxPwRdQLhfOtKtbAHB8K+egRB13xbhbv5aJ9juQg+zlYybmqe15iX0W9+NiBumEIdMyJf+ZWaKYeb6lyD7/IGFD7rI/MwNmrIH6/8vQ+mT9BGLrbt80fdcLqTAf3C9snzlVEkhT7lK7qO9hYafdJ6QB7n6yuKbUYsxFejEOTMbmVIP/hGUhRVgPe+nnhhOqWcF8= ceph-906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:32.957 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.954+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb0d8033600 msgr2=0x7fb0d8035ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:32.957 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.954+0000 7fb0fd2be700 1 --2- 172.21.15.157:0/2526041958 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb0d8033600 0x7fb0d8035ab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00096a0 tx=0x7fb0e0006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:32.957 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.954+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 msgr2=0x7fb0f810af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:32.958 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.954+0000 7fb0fd2be700 1 --2- 172.21.15.157:0/2526041958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f810af50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8011ea0 tx=0x7fb0e80092d0 comp rx=0 tx=0).stop 2021-10-08T19:20:32.958 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.955+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 shutdown_connections 2021-10-08T19:20:32.958 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.955+0000 7fb0fd2be700 1 --2- 172.21.15.157:0/2526041958 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb0d8033600 0x7fb0d8035ab0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:32.958 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.955+0000 7fb0fd2be700 1 --2- 172.21.15.157:0/2526041958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0f80fb2b0 0x7fb0f810af50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:32.958 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.955+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 >> 172.21.15.157:0/2526041958 conn(0x7fb0f80f6a20 msgr2=0x7fb0f80f7720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:32.959 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.955+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 shutdown_connections 2021-10-08T19:20:32.959 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:32.955+0000 7fb0fd2be700 1 -- 172.21.15.157:0/2526041958 wait complete. 2021-10-08T19:20:32.976 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:32 smithi157 ceph-mon[32847]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:32.976 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:32 smithi157 ceph-mon[32847]: Generating ssh key... 2021-10-08T19:20:32.977 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:32 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:32.977 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:32 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2021-10-08T19:20:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:Adding key to root@localhost authorized_keys... 2021-10-08T19:20:33.511 INFO:teuthology.orchestra.run.smithi157.stderr:Adding host smithi157... 2021-10-08T19:20:33.511 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch host add smithi157 172.21.15.157 2021-10-08T19:20:34.110 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.105+0000 7fbaa5ae6700 1 Processor -- start 2021-10-08T19:20:34.111 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.105+0000 7fbaa5ae6700 1 -- start start 2021-10-08T19:20:34.111 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.105+0000 7fbaa5ae6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:34.111 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.105+0000 7fbaa5ae6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00fe5f0 con 0x7fbaa00fdc10 2021-10-08T19:20:34.112 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.106+0000 7fba9f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:34.112 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.106+0000 7fba9f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fe020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39444/0 (socket says 172.21.15.157:39444) 2021-10-08T19:20:34.112 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.106+0000 7fba9f7fe700 1 -- 172.21.15.157:0/1574366069 learned_addr learned my addr 172.21.15.157:0/1574366069 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:34.112 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.106+0000 7fba9f7fe700 1 -- 172.21.15.157:0/1574366069 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00fe730 con 0x7fbaa00fdc10 2021-10-08T19:20:34.112 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.106+0000 7fba9f7fe700 1 --2- 172.21.15.157:0/1574366069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fe020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba9000b5f0 tx=0x7fba90006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab01f3336e2778b server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:34.113 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.106+0000 7fba9effd700 1 -- 172.21.15.157:0/1574366069 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba900106d0 con 0x7fbaa00fdc10 2021-10-08T19:20:34.113 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.106+0000 7fba9effd700 1 -- 172.21.15.157:0/1574366069 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fba90010c90 con 0x7fbaa00fdc10 2021-10-08T19:20:34.113 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.106+0000 7fba9effd700 1 -- 172.21.15.157:0/1574366069 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba90011c00 con 0x7fbaa00fdc10 2021-10-08T19:20:34.113 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.107+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/1574366069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 msgr2=0x7fbaa00fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:34.114 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.107+0000 7fbaa5ae6700 1 --2- 172.21.15.157:0/1574366069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fe020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba9000b5f0 tx=0x7fba90006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:34.114 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.107+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/1574366069 shutdown_connections 2021-10-08T19:20:34.114 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.107+0000 7fbaa5ae6700 1 --2- 172.21.15.157:0/1574366069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fe020 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:34.114 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.107+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/1574366069 >> 172.21.15.157:0/1574366069 conn(0x7fbaa00f63a0 msgr2=0x7fbaa00f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:34.115 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.107+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/1574366069 shutdown_connections 2021-10-08T19:20:34.115 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.107+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/1574366069 wait complete. 2021-10-08T19:20:34.115 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.107+0000 7fbaa5ae6700 1 Processor -- start 2021-10-08T19:20:34.116 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fbaa5ae6700 1 -- start start 2021-10-08T19:20:34.116 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fbaa5ae6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:34.116 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fbaa5ae6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00fb960 con 0x7fbaa00fdc10 2021-10-08T19:20:34.116 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fba9f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:34.116 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fba9f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39446/0 (socket says 172.21.15.157:39446) 2021-10-08T19:20:34.117 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fba9f7fe700 1 -- 172.21.15.157:0/137584113 learned_addr learned my addr 172.21.15.157:0/137584113 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:34.117 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fba9f7fe700 1 -- 172.21.15.157:0/137584113 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9000b200 con 0x7fbaa00fdc10 2021-10-08T19:20:34.117 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fba9f7fe700 1 --2- 172.21.15.157:0/137584113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fd4e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fba9000b5c0 tx=0x7fba90006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:34.117 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fba9cff9700 1 -- 172.21.15.157:0/137584113 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba9001b620 con 0x7fbaa00fdc10 2021-10-08T19:20:34.118 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fba9cff9700 1 -- 172.21.15.157:0/137584113 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fba9001bbe0 con 0x7fbaa00fdc10 2021-10-08T19:20:34.118 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.108+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa00fbb60 con 0x7fbaa00fdc10 2021-10-08T19:20:34.118 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.109+0000 7fba9cff9700 1 -- 172.21.15.157:0/137584113 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba90023890 con 0x7fbaa00fdc10 2021-10-08T19:20:34.118 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.109+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa00fbff0 con 0x7fbaa00fdc10 2021-10-08T19:20:34.119 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.109+0000 7fba9cff9700 1 -- 172.21.15.157:0/137584113 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7fba9000f070 con 0x7fbaa00fdc10 2021-10-08T19:20:34.120 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.109+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa005a9f0 con 0x7fbaa00fdc10 2021-10-08T19:20:34.120 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.110+0000 7fba9cff9700 1 --2- 172.21.15.157:0/137584113 >> v2:172.21.15.157:6800/4161241346 conn(0x7fba80033650 0x7fba80035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:34.120 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.110+0000 7fba9cff9700 1 -- 172.21.15.157:0/137584113 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fba90046bc0 con 0x7fbaa00fdc10 2021-10-08T19:20:34.121 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.110+0000 7fba96ffd700 1 --2- 172.21.15.157:0/137584113 >> v2:172.21.15.157:6800/4161241346 conn(0x7fba80033650 0x7fba80035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:34.121 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.110+0000 7fba96ffd700 1 --2- 172.21.15.157:0/137584113 >> v2:172.21.15.157:6800/4161241346 conn(0x7fba80033650 0x7fba80035b00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba880096a0 tx=0x7fba88006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:34.121 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.115+0000 7fba9cff9700 1 -- 172.21.15.157:0/137584113 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fba9001b780 con 0x7fbaa00fdc10 2021-10-08T19:20:34.277 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:34.275+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 --> v2:172.21.15.157:6800/4161241346 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi157", "addr": "172.21.15.157", "target": ["mon-mgr", ""]}) v1 -- 0x7fbaa00fc230 con 0x7fba80033650 2021-10-08T19:20:34.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:34 smithi157 ceph-mon[32847]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:35.190 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: Added host 'smithi157' with addr '172.21.15.157' 2021-10-08T19:20:35.191 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.188+0000 7fba9cff9700 1 -- 172.21.15.157:0/137584113 <== mgr.14118 v2:172.21.15.157:6800/4161241346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fbaa00fc230 con 0x7fba80033650 2021-10-08T19:20:35.193 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 >> v2:172.21.15.157:6800/4161241346 conn(0x7fba80033650 msgr2=0x7fba80035b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:35.193 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 --2- 172.21.15.157:0/137584113 >> v2:172.21.15.157:6800/4161241346 conn(0x7fba80033650 0x7fba80035b00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba880096a0 tx=0x7fba88006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:35.193 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 msgr2=0x7fbaa00fd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:35.193 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 --2- 172.21.15.157:0/137584113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fd4e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fba9000b5c0 tx=0x7fba90006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:35.194 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 shutdown_connections 2021-10-08T19:20:35.194 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 --2- 172.21.15.157:0/137584113 >> v2:172.21.15.157:6800/4161241346 conn(0x7fba80033650 0x7fba80035b00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:35.194 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 --2- 172.21.15.157:0/137584113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaa00fdc10 0x7fbaa00fd4e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:35.194 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 >> 172.21.15.157:0/137584113 conn(0x7fbaa00f63a0 msgr2=0x7fbaa00f70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:35.194 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 shutdown_connections 2021-10-08T19:20:35.195 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:35.191+0000 7fbaa5ae6700 1 -- 172.21.15.157:0/137584113 wait complete. 2021-10-08T19:20:35.808 INFO:teuthology.orchestra.run.smithi157.stderr:Deploying unmanaged mon service... 2021-10-08T19:20:35.808 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch apply mon --unmanaged 2021-10-08T19:20:35.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:35 smithi157 ceph-mon[32847]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "addr": "172.21.15.157", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:35.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:35 smithi157 ceph-mon[32847]: poll took 7881.083 ms: 1 events 2021-10-08T19:20:35.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:35 smithi157 ceph-mon[32847]: Deploying cephadm binary to smithi157 2021-10-08T19:20:35.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:35 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:35.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:35 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:36.427 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.420+0000 7eff55ab7700 1 Processor -- start 2021-10-08T19:20:36.428 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.420+0000 7eff55ab7700 1 -- start start 2021-10-08T19:20:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.420+0000 7eff55ab7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff500febf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.420+0000 7eff55ab7700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500ff1c0 con 0x7eff500fe7e0 2021-10-08T19:20:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.420+0000 7eff4f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff500febf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.420+0000 7eff4f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff500febf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39460/0 (socket says 172.21.15.157:39460) 2021-10-08T19:20:36.431 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.420+0000 7eff4f7fe700 1 -- 172.21.15.157:0/825725627 learned_addr learned my addr 172.21.15.157:0/825725627 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:36.431 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff4f7fe700 1 -- 172.21.15.157:0/825725627 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500ff300 con 0x7eff500fe7e0 2021-10-08T19:20:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff4f7fe700 1 --2- 172.21.15.157:0/825725627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff500febf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff40009960 tx=0x7eff400092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1878a62ccfeab31 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff4e7fc700 1 -- 172.21.15.157:0/825725627 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff4000b860 con 0x7eff500fe7e0 2021-10-08T19:20:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff4e7fc700 1 -- 172.21.15.157:0/825725627 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7eff4000be20 con 0x7eff500fe7e0 2021-10-08T19:20:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff4e7fc700 1 -- 172.21.15.157:0/825725627 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff40011cf0 con 0x7eff500fe7e0 2021-10-08T19:20:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff55ab7700 1 -- 172.21.15.157:0/825725627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 msgr2=0x7eff500febf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff55ab7700 1 --2- 172.21.15.157:0/825725627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff500febf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff40009960 tx=0x7eff400092d0 comp rx=0 tx=0).stop 2021-10-08T19:20:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff55ab7700 1 -- 172.21.15.157:0/825725627 shutdown_connections 2021-10-08T19:20:36.435 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff55ab7700 1 --2- 172.21.15.157:0/825725627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff500febf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:36.435 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.421+0000 7eff55ab7700 1 -- 172.21.15.157:0/825725627 >> 172.21.15.157:0/825725627 conn(0x7eff50071e90 msgr2=0x7eff500722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.422+0000 7eff55ab7700 1 -- 172.21.15.157:0/825725627 shutdown_connections 2021-10-08T19:20:36.437 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.422+0000 7eff55ab7700 1 -- 172.21.15.157:0/825725627 wait complete. 2021-10-08T19:20:36.437 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.422+0000 7eff55ab7700 1 Processor -- start 2021-10-08T19:20:36.437 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.422+0000 7eff55ab7700 1 -- start start 2021-10-08T19:20:36.437 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.422+0000 7eff55ab7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff5010d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.422+0000 7eff55ab7700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5010d890 con 0x7eff500fe7e0 2021-10-08T19:20:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.422+0000 7eff4f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff5010d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.422+0000 7eff4f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff5010d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39462/0 (socket says 172.21.15.157:39462) 2021-10-08T19:20:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.422+0000 7eff4f7fe700 1 -- 172.21.15.157:0/3604391337 learned_addr learned my addr 172.21.15.157:0/3604391337 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:36.439 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.423+0000 7eff4f7fe700 1 -- 172.21.15.157:0/3604391337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff40009570 con 0x7eff500fe7e0 2021-10-08T19:20:36.439 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.423+0000 7eff4f7fe700 1 --2- 172.21.15.157:0/3604391337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff5010d350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff40011ea0 tx=0x7eff400092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:36.439 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.423+0000 7eff37fff700 1 -- 172.21.15.157:0/3604391337 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff4001a670 con 0x7eff500fe7e0 2021-10-08T19:20:36.439 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.423+0000 7eff37fff700 1 -- 172.21.15.157:0/3604391337 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7eff4001ac30 con 0x7eff500fe7e0 2021-10-08T19:20:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.423+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5010da90 con 0x7eff500fe7e0 2021-10-08T19:20:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.423+0000 7eff37fff700 1 -- 172.21.15.157:0/3604391337 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff40022980 con 0x7eff500fe7e0 2021-10-08T19:20:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.423+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5010e730 con 0x7eff500fe7e0 2021-10-08T19:20:36.441 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.424+0000 7eff37fff700 1 -- 172.21.15.157:0/3604391337 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7eff4002a070 con 0x7eff500fe7e0 2021-10-08T19:20:36.441 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.424+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5010df20 con 0x7eff500fe7e0 2021-10-08T19:20:36.441 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.424+0000 7eff37fff700 1 --2- 172.21.15.157:0/3604391337 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff3c033600 0x7eff3c035ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:36.441 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.424+0000 7eff37fff700 1 -- 172.21.15.157:0/3604391337 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7eff40046150 con 0x7eff500fe7e0 2021-10-08T19:20:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.424+0000 7eff4effd700 1 --2- 172.21.15.157:0/3604391337 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff3c033600 0x7eff3c035ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.425+0000 7eff4effd700 1 --2- 172.21.15.157:0/3604391337 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff3c033600 0x7eff3c035ab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7eff440096a0 tx=0x7eff44006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.428+0000 7eff37fff700 1 -- 172.21.15.157:0/3604391337 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7eff40010380 con 0x7eff500fe7e0 2021-10-08T19:20:36.617 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.616+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 --> v2:172.21.15.157:6800/4161241346 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7eff501006e0 con 0x7eff3c033600 2021-10-08T19:20:36.620 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.620+0000 7eff37fff700 1 -- 172.21.15.157:0/3604391337 <== mgr.14118 v2:172.21.15.157:6800/4161241346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7eff501006e0 con 0x7eff3c033600 2021-10-08T19:20:36.620 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: Scheduled mon update... 2021-10-08T19:20:36.623 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.621+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff3c033600 msgr2=0x7eff3c035ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:36.623 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.621+0000 7eff55ab7700 1 --2- 172.21.15.157:0/3604391337 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff3c033600 0x7eff3c035ab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7eff440096a0 tx=0x7eff44006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:36.623 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.621+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 msgr2=0x7eff5010d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:36.623 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.621+0000 7eff55ab7700 1 --2- 172.21.15.157:0/3604391337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff5010d350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff40011ea0 tx=0x7eff400092d0 comp rx=0 tx=0).stop 2021-10-08T19:20:36.624 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.621+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 shutdown_connections 2021-10-08T19:20:36.624 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.621+0000 7eff55ab7700 1 --2- 172.21.15.157:0/3604391337 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff3c033600 0x7eff3c035ab0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:36.624 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.621+0000 7eff55ab7700 1 --2- 172.21.15.157:0/3604391337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff500fe7e0 0x7eff5010d350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:36.624 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.621+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 >> 172.21.15.157:0/3604391337 conn(0x7eff50071e90 msgr2=0x7eff500fbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:36.625 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.622+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 shutdown_connections 2021-10-08T19:20:36.625 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:36.622+0000 7eff55ab7700 1 -- 172.21.15.157:0/3604391337 wait complete. 2021-10-08T19:20:36.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:36 smithi157 ceph-mon[32847]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.154 seconds 2021-10-08T19:20:36.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:36 smithi157 ceph-mon[32847]: Executing took 0.144 seconds 2021-10-08T19:20:36.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:36 smithi157 ceph-mon[32847]: Added host smithi157 2021-10-08T19:20:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:Deploying unmanaged mgr service... 2021-10-08T19:20:37.585 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch apply mgr --unmanaged 2021-10-08T19:20:37.869 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:37 smithi157 ceph-mon[32847]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:37.869 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:37 smithi157 ceph-mon[32847]: Saving service mon spec with placement count:5 2021-10-08T19:20:37.870 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:37 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:38.347 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.341+0000 7f91df757700 1 Processor -- start 2021-10-08T19:20:38.348 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.341+0000 7f91df757700 1 -- start start 2021-10-08T19:20:38.348 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.341+0000 7f91df757700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d80fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:38.348 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.341+0000 7f91df757700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80fd290 con 0x7f91d80fc8b0 2021-10-08T19:20:38.412 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.341+0000 7f91dd4f3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d80fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:38.412 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.342+0000 7f91dd4f3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d80fccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39466/0 (socket says 172.21.15.157:39466) 2021-10-08T19:20:38.412 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.342+0000 7f91dd4f3700 1 -- 172.21.15.157:0/843021686 learned_addr learned my addr 172.21.15.157:0/843021686 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.342+0000 7f91dd4f3700 1 -- 172.21.15.157:0/843021686 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d80fd3d0 con 0x7f91d80fc8b0 2021-10-08T19:20:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.342+0000 7f91dd4f3700 1 --2- 172.21.15.157:0/843021686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d80fccc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f91c800b5f0 tx=0x7f91c8006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fc94f2c53c7502 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.342+0000 7f91c7fff700 1 -- 172.21.15.157:0/843021686 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91c80106d0 con 0x7f91d80fc8b0 2021-10-08T19:20:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.342+0000 7f91c7fff700 1 -- 172.21.15.157:0/843021686 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f91c8010cb0 con 0x7f91d80fc8b0 2021-10-08T19:20:38.414 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.342+0000 7f91c7fff700 1 -- 172.21.15.157:0/843021686 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91c8011c30 con 0x7f91d80fc8b0 2021-10-08T19:20:38.414 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 -- 172.21.15.157:0/843021686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 msgr2=0x7f91d80fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:38.414 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 --2- 172.21.15.157:0/843021686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d80fccc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f91c800b5f0 tx=0x7f91c8006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:38.414 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 -- 172.21.15.157:0/843021686 shutdown_connections 2021-10-08T19:20:38.415 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 --2- 172.21.15.157:0/843021686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d80fccc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:38.415 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 -- 172.21.15.157:0/843021686 >> 172.21.15.157:0/843021686 conn(0x7f91d80f61c0 msgr2=0x7f91d80f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:38.415 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 -- 172.21.15.157:0/843021686 shutdown_connections 2021-10-08T19:20:38.415 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 -- 172.21.15.157:0/843021686 wait complete. 2021-10-08T19:20:38.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 Processor -- start 2021-10-08T19:20:38.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 -- start start 2021-10-08T19:20:38.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d810d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:38.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.343+0000 7f91df757700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d810d6e0 con 0x7f91d80fc8b0 2021-10-08T19:20:38.416 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91dd4f3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d810d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91dd4f3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d810d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39468/0 (socket says 172.21.15.157:39468) 2021-10-08T19:20:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91dd4f3700 1 -- 172.21.15.157:0/2434813098 learned_addr learned my addr 172.21.15.157:0/2434813098 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91dd4f3700 1 -- 172.21.15.157:0/2434813098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c800b200 con 0x7f91d80fc8b0 2021-10-08T19:20:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91dd4f3700 1 --2- 172.21.15.157:0/2434813098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d810d1a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91c8011040 tx=0x7f91c8006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91c5ffb700 1 -- 172.21.15.157:0/2434813098 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91c801b620 con 0x7f91d80fc8b0 2021-10-08T19:20:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91c5ffb700 1 -- 172.21.15.157:0/2434813098 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f91c801bc00 con 0x7f91d80fc8b0 2021-10-08T19:20:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d810d8e0 con 0x7f91d80fc8b0 2021-10-08T19:20:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d810e580 con 0x7f91d80fc8b0 2021-10-08T19:20:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.344+0000 7f91c5ffb700 1 -- 172.21.15.157:0/2434813098 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91c80238b0 con 0x7f91d80fc8b0 2021-10-08T19:20:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.345+0000 7f91c5ffb700 1 -- 172.21.15.157:0/2434813098 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7f91c800f070 con 0x7f91d80fc8b0 2021-10-08T19:20:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.345+0000 7f91c5ffb700 1 --2- 172.21.15.157:0/2434813098 >> v2:172.21.15.157:6800/4161241346 conn(0x7f91c0033650 0x7f91c0035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.345+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b8004de0 con 0x7f91d80fc8b0 2021-10-08T19:20:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.345+0000 7f91c5ffb700 1 -- 172.21.15.157:0/2434813098 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f91c8046b80 con 0x7f91d80fc8b0 2021-10-08T19:20:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.346+0000 7f91dccf2700 1 --2- 172.21.15.157:0/2434813098 >> v2:172.21.15.157:6800/4161241346 conn(0x7f91c0033650 0x7f91c0035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.346+0000 7f91dccf2700 1 --2- 172.21.15.157:0/2434813098 >> v2:172.21.15.157:6800/4161241346 conn(0x7f91c0033650 0x7f91c0035b00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f91d40096a0 tx=0x7f91d4006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:38.421 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.350+0000 7f91c5ffb700 1 -- 172.21.15.157:0/2434813098 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f91c8023b20 con 0x7f91d80fc8b0 2021-10-08T19:20:38.526 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.525+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 --> v2:172.21.15.157:6800/4161241346 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f91b8000bf0 con 0x7f91c0033650 2021-10-08T19:20:38.546 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.545+0000 7f91c5ffb700 1 -- 172.21.15.157:0/2434813098 <== mgr.14118 v2:172.21.15.157:6800/4161241346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f91b8000bf0 con 0x7f91c0033650 2021-10-08T19:20:38.547 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: Scheduled mgr update... 2021-10-08T19:20:38.549 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.547+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 >> v2:172.21.15.157:6800/4161241346 conn(0x7f91c0033650 msgr2=0x7f91c0035b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:38.549 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.547+0000 7f91df757700 1 --2- 172.21.15.157:0/2434813098 >> v2:172.21.15.157:6800/4161241346 conn(0x7f91c0033650 0x7f91c0035b00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f91d40096a0 tx=0x7f91d4006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:38.549 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.547+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 msgr2=0x7f91d810d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:38.550 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.547+0000 7f91df757700 1 --2- 172.21.15.157:0/2434813098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d810d1a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91c8011040 tx=0x7f91c8006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:38.550 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.547+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 shutdown_connections 2021-10-08T19:20:38.550 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.547+0000 7f91df757700 1 --2- 172.21.15.157:0/2434813098 >> v2:172.21.15.157:6800/4161241346 conn(0x7f91c0033650 0x7f91c0035b00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:38.550 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.547+0000 7f91df757700 1 --2- 172.21.15.157:0/2434813098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91d80fc8b0 0x7f91d810d1a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:38.550 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.547+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 >> 172.21.15.157:0/2434813098 conn(0x7f91d80f61c0 msgr2=0x7f91d80ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.548+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 shutdown_connections 2021-10-08T19:20:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:38.548+0000 7f91df757700 1 -- 172.21.15.157:0/2434813098 wait complete. 2021-10-08T19:20:39.196 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config set mgr mgr/cephadm/container_init True --force 2021-10-08T19:20:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: poll took 2199.266 ms: 1 events 2021-10-08T19:20:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:39.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:20:39.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi157", "caps": []}]: dispatch 2021-10-08T19:20:39.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi157", "caps": []}]': finished 2021-10-08T19:20:39.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: Deploying daemon agent.smithi157 on smithi157 2021-10-08T19:20:39.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:39.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: Saving service mgr spec with placement count:2 2021-10-08T19:20:39.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: from='mgr.14118 172.21.15.157:0/1398004799' entity='mgr.y' 2021-10-08T19:20:39.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:38 smithi157 ceph-mon[32847]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.172 seconds 2021-10-08T19:20:39.811 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.806+0000 7fb8ca922700 1 Processor -- start 2021-10-08T19:20:39.812 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.806+0000 7fb8ca922700 1 -- start start 2021-10-08T19:20:39.813 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.806+0000 7fb8ca922700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c40facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:39.813 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.806+0000 7fb8ca922700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40fb2c0 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.813 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.806+0000 7fb8c3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c40facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:39.814 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.806+0000 7fb8c3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c40facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39472/0 (socket says 172.21.15.157:39472) 2021-10-08T19:20:39.814 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.806+0000 7fb8c3fff700 1 -- 172.21.15.157:0/478822033 learned_addr learned my addr 172.21.15.157:0/478822033 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:39.814 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.807+0000 7fb8c3fff700 1 -- 172.21.15.157:0/478822033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40fb400 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.814 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.807+0000 7fb8c3fff700 1 --2- 172.21.15.157:0/478822033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c40facf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400b5f0 tx=0x7fb8b4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abde962c95537d4 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:39.814 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.807+0000 7fb8c2ffd700 1 -- 172.21.15.157:0/478822033 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8b40106d0 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.807+0000 7fb8c2ffd700 1 -- 172.21.15.157:0/478822033 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fb8b4010cb0 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.807+0000 7fb8c2ffd700 1 -- 172.21.15.157:0/478822033 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8b4011c30 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 -- 172.21.15.157:0/478822033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 msgr2=0x7fb8c40facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 --2- 172.21.15.157:0/478822033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c40facf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400b5f0 tx=0x7fb8b4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:39.816 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 -- 172.21.15.157:0/478822033 shutdown_connections 2021-10-08T19:20:39.816 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 --2- 172.21.15.157:0/478822033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c40facf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:39.816 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 -- 172.21.15.157:0/478822033 >> 172.21.15.157:0/478822033 conn(0x7fb8c40f63a0 msgr2=0x7fb8c40f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:39.816 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 -- 172.21.15.157:0/478822033 shutdown_connections 2021-10-08T19:20:39.817 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 -- 172.21.15.157:0/478822033 wait complete. 2021-10-08T19:20:39.817 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 Processor -- start 2021-10-08T19:20:39.817 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 -- start start 2021-10-08T19:20:39.817 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c410b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:39.818 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.808+0000 7fb8ca922700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c410b6f0 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.818 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8c3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c410b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:39.818 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8c3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c410b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39474/0 (socket says 172.21.15.157:39474) 2021-10-08T19:20:39.819 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8c3fff700 1 -- 172.21.15.157:0/397211473 learned_addr learned my addr 172.21.15.157:0/397211473 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:39.819 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8c3fff700 1 -- 172.21.15.157:0/397211473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b400b200 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.819 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8c3fff700 1 --2- 172.21.15.157:0/397211473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c410b1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011040 tx=0x7fb8b4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:39.819 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8c0ff9700 1 -- 172.21.15.157:0/397211473 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8b401b620 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c410b8f0 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8c0ff9700 1 -- 172.21.15.157:0/397211473 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fb8b401bc00 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8c0ff9700 1 -- 172.21.15.157:0/397211473 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8b40238b0 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.809+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c410c590 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.810+0000 7fb8c0ff9700 1 -- 172.21.15.157:0/397211473 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7fb8b400f070 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.821 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.810+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c410bd80 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.821 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.810+0000 7fb8c0ff9700 1 --2- 172.21.15.157:0/397211473 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb8b0033600 0x7fb8b0035ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:39.821 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.810+0000 7fb8c0ff9700 1 -- 172.21.15.157:0/397211473 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fb8b4046c60 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.822 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.810+0000 7fb8c37fe700 1 --2- 172.21.15.157:0/397211473 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb8b0033600 0x7fb8b0035ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:39.822 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.811+0000 7fb8c37fe700 1 --2- 172.21.15.157:0/397211473 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb8b0033600 0x7fb8b0035ab0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80096a0 tx=0x7fb8b8006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:39.822 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.815+0000 7fb8c0ff9700 1 -- 172.21.15.157:0/397211473 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fb8b402bd60 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.974 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.972+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fb8c405a9f0 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.976 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.975+0000 7fb8c0ff9700 1 -- 172.21.15.157:0/397211473 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fb8b402bb80 con 0x7fb8c40fa8e0 2021-10-08T19:20:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb8b0033600 msgr2=0x7fb8b0035ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 --2- 172.21.15.157:0/397211473 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb8b0033600 0x7fb8b0035ab0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80096a0 tx=0x7fb8b8006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 msgr2=0x7fb8c410b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 --2- 172.21.15.157:0/397211473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c410b1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011040 tx=0x7fb8b4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:39.980 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 shutdown_connections 2021-10-08T19:20:39.980 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 --2- 172.21.15.157:0/397211473 >> v2:172.21.15.157:6800/4161241346 conn(0x7fb8b0033600 0x7fb8b0035ab0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:39.980 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 --2- 172.21.15.157:0/397211473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8c40fa8e0 0x7fb8c410b1b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:39.980 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 >> 172.21.15.157:0/397211473 conn(0x7fb8c40f63a0 msgr2=0x7fb8c40f70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:39.981 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 shutdown_connections 2021-10-08T19:20:39.981 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:39.977+0000 7fb8ca922700 1 -- 172.21.15.157:0/397211473 wait complete. 2021-10-08T19:20:40.486 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config set mgr mgr/dashboard/ssl_server_port 8443 2021-10-08T19:20:41.069 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.063+0000 7fea73bcc700 1 Processor -- start 2021-10-08T19:20:41.069 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.063+0000 7fea73bcc700 1 -- start start 2021-10-08T19:20:41.070 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.063+0000 7fea73bcc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:41.070 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.063+0000 7fea73bcc700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c072940 con 0x7fea6c072530 2021-10-08T19:20:41.070 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.064+0000 7fea71968700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:41.070 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.064+0000 7fea71968700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39478/0 (socket says 172.21.15.157:39478) 2021-10-08T19:20:41.071 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.064+0000 7fea71968700 1 -- 172.21.15.157:0/4052881230 learned_addr learned my addr 172.21.15.157:0/4052881230 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:41.071 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.064+0000 7fea71968700 1 -- 172.21.15.157:0/4052881230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c071010 con 0x7fea6c072530 2021-10-08T19:20:41.071 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.064+0000 7fea71968700 1 --2- 172.21.15.157:0/4052881230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c070ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b5f0 tx=0x7fea5c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaf53e2a29eebe3 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:41.072 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.064+0000 7fea70966700 1 -- 172.21.15.157:0/4052881230 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea5c0106d0 con 0x7fea6c072530 2021-10-08T19:20:41.072 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.064+0000 7fea70966700 1 -- 172.21.15.157:0/4052881230 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fea5c010cb0 con 0x7fea6c072530 2021-10-08T19:20:41.072 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.064+0000 7fea70966700 1 -- 172.21.15.157:0/4052881230 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea5c011c30 con 0x7fea6c072530 2021-10-08T19:20:41.072 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.065+0000 7fea73bcc700 1 -- 172.21.15.157:0/4052881230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 msgr2=0x7fea6c070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:41.072 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.065+0000 7fea73bcc700 1 --2- 172.21.15.157:0/4052881230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c070ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b5f0 tx=0x7fea5c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:41.073 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.065+0000 7fea73bcc700 1 -- 172.21.15.157:0/4052881230 shutdown_connections 2021-10-08T19:20:41.073 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.065+0000 7fea73bcc700 1 --2- 172.21.15.157:0/4052881230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c070ad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:41.073 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.065+0000 7fea73bcc700 1 -- 172.21.15.157:0/4052881230 >> 172.21.15.157:0/4052881230 conn(0x7fea6c0f7bd0 msgr2=0x7fea6c0f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:41.073 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.065+0000 7fea73bcc700 1 -- 172.21.15.157:0/4052881230 shutdown_connections 2021-10-08T19:20:41.074 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.065+0000 7fea73bcc700 1 -- 172.21.15.157:0/4052881230 wait complete. 2021-10-08T19:20:41.074 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.065+0000 7fea73bcc700 1 Processor -- start 2021-10-08T19:20:41.074 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.065+0000 7fea73bcc700 1 -- start start 2021-10-08T19:20:41.075 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea73bcc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c10d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:41.075 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea73bcc700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c10d6c0 con 0x7fea6c072530 2021-10-08T19:20:41.075 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea71968700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c10d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:41.076 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea71968700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c10d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39480/0 (socket says 172.21.15.157:39480) 2021-10-08T19:20:41.076 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea71968700 1 -- 172.21.15.157:0/597586149 learned_addr learned my addr 172.21.15.157:0/597586149 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:41.076 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea71968700 1 -- 172.21.15.157:0/597586149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c00b200 con 0x7fea6c072530 2021-10-08T19:20:41.076 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea71968700 1 --2- 172.21.15.157:0/597586149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c10d180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b1d0 tx=0x7fea5c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:41.077 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea6a7fc700 1 -- 172.21.15.157:0/597586149 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea5c01b620 con 0x7fea6c072530 2021-10-08T19:20:41.077 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea6a7fc700 1 -- 172.21.15.157:0/597586149 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fea5c01bc00 con 0x7fea6c072530 2021-10-08T19:20:41.077 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c10d8c0 con 0x7fea6c072530 2021-10-08T19:20:41.077 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea6a7fc700 1 -- 172.21.15.157:0/597586149 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea5c0238a0 con 0x7fea6c072530 2021-10-08T19:20:41.077 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.066+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c10e560 con 0x7fea6c072530 2021-10-08T19:20:41.078 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.067+0000 7fea6a7fc700 1 -- 172.21.15.157:0/597586149 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7fea5c00f070 con 0x7fea6c072530 2021-10-08T19:20:41.078 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.067+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c10dd50 con 0x7fea6c072530 2021-10-08T19:20:41.078 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.067+0000 7fea6a7fc700 1 --2- 172.21.15.157:0/597586149 >> v2:172.21.15.157:6800/4161241346 conn(0x7fea58033650 0x7fea58035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:41.078 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.067+0000 7fea6a7fc700 1 -- 172.21.15.157:0/597586149 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fea5c046ae0 con 0x7fea6c072530 2021-10-08T19:20:41.079 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.068+0000 7fea71167700 1 --2- 172.21.15.157:0/597586149 >> v2:172.21.15.157:6800/4161241346 conn(0x7fea58033650 0x7fea58035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:41.079 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.068+0000 7fea71167700 1 --2- 172.21.15.157:0/597586149 >> v2:172.21.15.157:6800/4161241346 conn(0x7fea58033650 0x7fea58035b00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fea600096a0 tx=0x7fea60006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:41.079 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.072+0000 7fea6a7fc700 1 -- 172.21.15.157:0/597586149 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fea5c023400 con 0x7fea6c072530 2021-10-08T19:20:41.231 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.231+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fea6c102760 con 0x7fea6c072530 2021-10-08T19:20:41.234 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.233+0000 7fea6a7fc700 1 -- 172.21.15.157:0/597586149 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fea6c102760 con 0x7fea6c072530 2021-10-08T19:20:41.237 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.235+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 >> v2:172.21.15.157:6800/4161241346 conn(0x7fea58033650 msgr2=0x7fea58035b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:41.237 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.235+0000 7fea73bcc700 1 --2- 172.21.15.157:0/597586149 >> v2:172.21.15.157:6800/4161241346 conn(0x7fea58033650 0x7fea58035b00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fea600096a0 tx=0x7fea60006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:41.237 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.235+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 msgr2=0x7fea6c10d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:41.238 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.235+0000 7fea73bcc700 1 --2- 172.21.15.157:0/597586149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c10d180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b1d0 tx=0x7fea5c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:41.238 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.236+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 shutdown_connections 2021-10-08T19:20:41.238 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.236+0000 7fea73bcc700 1 --2- 172.21.15.157:0/597586149 >> v2:172.21.15.157:6800/4161241346 conn(0x7fea58033650 0x7fea58035b00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.236+0000 7fea73bcc700 1 --2- 172.21.15.157:0/597586149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea6c072530 0x7fea6c10d180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.236+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 >> 172.21.15.157:0/597586149 conn(0x7fea6c0f7bd0 msgr2=0x7fea6c0f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.236+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 shutdown_connections 2021-10-08T19:20:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:41.236+0000 7fea73bcc700 1 -- 172.21.15.157:0/597586149 wait complete. 2021-10-08T19:20:41.268 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/397211473' entity='client.admin' 2021-10-08T19:20:41.766 INFO:teuthology.orchestra.run.smithi157.stderr:Enabling the dashboard module... 2021-10-08T19:20:41.766 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr module enable dashboard 2021-10-08T19:20:42.368 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.363+0000 7f0e49c19700 1 Processor -- start 2021-10-08T19:20:42.368 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.363+0000 7f0e49c19700 1 -- start start 2021-10-08T19:20:42.368 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.363+0000 7f0e49c19700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.363+0000 7f0e49c19700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e440ff7b0 con 0x7f0e44070530 2021-10-08T19:20:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.363+0000 7f0e437fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.363+0000 7f0e437fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39484/0 (socket says 172.21.15.157:39484) 2021-10-08T19:20:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.363+0000 7f0e437fe700 1 -- 172.21.15.157:0/3076022104 learned_addr learned my addr 172.21.15.157:0/3076022104 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:42.370 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.364+0000 7f0e437fe700 1 -- 172.21.15.157:0/3076022104 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440ff8f0 con 0x7f0e44070530 2021-10-08T19:20:42.370 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.364+0000 7f0e437fe700 1 --2- 172.21.15.157:0/3076022104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440ff1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400b5f0 tx=0x7f0e34006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e0ba223036d73d server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:42.370 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.364+0000 7f0e427fc700 1 -- 172.21.15.157:0/3076022104 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e340106d0 con 0x7f0e44070530 2021-10-08T19:20:42.370 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.364+0000 7f0e427fc700 1 -- 172.21.15.157:0/3076022104 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f0e34010cb0 con 0x7f0e44070530 2021-10-08T19:20:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.364+0000 7f0e427fc700 1 -- 172.21.15.157:0/3076022104 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e34011c30 con 0x7f0e44070530 2021-10-08T19:20:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.364+0000 7f0e49c19700 1 -- 172.21.15.157:0/3076022104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 msgr2=0x7f0e440ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.364+0000 7f0e49c19700 1 --2- 172.21.15.157:0/3076022104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440ff1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400b5f0 tx=0x7f0e34006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.364+0000 7f0e49c19700 1 -- 172.21.15.157:0/3076022104 shutdown_connections 2021-10-08T19:20:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.364+0000 7f0e49c19700 1 --2- 172.21.15.157:0/3076022104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440ff1e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.365+0000 7f0e49c19700 1 -- 172.21.15.157:0/3076022104 >> 172.21.15.157:0/3076022104 conn(0x7f0e440f6c30 msgr2=0x7f0e440f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.365+0000 7f0e49c19700 1 -- 172.21.15.157:0/3076022104 shutdown_connections 2021-10-08T19:20:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.365+0000 7f0e49c19700 1 -- 172.21.15.157:0/3076022104 wait complete. 2021-10-08T19:20:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.365+0000 7f0e49c19700 1 Processor -- start 2021-10-08T19:20:42.373 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.365+0000 7f0e49c19700 1 -- start start 2021-10-08T19:20:42.373 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.365+0000 7f0e49c19700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:42.373 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.365+0000 7f0e49c19700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e440fb0e0 con 0x7f0e44070530 2021-10-08T19:20:42.373 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.365+0000 7f0e437fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:42.373 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.366+0000 7f0e437fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440fcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39486/0 (socket says 172.21.15.157:39486) 2021-10-08T19:20:42.374 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.366+0000 7f0e437fe700 1 -- 172.21.15.157:0/893161609 learned_addr learned my addr 172.21.15.157:0/893161609 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:42.374 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.366+0000 7f0e437fe700 1 -- 172.21.15.157:0/893161609 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3400b200 con 0x7f0e44070530 2021-10-08T19:20:42.374 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.366+0000 7f0e437fe700 1 --2- 172.21.15.157:0/893161609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440fcc60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400b1d0 tx=0x7f0e34006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:42.374 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.366+0000 7f0e2bfff700 1 -- 172.21.15.157:0/893161609 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e3401b620 con 0x7f0e44070530 2021-10-08T19:20:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.366+0000 7f0e2bfff700 1 -- 172.21.15.157:0/893161609 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f0e3401bc00 con 0x7f0e44070530 2021-10-08T19:20:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.366+0000 7f0e2bfff700 1 -- 172.21.15.157:0/893161609 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e340238a0 con 0x7f0e44070530 2021-10-08T19:20:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.366+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e440fb2e0 con 0x7f0e44070530 2021-10-08T19:20:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.366+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e440fb770 con 0x7f0e44070530 2021-10-08T19:20:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.367+0000 7f0e2bfff700 1 -- 172.21.15.157:0/893161609 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 40462+0+0 (secure 0 0 0) 0x7f0e3400f070 con 0x7f0e44070530 2021-10-08T19:20:42.376 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.367+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4405a9f0 con 0x7f0e44070530 2021-10-08T19:20:42.376 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.367+0000 7f0e2bfff700 1 --2- 172.21.15.157:0/893161609 >> v2:172.21.15.157:6800/4161241346 conn(0x7f0e30033650 0x7f0e30035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:42.376 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.367+0000 7f0e2bfff700 1 -- 172.21.15.157:0/893161609 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f0e34046af0 con 0x7f0e44070530 2021-10-08T19:20:42.376 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.367+0000 7f0e42ffd700 1 --2- 172.21.15.157:0/893161609 >> v2:172.21.15.157:6800/4161241346 conn(0x7f0e30033650 0x7f0e30035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:42.377 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.368+0000 7f0e42ffd700 1 --2- 172.21.15.157:0/893161609 >> v2:172.21.15.157:6800/4161241346 conn(0x7f0e30033650 0x7f0e30035b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0e380096a0 tx=0x7f0e38006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:42.377 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.371+0000 7f0e2bfff700 1 -- 172.21.15.157:0/893161609 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f0e3402b570 con 0x7f0e44070530 2021-10-08T19:20:42.571 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:42.570+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f0e441007a0 con 0x7f0e44070530 2021-10-08T19:20:42.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/597586149' entity='client.admin' 2021-10-08T19:20:43.238 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.237+0000 7f0e2bfff700 1 -- 172.21.15.157:0/893161609 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 9) v1 ==== 40475+0+0 (secure 0 0 0) 0x7f0e3402d4a0 con 0x7f0e44070530 2021-10-08T19:20:43.239 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.238+0000 7f0e2bfff700 1 -- 172.21.15.157:0/893161609 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f0e3401a810 con 0x7f0e44070530 2021-10-08T19:20:43.242 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.240+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 >> v2:172.21.15.157:6800/4161241346 conn(0x7f0e30033650 msgr2=0x7f0e30035b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:43.242 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.240+0000 7f0e49c19700 1 --2- 172.21.15.157:0/893161609 >> v2:172.21.15.157:6800/4161241346 conn(0x7f0e30033650 0x7f0e30035b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0e380096a0 tx=0x7f0e38006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:43.242 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.240+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 msgr2=0x7f0e440fcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:43.243 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.240+0000 7f0e49c19700 1 --2- 172.21.15.157:0/893161609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440fcc60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400b1d0 tx=0x7f0e34006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:43.243 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.240+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 shutdown_connections 2021-10-08T19:20:43.243 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.240+0000 7f0e49c19700 1 --2- 172.21.15.157:0/893161609 >> v2:172.21.15.157:6800/4161241346 conn(0x7f0e30033650 0x7f0e30035b00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:43.243 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.240+0000 7f0e49c19700 1 --2- 172.21.15.157:0/893161609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e44070530 0x7f0e440fcc60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:43.244 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.240+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 >> 172.21.15.157:0/893161609 conn(0x7f0e440f6c30 msgr2=0x7f0e440f79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:43.244 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.240+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 shutdown_connections 2021-10-08T19:20:43.244 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:43.241+0000 7f0e49c19700 1 -- 172.21.15.157:0/893161609 wait complete. 2021-10-08T19:20:43.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/893161609' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-10-08T19:20:43.579 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:43 smithi157 conmon[33269]: ignoring --setuser ceph since I am not root 2021-10-08T19:20:43.579 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:43 smithi157 conmon[33269]: ignoring --setgroup ceph since I am not root 2021-10-08T19:20:43.896 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr stat 2021-10-08T19:20:44.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/893161609' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-10-08T19:20:44.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:44 smithi157 ceph-mon[32847]: mgrmap e9: y(active, since 16s) 2021-10-08T19:20:44.591 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.588+0000 7eff28a39700 1 Processor -- start 2021-10-08T19:20:44.591 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.588+0000 7eff28a39700 1 -- start start 2021-10-08T19:20:44.592 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.588+0000 7eff28a39700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff240fee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:44.592 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.588+0000 7eff28a39700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff240ff3e0 con 0x7eff24070510 2021-10-08T19:20:44.592 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.589+0000 7eff237fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff240fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:44.592 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.589+0000 7eff237fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff240fee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39500/0 (socket says 172.21.15.157:39500) 2021-10-08T19:20:44.593 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.589+0000 7eff237fe700 1 -- 172.21.15.157:0/1087358642 learned_addr learned my addr 172.21.15.157:0/1087358642 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:44.593 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.589+0000 7eff237fe700 1 -- 172.21.15.157:0/1087358642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff240ff520 con 0x7eff24070510 2021-10-08T19:20:44.593 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.589+0000 7eff237fe700 1 --2- 172.21.15.157:0/1087358642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff240fee10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff1800b5f0 tx=0x7eff18006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9018fa266f70b25 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:44.593 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.589+0000 7eff227fc700 1 -- 172.21.15.157:0/1087358642 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff180106d0 con 0x7eff24070510 2021-10-08T19:20:44.593 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.589+0000 7eff227fc700 1 -- 172.21.15.157:0/1087358642 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7eff18010cb0 con 0x7eff24070510 2021-10-08T19:20:44.594 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.589+0000 7eff227fc700 1 -- 172.21.15.157:0/1087358642 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff18011c30 con 0x7eff24070510 2021-10-08T19:20:44.594 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.590+0000 7eff28a39700 1 -- 172.21.15.157:0/1087358642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 msgr2=0x7eff240fee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:44.594 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.590+0000 7eff28a39700 1 --2- 172.21.15.157:0/1087358642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff240fee10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff1800b5f0 tx=0x7eff18006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:44.594 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.590+0000 7eff28a39700 1 -- 172.21.15.157:0/1087358642 shutdown_connections 2021-10-08T19:20:44.595 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.590+0000 7eff28a39700 1 --2- 172.21.15.157:0/1087358642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff240fee10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:44.595 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.590+0000 7eff28a39700 1 -- 172.21.15.157:0/1087358642 >> 172.21.15.157:0/1087358642 conn(0x7eff240f68a0 msgr2=0x7eff240f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:44.595 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.590+0000 7eff28a39700 1 -- 172.21.15.157:0/1087358642 shutdown_connections 2021-10-08T19:20:44.595 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.590+0000 7eff28a39700 1 -- 172.21.15.157:0/1087358642 wait complete. 2021-10-08T19:20:44.596 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.591+0000 7eff28a39700 1 Processor -- start 2021-10-08T19:20:44.598 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.591+0000 7eff28a39700 1 -- start start 2021-10-08T19:20:44.598 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.591+0000 7eff28a39700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff2410ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:44.598 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.591+0000 7eff28a39700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2410b340 con 0x7eff24070510 2021-10-08T19:20:44.599 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.591+0000 7eff237fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff2410ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:44.599 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.591+0000 7eff237fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff2410ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39502/0 (socket says 172.21.15.157:39502) 2021-10-08T19:20:44.599 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.591+0000 7eff237fe700 1 -- 172.21.15.157:0/3213348203 learned_addr learned my addr 172.21.15.157:0/3213348203 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:44.599 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.592+0000 7eff237fe700 1 -- 172.21.15.157:0/3213348203 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1800b200 con 0x7eff24070510 2021-10-08T19:20:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.592+0000 7eff237fe700 1 --2- 172.21.15.157:0/3213348203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff2410ae00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff18011040 tx=0x7eff18006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.592+0000 7eff0bfff700 1 -- 172.21.15.157:0/3213348203 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1801b620 con 0x7eff24070510 2021-10-08T19:20:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.592+0000 7eff0bfff700 1 -- 172.21.15.157:0/3213348203 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7eff1801bc00 con 0x7eff24070510 2021-10-08T19:20:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.592+0000 7eff0bfff700 1 -- 172.21.15.157:0/3213348203 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff180238b0 con 0x7eff24070510 2021-10-08T19:20:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.592+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2410b540 con 0x7eff24070510 2021-10-08T19:20:44.601 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.592+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2410c100 con 0x7eff24070510 2021-10-08T19:20:44.601 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.593+0000 7eff0bfff700 1 -- 172.21.15.157:0/3213348203 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 9) v1 ==== 40475+0+0 (secure 0 0 0) 0x7eff1800f070 con 0x7eff24070510 2021-10-08T19:20:44.601 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.593+0000 7eff0bfff700 1 --2- 172.21.15.157:0/3213348203 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff100336b0 0x7eff10035b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:44.601 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.593+0000 7eff0bfff700 1 -- 172.21.15.157:0/3213348203 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7eff18046c30 con 0x7eff24070510 2021-10-08T19:20:44.602 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.593+0000 7eff22ffd700 1 -- 172.21.15.157:0/3213348203 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff100336b0 msgr2=0x7eff10035b60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/4161241346 2021-10-08T19:20:44.602 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.593+0000 7eff22ffd700 1 --2- 172.21.15.157:0/3213348203 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff100336b0 0x7eff10035b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:20:44.602 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.594+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2405a9f0 con 0x7eff24070510 2021-10-08T19:20:44.603 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.599+0000 7eff0bfff700 1 -- 172.21.15.157:0/3213348203 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7eff1802bb30 con 0x7eff24070510 2021-10-08T19:20:44.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.794+0000 7eff22ffd700 1 -- 172.21.15.157:0/3213348203 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff100336b0 msgr2=0x7eff10035b60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/4161241346 2021-10-08T19:20:44.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.794+0000 7eff22ffd700 1 --2- 172.21.15.157:0/3213348203 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff100336b0 0x7eff10035b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:20:44.864 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.862+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7eff24100390 con 0x7eff24070510 2021-10-08T19:20:44.865 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.863+0000 7eff0bfff700 1 -- 172.21.15.157:0/3213348203 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7eff1801b780 con 0x7eff24070510 2021-10-08T19:20:44.865 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: { 2021-10-08T19:20:44.866 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "epoch": 9, 2021-10-08T19:20:44.866 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "available": true, 2021-10-08T19:20:44.866 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "active_name": "y", 2021-10-08T19:20:44.867 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "num_standby": 0 2021-10-08T19:20:44.867 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: } 2021-10-08T19:20:44.868 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff100336b0 msgr2=0x7eff10035b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:20:44.869 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 --2- 172.21.15.157:0/3213348203 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff100336b0 0x7eff10035b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:44.869 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 msgr2=0x7eff2410ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:44.869 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 --2- 172.21.15.157:0/3213348203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff2410ae00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff18011040 tx=0x7eff18006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:44.869 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 shutdown_connections 2021-10-08T19:20:44.870 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 --2- 172.21.15.157:0/3213348203 >> v2:172.21.15.157:6800/4161241346 conn(0x7eff100336b0 0x7eff10035b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:44.870 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 --2- 172.21.15.157:0/3213348203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff24070510 0x7eff2410ae00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:44.870 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 >> 172.21.15.157:0/3213348203 conn(0x7eff240f68a0 msgr2=0x7eff240f75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:44.870 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 shutdown_connections 2021-10-08T19:20:44.871 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:44.865+0000 7eff28a39700 1 -- 172.21.15.157:0/3213348203 wait complete. 2021-10-08T19:20:45.429 INFO:teuthology.orchestra.run.smithi157.stderr:Waiting for the mgr to restart... 2021-10-08T19:20:45.429 INFO:teuthology.orchestra.run.smithi157.stderr:Waiting for mgr epoch 9... 2021-10-08T19:20:45.430 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf tell mgr mgr_status 2021-10-08T19:20:45.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3213348203' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-10-08T19:20:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.030+0000 7f1be7495700 1 Processor -- start 2021-10-08T19:20:46.036 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.030+0000 7f1be7495700 1 -- start start 2021-10-08T19:20:46.036 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.030+0000 7f1be7495700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be0070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.030+0000 7f1be7495700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0072940 con 0x7f1be0072530 2021-10-08T19:20:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.031+0000 7f1be5231700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be0070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.031+0000 7f1be5231700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be0070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39510/0 (socket says 172.21.15.157:39510) 2021-10-08T19:20:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.031+0000 7f1be5231700 1 -- 172.21.15.157:0/1256526624 learned_addr learned my addr 172.21.15.157:0/1256526624 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.031+0000 7f1be5231700 1 -- 172.21.15.157:0/1256526624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0071010 con 0x7f1be0072530 2021-10-08T19:20:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.031+0000 7f1be5231700 1 --2- 172.21.15.157:0/1256526624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be0070ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000b5f0 tx=0x7f1bd0006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3200aa6acba1326 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.031+0000 7f1bcffff700 1 -- 172.21.15.157:0/1256526624 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00106d0 con 0x7f1be0072530 2021-10-08T19:20:46.039 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.031+0000 7f1bcffff700 1 -- 172.21.15.157:0/1256526624 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f1bd0010cb0 con 0x7f1be0072530 2021-10-08T19:20:46.039 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.031+0000 7f1bcffff700 1 -- 172.21.15.157:0/1256526624 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd0011c30 con 0x7f1be0072530 2021-10-08T19:20:46.039 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.032+0000 7f1be7495700 1 -- 172.21.15.157:0/1256526624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 msgr2=0x7f1be0070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:46.039 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.032+0000 7f1be7495700 1 --2- 172.21.15.157:0/1256526624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be0070ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000b5f0 tx=0x7f1bd0006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:46.039 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.032+0000 7f1be7495700 1 -- 172.21.15.157:0/1256526624 shutdown_connections 2021-10-08T19:20:46.040 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.032+0000 7f1be7495700 1 --2- 172.21.15.157:0/1256526624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be0070ad0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:46.040 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.032+0000 7f1be7495700 1 -- 172.21.15.157:0/1256526624 >> 172.21.15.157:0/1256526624 conn(0x7f1be00f7bd0 msgr2=0x7f1be00f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:46.040 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.032+0000 7f1be7495700 1 -- 172.21.15.157:0/1256526624 shutdown_connections 2021-10-08T19:20:46.040 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.032+0000 7f1be7495700 1 -- 172.21.15.157:0/1256526624 wait complete. 2021-10-08T19:20:46.040 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.032+0000 7f1be7495700 1 Processor -- start 2021-10-08T19:20:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.032+0000 7f1be7495700 1 -- start start 2021-10-08T19:20:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1be7495700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be010d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1be7495700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be010d6b0 con 0x7f1be0072530 2021-10-08T19:20:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1be5231700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be010d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:46.042 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1be5231700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be010d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39512/0 (socket says 172.21.15.157:39512) 2021-10-08T19:20:46.042 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1be5231700 1 -- 172.21.15.157:0/135177067 learned_addr learned my addr 172.21.15.157:0/135177067 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:46.042 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1be5231700 1 -- 172.21.15.157:0/135177067 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd000b200 con 0x7f1be0072530 2021-10-08T19:20:46.042 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1be5231700 1 --2- 172.21.15.157:0/135177067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be010d170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0011040 tx=0x7f1bd0006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:46.043 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd001b620 con 0x7f1be0072530 2021-10-08T19:20:46.043 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f1bd001bc00 con 0x7f1be0072530 2021-10-08T19:20:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00238b0 con 0x7f1be0072530 2021-10-08T19:20:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.033+0000 7f1be7495700 1 -- 172.21.15.157:0/135177067 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be010d8b0 con 0x7f1be0072530 2021-10-08T19:20:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.034+0000 7f1be7495700 1 -- 172.21.15.157:0/135177067 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be010e550 con 0x7f1be0072530 2021-10-08T19:20:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.034+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 9) v1 ==== 40475+0+0 (secure 0 0 0) 0x7f1bd000f070 con 0x7f1be0072530 2021-10-08T19:20:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.035+0000 7f1bcdffb700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 0x7f1bc8035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.035+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 --> v2:172.21.15.157:6800/4161241346 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bc80361d0 con 0x7f1bc8033650 2021-10-08T19:20:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.035+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f1bd0046a30 con 0x7f1be0072530 2021-10-08T19:20:46.046 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.035+0000 7f1be4a30700 1 -- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 msgr2=0x7f1bc8035b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/4161241346 2021-10-08T19:20:46.046 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.035+0000 7f1be4a30700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 0x7f1bc8035b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:20:46.237 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.236+0000 7f1be4a30700 1 -- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 msgr2=0x7f1bc8035b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/4161241346 2021-10-08T19:20:46.237 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.236+0000 7f1be4a30700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 0x7f1bc8035b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:20:46.638 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.637+0000 7f1be4a30700 1 -- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 msgr2=0x7f1bc8035b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/4161241346 2021-10-08T19:20:46.638 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:46.637+0000 7f1be4a30700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 0x7f1bc8035b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2021-10-08T19:20:47.439 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:47.438+0000 7f1be4a30700 1 -- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 msgr2=0x7f1bc8035b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/4161241346 2021-10-08T19:20:47.439 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:47.438+0000 7f1be4a30700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 0x7f1bc8035b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2021-10-08T19:20:49.041 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:49.040+0000 7f1be4a30700 1 -- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 msgr2=0x7f1bc8035b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/4161241346 2021-10-08T19:20:49.041 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:49.040+0000 7f1be4a30700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 0x7f1bc8035b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2021-10-08T19:20:49.558 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:49.557+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mgrmap(e 10) v1 ==== 40278+0+0 (secure 0 0 0) 0x7f1bd001bd70 con 0x7f1be0072530 2021-10-08T19:20:49.559 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:49.557+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 msgr2=0x7f1bc8035b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:20:49.559 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:49.557+0000 7f1bcdffb700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 0x7f1bc8035b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: Active manager daemon y restarted 2021-10-08T19:20:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: Activating manager daemon y 2021-10-08T19:20:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: osdmap e3: 0 total, 0 up, 0 in 2021-10-08T19:20:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: mgrmap e10: y(active, starting, since 0.682176s) 2021-10-08T19:20:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:20:50.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:20:50.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:20:50.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:20:50.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:20:50.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: Manager daemon y is now available 2021-10-08T19:20:50.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:20:50.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:50.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:50.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:20:50.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:20:50.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:50.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:20:50.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:20:50.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:20:50.560 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.558+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 11) v1 ==== 40353+0+0 (secure 0 0 0) 0x7f1bd001b780 con 0x7f1be0072530 2021-10-08T19:20:50.561 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.558+0000 7f1bcdffb700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1bc8036fc0 0x7f1bc80393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:50.561 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.558+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 --> v2:172.21.15.157:6800/3606206634 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bc80361d0 con 0x7f1bc8036fc0 2021-10-08T19:20:50.561 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.559+0000 7f1be4a30700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1bc8036fc0 0x7f1bc80393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:50.562 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.559+0000 7f1be4a30700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1bc8036fc0 0x7f1bc80393a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0036d0 tx=0x7f1bdc006c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:50.562 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.560+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6424 (secure 0 0 0) 0x7f1bc80361d0 con 0x7f1bc8036fc0 2021-10-08T19:20:50.569 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.566+0000 7f1be7495700 1 -- 172.21.15.157:0/135177067 --> v2:172.21.15.157:6800/3606206634 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f1be010dd40 con 0x7f1bc8036fc0 2021-10-08T19:20:50.569 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.566+0000 7f1bcdffb700 1 -- 172.21.15.157:0/135177067 <== mgr.14150 v2:172.21.15.157:6800/3606206634 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f1be010dd40 con 0x7f1bc8036fc0 2021-10-08T19:20:50.569 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: { 2021-10-08T19:20:50.570 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2021-10-08T19:20:50.570 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: "initialized": true 2021-10-08T19:20:50.570 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: } 2021-10-08T19:20:50.570 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.567+0000 7f1be7495700 1 -- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1bc8036fc0 msgr2=0x7f1bc80393a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:50.570 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.567+0000 7f1be7495700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1bc8036fc0 0x7f1bc80393a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0036d0 tx=0x7f1bdc006c70 comp rx=0 tx=0).stop 2021-10-08T19:20:50.571 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.567+0000 7f1be7495700 1 -- 172.21.15.157:0/135177067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 msgr2=0x7f1be010d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:50.571 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.567+0000 7f1be7495700 1 --2- 172.21.15.157:0/135177067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be010d170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0011040 tx=0x7f1bd0006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:50.571 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.567+0000 7f1be7495700 1 -- 172.21.15.157:0/135177067 shutdown_connections 2021-10-08T19:20:50.571 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.567+0000 7f1be7495700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1bc8036fc0 0x7f1bc80393a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:50.572 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.567+0000 7f1be7495700 1 --2- 172.21.15.157:0/135177067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be0072530 0x7f1be010d170 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0011040 tx=0x7f1bd0006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:50.572 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.567+0000 7f1be7495700 1 --2- 172.21.15.157:0/135177067 >> v2:172.21.15.157:6800/4161241346 conn(0x7f1bc8033650 0x7f1bc8035b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:50.572 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.567+0000 7f1be7495700 1 -- 172.21.15.157:0/135177067 >> 172.21.15.157:0/135177067 conn(0x7f1be00f7bd0 msgr2=0x7f1be00f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:50.572 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.568+0000 7f1be7495700 1 -- 172.21.15.157:0/135177067 shutdown_connections 2021-10-08T19:20:50.572 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:50.568+0000 7f1be7495700 1 -- 172.21.15.157:0/135177067 wait complete. 2021-10-08T19:20:50.878 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:50 smithi157 conmon[33269]: [08/Oct/2021:19:20:50] ENGINE Bus STARTING 2021-10-08T19:20:50.878 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:50 smithi157 conmon[33269]: [08/Oct/2021:19:20:50] ENGINE Serving on https://172.21.15.157:8499 2021-10-08T19:20:50.878 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:20:50 smithi157 conmon[33269]: [08/Oct/2021:19:20:50] ENGINE Bus STARTED 2021-10-08T19:20:51.126 INFO:teuthology.orchestra.run.smithi157.stderr:mgr epoch 9 is available 2021-10-08T19:20:51.127 INFO:teuthology.orchestra.run.smithi157.stderr:Generating a dashboard self-signed certificate... 2021-10-08T19:20:51.127 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf dashboard create-self-signed-cert 2021-10-08T19:20:51.312 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:50 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:20:51.312 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:50 smithi157 ceph-mon[32847]: Delaying applying agent spec until cephadm endpoint root cert created 2021-10-08T19:20:51.312 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:50 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:20:51.313 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:50 smithi157 ceph-mon[32847]: Delaying applying agent spec until cephadm endpoint root cert created 2021-10-08T19:20:51.313 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:50 smithi157 ceph-mon[32847]: mgrmap e11: y(active, since 1.68399s) 2021-10-08T19:20:51.708 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.702+0000 7f4d0af3a700 1 Processor -- start 2021-10-08T19:20:51.709 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.702+0000 7f4d0af3a700 1 -- start start 2021-10-08T19:20:51.709 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.702+0000 7f4d0af3a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:51.709 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.702+0000 7f4d0af3a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040fe1f0 con 0x7f4d040fd810 2021-10-08T19:20:51.710 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.703+0000 7f4d09f38700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:51.710 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.703+0000 7f4d09f38700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39564/0 (socket says 172.21.15.157:39564) 2021-10-08T19:20:51.710 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.703+0000 7f4d09f38700 1 -- 172.21.15.157:0/2233340307 learned_addr learned my addr 172.21.15.157:0/2233340307 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:51.711 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.703+0000 7f4d09f38700 1 -- 172.21.15.157:0/2233340307 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040fe330 con 0x7f4d040fd810 2021-10-08T19:20:51.711 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.703+0000 7f4d09f38700 1 --2- 172.21.15.157:0/2233340307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fdc20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000b5f0 tx=0x7f4d00006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8c47419504d2f8 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:51.712 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.703+0000 7f4d08f36700 1 -- 172.21.15.157:0/2233340307 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d000106d0 con 0x7f4d040fd810 2021-10-08T19:20:51.712 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.703+0000 7f4d08f36700 1 -- 172.21.15.157:0/2233340307 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f4d00010cb0 con 0x7f4d040fd810 2021-10-08T19:20:51.712 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.703+0000 7f4d08f36700 1 -- 172.21.15.157:0/2233340307 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d00011c30 con 0x7f4d040fd810 2021-10-08T19:20:51.713 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.704+0000 7f4d0af3a700 1 -- 172.21.15.157:0/2233340307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 msgr2=0x7f4d040fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:51.713 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.704+0000 7f4d0af3a700 1 --2- 172.21.15.157:0/2233340307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fdc20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000b5f0 tx=0x7f4d00006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:51.713 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.704+0000 7f4d0af3a700 1 -- 172.21.15.157:0/2233340307 shutdown_connections 2021-10-08T19:20:51.714 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.704+0000 7f4d0af3a700 1 --2- 172.21.15.157:0/2233340307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fdc20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:51.714 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.704+0000 7f4d0af3a700 1 -- 172.21.15.157:0/2233340307 >> 172.21.15.157:0/2233340307 conn(0x7f4d040f6020 msgr2=0x7f4d040f8430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:51.714 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.704+0000 7f4d0af3a700 1 -- 172.21.15.157:0/2233340307 shutdown_connections 2021-10-08T19:20:51.714 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.704+0000 7f4d0af3a700 1 -- 172.21.15.157:0/2233340307 wait complete. 2021-10-08T19:20:51.715 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.704+0000 7f4d0af3a700 1 Processor -- start 2021-10-08T19:20:51.715 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.704+0000 7f4d0af3a700 1 -- start start 2021-10-08T19:20:51.715 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4d0af3a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:51.715 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4d0af3a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040fb560 con 0x7f4d040fd810 2021-10-08T19:20:51.716 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4d09f38700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:51.716 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4d09f38700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39566/0 (socket says 172.21.15.157:39566) 2021-10-08T19:20:51.716 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4d09f38700 1 -- 172.21.15.157:0/1065369695 learned_addr learned my addr 172.21.15.157:0/1065369695 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:51.717 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4d09f38700 1 -- 172.21.15.157:0/1065369695 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0000b200 con 0x7f4d040fd810 2021-10-08T19:20:51.717 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4d09f38700 1 --2- 172.21.15.157:0/1065369695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fd0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d00011040 tx=0x7f4d00006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:51.717 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4cf27fc700 1 -- 172.21.15.157:0/1065369695 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d0001b620 con 0x7f4d040fd810 2021-10-08T19:20:51.717 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4cf27fc700 1 -- 172.21.15.157:0/1065369695 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f4d0001bc00 con 0x7f4d040fd810 2021-10-08T19:20:51.717 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d040fb760 con 0x7f4d040fd810 2021-10-08T19:20:51.718 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4cf27fc700 1 -- 172.21.15.157:0/1065369695 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d000238b0 con 0x7f4d040fd810 2021-10-08T19:20:51.718 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.705+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d040fbbf0 con 0x7f4d040fd810 2021-10-08T19:20:51.719 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.706+0000 7f4cf27fc700 1 -- 172.21.15.157:0/1065369695 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 12) v1 ==== 40475+0+0 (secure 0 0 0) 0x7f4d0000f070 con 0x7f4d040fd810 2021-10-08T19:20:51.719 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.706+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0405a9f0 con 0x7f4d040fd810 2021-10-08T19:20:51.719 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.706+0000 7f4cf27fc700 1 --2- 172.21.15.157:0/1065369695 >> v2:172.21.15.157:6800/3606206634 conn(0x7f4cec0336b0 0x7f4cec035b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:51.719 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.706+0000 7f4cf27fc700 1 -- 172.21.15.157:0/1065369695 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f4d00046990 con 0x7f4d040fd810 2021-10-08T19:20:51.719 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.706+0000 7f4d09737700 1 --2- 172.21.15.157:0/1065369695 >> v2:172.21.15.157:6800/3606206634 conn(0x7f4cec0336b0 0x7f4cec035b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:51.720 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.707+0000 7f4d09737700 1 --2- 172.21.15.157:0/1065369695 >> v2:172.21.15.157:6800/3606206634 conn(0x7f4cec0336b0 0x7f4cec035b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40096a0 tx=0x7f4cf4006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:51.720 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.711+0000 7f4cf27fc700 1 -- 172.21.15.157:0/1065369695 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f4d0002bb80 con 0x7f4d040fd810 2021-10-08T19:20:51.875 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:51.874+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d040fbf40 con 0x7f4cec0336b0 2021-10-08T19:20:52.060 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.059+0000 7f4cf27fc700 1 -- 172.21.15.157:0/1065369695 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f4d040fbf40 con 0x7f4cec0336b0 2021-10-08T19:20:52.061 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: Self-signed certificate created 2021-10-08T19:20:52.062 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 >> v2:172.21.15.157:6800/3606206634 conn(0x7f4cec0336b0 msgr2=0x7f4cec035b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:52.063 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 --2- 172.21.15.157:0/1065369695 >> v2:172.21.15.157:6800/3606206634 conn(0x7f4cec0336b0 0x7f4cec035b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40096a0 tx=0x7f4cf4006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:52.063 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 msgr2=0x7f4d040fd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:52.063 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 --2- 172.21.15.157:0/1065369695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fd0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d00011040 tx=0x7f4d00006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:52.064 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 shutdown_connections 2021-10-08T19:20:52.064 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 --2- 172.21.15.157:0/1065369695 >> v2:172.21.15.157:6800/3606206634 conn(0x7f4cec0336b0 0x7f4cec035b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:52.064 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 --2- 172.21.15.157:0/1065369695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d040fd810 0x7f4d040fd0e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:52.064 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 >> 172.21.15.157:0/1065369695 conn(0x7f4d040f6020 msgr2=0x7f4d040f6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:52.065 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 shutdown_connections 2021-10-08T19:20:52.065 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:52.061+0000 7f4d0af3a700 1 -- 172.21.15.157:0/1065369695 wait complete. 2021-10-08T19:20:52.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:51 smithi157 ceph-mon[32847]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-10-08T19:20:52.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:51 smithi157 ceph-mon[32847]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-10-08T19:20:52.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:51 smithi157 ceph-mon[32847]: Starting cherrypy engine... 2021-10-08T19:20:52.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:51 smithi157 ceph-mon[32847]: [08/Oct/2021:19:20:50] ENGINE Bus STARTING 2021-10-08T19:20:52.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:51 smithi157 ceph-mon[32847]: [08/Oct/2021:19:20:50] ENGINE Serving on https://172.21.15.157:8499 2021-10-08T19:20:52.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:51 smithi157 ceph-mon[32847]: [08/Oct/2021:19:20:50] ENGINE Bus STARTED 2021-10-08T19:20:52.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:51 smithi157 ceph-mon[32847]: Cherrypy engine started. 2021-10-08T19:20:52.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:51 smithi157 ceph-mon[32847]: mgrmap e12: y(active, since 2s) 2021-10-08T19:20:52.564 INFO:teuthology.orchestra.run.smithi157.stderr:Creating initial admin user... 2021-10-08T19:20:52.564 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpygl52pdp:/tmp/dashboard.pw:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-10-08T19:20:53.158 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.153+0000 7f183cc7c700 1 Processor -- start 2021-10-08T19:20:53.158 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.153+0000 7f183cc7c700 1 -- start start 2021-10-08T19:20:53.159 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.153+0000 7f183cc7c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:53.159 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.153+0000 7f183cc7c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380ff7b0 con 0x7f1838070530 2021-10-08T19:20:53.159 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.153+0000 7f183659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:53.159 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.153+0000 7f183659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39570/0 (socket says 172.21.15.157:39570) 2021-10-08T19:20:53.160 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.153+0000 7f183659c700 1 -- 172.21.15.157:0/4057729487 learned_addr learned my addr 172.21.15.157:0/4057729487 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:53.160 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f183659c700 1 -- 172.21.15.157:0/4057729487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380ff8f0 con 0x7f1838070530 2021-10-08T19:20:53.160 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f183659c700 1 --2- 172.21.15.157:0/4057729487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380ff1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f182800b5f0 tx=0x7f1828006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c3c22084ef1eee server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:53.160 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f1835d9b700 1 -- 172.21.15.157:0/4057729487 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18280106d0 con 0x7f1838070530 2021-10-08T19:20:53.161 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f1835d9b700 1 -- 172.21.15.157:0/4057729487 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f1828010cb0 con 0x7f1838070530 2021-10-08T19:20:53.161 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f1835d9b700 1 -- 172.21.15.157:0/4057729487 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1828011c30 con 0x7f1838070530 2021-10-08T19:20:53.161 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f183cc7c700 1 -- 172.21.15.157:0/4057729487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 msgr2=0x7f18380ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:53.161 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f183cc7c700 1 --2- 172.21.15.157:0/4057729487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380ff1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f182800b5f0 tx=0x7f1828006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:53.161 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f183cc7c700 1 -- 172.21.15.157:0/4057729487 shutdown_connections 2021-10-08T19:20:53.162 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f183cc7c700 1 --2- 172.21.15.157:0/4057729487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380ff1e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:53.162 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.154+0000 7f183cc7c700 1 -- 172.21.15.157:0/4057729487 >> 172.21.15.157:0/4057729487 conn(0x7f18380f6c30 msgr2=0x7f18380f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:53.162 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.155+0000 7f183cc7c700 1 -- 172.21.15.157:0/4057729487 shutdown_connections 2021-10-08T19:20:53.162 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.155+0000 7f183cc7c700 1 -- 172.21.15.157:0/4057729487 wait complete. 2021-10-08T19:20:53.162 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.155+0000 7f183cc7c700 1 Processor -- start 2021-10-08T19:20:53.163 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183cc7c700 1 -- start start 2021-10-08T19:20:53.163 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183cc7c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:53.163 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183cc7c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380fb0e0 con 0x7f1838070530 2021-10-08T19:20:53.163 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:53.164 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380fcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39572/0 (socket says 172.21.15.157:39572) 2021-10-08T19:20:53.164 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183659c700 1 -- 172.21.15.157:0/773264447 learned_addr learned my addr 172.21.15.157:0/773264447 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:53.164 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183659c700 1 -- 172.21.15.157:0/773264447 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182800b200 con 0x7f1838070530 2021-10-08T19:20:53.164 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183659c700 1 --2- 172.21.15.157:0/773264447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380fcc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1828011040 tx=0x7f1828006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:53.164 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f182f7fe700 1 -- 172.21.15.157:0/773264447 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f182801b620 con 0x7f1838070530 2021-10-08T19:20:53.165 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18380fb2e0 con 0x7f1838070530 2021-10-08T19:20:53.165 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f182f7fe700 1 -- 172.21.15.157:0/773264447 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f182801bc00 con 0x7f1838070530 2021-10-08T19:20:53.165 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f182f7fe700 1 -- 172.21.15.157:0/773264447 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18280238b0 con 0x7f1838070530 2021-10-08T19:20:53.165 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.156+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18380fb770 con 0x7f1838070530 2021-10-08T19:20:53.165 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.157+0000 7f182f7fe700 1 -- 172.21.15.157:0/773264447 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 12) v1 ==== 40475+0+0 (secure 0 0 0) 0x7f182800f070 con 0x7f1838070530 2021-10-08T19:20:53.166 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.157+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183805a9f0 con 0x7f1838070530 2021-10-08T19:20:53.166 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.157+0000 7f182f7fe700 1 --2- 172.21.15.157:0/773264447 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1818033650 0x7f1818035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:53.166 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.158+0000 7f182f7fe700 1 -- 172.21.15.157:0/773264447 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f1828046a00 con 0x7f1838070530 2021-10-08T19:20:53.166 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.158+0000 7f182dd9b700 1 --2- 172.21.15.157:0/773264447 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1818033650 0x7f1818035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:53.167 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.158+0000 7f182dd9b700 1 --2- 172.21.15.157:0/773264447 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1818033650 0x7f1818035b00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18200096a0 tx=0x7f1820006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:53.167 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.162+0000 7f182f7fe700 1 -- 172.21.15.157:0/773264447 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f18280223a0 con 0x7f1838070530 2021-10-08T19:20:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:53 smithi157 ceph-mon[32847]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:20:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:20:53.336 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.335+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f18381007a0 con 0x7f1818033650 2021-10-08T19:20:53.552 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.551+0000 7f182f7fe700 1 -- 172.21.15.157:0/773264447 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f18381007a0 con 0x7f1818033650 2021-10-08T19:20:53.553 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$gkT1p/oaZj3bNK0PPLJloeSMDP7HyQkTZzcU9Wk3s5H.jKQ2AkNiu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1633720853, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-10-08T19:20:53.554 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1818033650 msgr2=0x7f1818035b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:53.555 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 --2- 172.21.15.157:0/773264447 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1818033650 0x7f1818035b00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18200096a0 tx=0x7f1820006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:53.555 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 msgr2=0x7f18380fcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:53.555 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 --2- 172.21.15.157:0/773264447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380fcc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1828011040 tx=0x7f1828006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:53.555 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 shutdown_connections 2021-10-08T19:20:53.557 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 --2- 172.21.15.157:0/773264447 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1818033650 0x7f1818035b00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:53.557 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 --2- 172.21.15.157:0/773264447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1838070530 0x7f18380fcc60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:53.557 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 >> 172.21.15.157:0/773264447 conn(0x7f18380f6c30 msgr2=0x7f18380f79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:53.558 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 shutdown_connections 2021-10-08T19:20:53.558 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:53.553+0000 7f183cc7c700 1 -- 172.21.15.157:0/773264447 wait complete. 2021-10-08T19:20:54.181 INFO:teuthology.orchestra.run.smithi157.stderr:Fetching dashboard port number... 2021-10-08T19:20:54.181 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi157 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/906d7a14-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpx51q5apl:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe23l5079:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config get mgr mgr/dashboard/ssl_server_port 2021-10-08T19:20:54.788 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.782+0000 7f655ead0700 1 Processor -- start 2021-10-08T19:20:54.789 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.782+0000 7f655ead0700 1 -- start start 2021-10-08T19:20:54.789 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.782+0000 7f655ead0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f65580fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:54.789 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.782+0000 7f655ead0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65580fbc90 con 0x7f65580fb2b0 2021-10-08T19:20:54.789 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.782+0000 7f655c86c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f65580fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:54.790 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.782+0000 7f655c86c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f65580fb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39576/0 (socket says 172.21.15.157:39576) 2021-10-08T19:20:54.790 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.782+0000 7f655c86c700 1 -- 172.21.15.157:0/4061960967 learned_addr learned my addr 172.21.15.157:0/4061960967 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:54.790 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.782+0000 7f655c86c700 1 -- 172.21.15.157:0/4061960967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65580fbdd0 con 0x7f65580fb2b0 2021-10-08T19:20:54.790 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.783+0000 7f655c86c700 1 --2- 172.21.15.157:0/4061960967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f65580fb6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f654c00b5f0 tx=0x7f654c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2e8720fe99b498 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:54.790 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.783+0000 7f65577fe700 1 -- 172.21.15.157:0/4061960967 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f654c0106d0 con 0x7f65580fb2b0 2021-10-08T19:20:54.791 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.783+0000 7f65577fe700 1 -- 172.21.15.157:0/4061960967 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f654c010cb0 con 0x7f65580fb2b0 2021-10-08T19:20:54.791 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.783+0000 7f65577fe700 1 -- 172.21.15.157:0/4061960967 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f654c011c30 con 0x7f65580fb2b0 2021-10-08T19:20:54.791 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.784+0000 7f655ead0700 1 -- 172.21.15.157:0/4061960967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 msgr2=0x7f65580fb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:54.791 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.784+0000 7f655ead0700 1 --2- 172.21.15.157:0/4061960967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f65580fb6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f654c00b5f0 tx=0x7f654c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:54.791 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.784+0000 7f655ead0700 1 -- 172.21.15.157:0/4061960967 shutdown_connections 2021-10-08T19:20:54.792 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.784+0000 7f655ead0700 1 --2- 172.21.15.157:0/4061960967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f65580fb6c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:54.792 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.784+0000 7f655ead0700 1 -- 172.21.15.157:0/4061960967 >> 172.21.15.157:0/4061960967 conn(0x7f65580f6a20 msgr2=0x7f65580f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:54.792 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.784+0000 7f655ead0700 1 -- 172.21.15.157:0/4061960967 shutdown_connections 2021-10-08T19:20:54.792 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.784+0000 7f655ead0700 1 -- 172.21.15.157:0/4061960967 wait complete. 2021-10-08T19:20:54.793 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.784+0000 7f655ead0700 1 Processor -- start 2021-10-08T19:20:54.793 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.785+0000 7f655ead0700 1 -- start start 2021-10-08T19:20:54.793 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.785+0000 7f655ead0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f6558108db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:54.793 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.785+0000 7f655ead0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65581092f0 con 0x7f65580fb2b0 2021-10-08T19:20:54.793 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.785+0000 7f655c86c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f6558108db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:54.794 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.785+0000 7f655c86c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f6558108db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39578/0 (socket says 172.21.15.157:39578) 2021-10-08T19:20:54.794 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.785+0000 7f655c86c700 1 -- 172.21.15.157:0/2510067271 learned_addr learned my addr 172.21.15.157:0/2510067271 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:54.794 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.785+0000 7f655c86c700 1 -- 172.21.15.157:0/2510067271 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c00b200 con 0x7f65580fb2b0 2021-10-08T19:20:54.794 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.786+0000 7f655c86c700 1 --2- 172.21.15.157:0/2510067271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f6558108db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f654c011040 tx=0x7f654c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.786+0000 7f65557fa700 1 -- 172.21.15.157:0/2510067271 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f654c01b620 con 0x7f65580fb2b0 2021-10-08T19:20:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.786+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65581094f0 con 0x7f65580fb2b0 2021-10-08T19:20:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.786+0000 7f65557fa700 1 -- 172.21.15.157:0/2510067271 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f654c01bc00 con 0x7f65580fb2b0 2021-10-08T19:20:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.786+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655810a0e0 con 0x7f65580fb2b0 2021-10-08T19:20:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.786+0000 7f65557fa700 1 -- 172.21.15.157:0/2510067271 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f654c0238b0 con 0x7f65580fb2b0 2021-10-08T19:20:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.787+0000 7f65557fa700 1 -- 172.21.15.157:0/2510067271 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 12) v1 ==== 40475+0+0 (secure 0 0 0) 0x7f654c00f070 con 0x7f65580fb2b0 2021-10-08T19:20:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.787+0000 7f65557fa700 1 --2- 172.21.15.157:0/2510067271 >> v2:172.21.15.157:6800/3606206634 conn(0x7f653c0358a0 0x7f653c037d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.787+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655805a9f0 con 0x7f65580fb2b0 2021-10-08T19:20:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.787+0000 7f65557fa700 1 -- 172.21.15.157:0/2510067271 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f654c0478a0 con 0x7f65580fb2b0 2021-10-08T19:20:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.787+0000 7f6557fff700 1 --2- 172.21.15.157:0/2510067271 >> v2:172.21.15.157:6800/3606206634 conn(0x7f653c0358a0 0x7f653c037d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.787+0000 7f6557fff700 1 --2- 172.21.15.157:0/2510067271 >> v2:172.21.15.157:6800/3606206634 conn(0x7f653c0358a0 0x7f653c037d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f65440096a0 tx=0x7f6544006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:54.798 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.791+0000 7f65557fa700 1 -- 172.21.15.157:0/2510067271 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f654c02bd60 con 0x7f65580fb2b0 2021-10-08T19:20:54.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:54 smithi157 ceph-mon[32847]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:20:54.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:54 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:20:54.958 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.956+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f65580fd270 con 0x7f65580fb2b0 2021-10-08T19:20:54.958 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.957+0000 7f65557fa700 1 -- 172.21.15.157:0/2510067271 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f654c00f300 con 0x7f65580fb2b0 2021-10-08T19:20:54.958 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 8443 2021-10-08T19:20:54.960 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 >> v2:172.21.15.157:6800/3606206634 conn(0x7f653c0358a0 msgr2=0x7f653c037d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:54.961 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 --2- 172.21.15.157:0/2510067271 >> v2:172.21.15.157:6800/3606206634 conn(0x7f653c0358a0 0x7f653c037d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f65440096a0 tx=0x7f6544006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:54.961 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 msgr2=0x7f6558108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:54.961 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 --2- 172.21.15.157:0/2510067271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f6558108db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f654c011040 tx=0x7f654c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:20:54.961 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 shutdown_connections 2021-10-08T19:20:54.962 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 --2- 172.21.15.157:0/2510067271 >> v2:172.21.15.157:6800/3606206634 conn(0x7f653c0358a0 0x7f653c037d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:54.962 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 --2- 172.21.15.157:0/2510067271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65580fb2b0 0x7f6558108db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:54.962 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 >> 172.21.15.157:0/2510067271 conn(0x7f65580f6a20 msgr2=0x7f65580f8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:54.962 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 shutdown_connections 2021-10-08T19:20:54.962 INFO:teuthology.orchestra.run.smithi157.stderr:/usr/bin/ceph: 2021-10-08T19:20:54.959+0000 7f655ead0700 1 -- 172.21.15.157:0/2510067271 wait complete. 2021-10-08T19:20:55.484 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:20:55.493 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: disabled 2021-10-08T19:20:55.493 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:20:55.499 INFO:teuthology.orchestra.run.smithi157.stderr:systemctl: inactive 2021-10-08T19:20:55.500 INFO:teuthology.orchestra.run.smithi157.stderr:firewalld.service is not enabled 2021-10-08T19:20:55.500 INFO:teuthology.orchestra.run.smithi157.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-10-08T19:20:55.503 INFO:teuthology.orchestra.run.smithi157.stderr:Ceph Dashboard is now available at: 2021-10-08T19:20:55.503 INFO:teuthology.orchestra.run.smithi157.stderr: 2021-10-08T19:20:55.503 INFO:teuthology.orchestra.run.smithi157.stderr: URL: https://smithi157.front.sepia.ceph.com:8443/ 2021-10-08T19:20:55.503 INFO:teuthology.orchestra.run.smithi157.stderr: User: admin 2021-10-08T19:20:55.503 INFO:teuthology.orchestra.run.smithi157.stderr: Password: hwujm8tvr5 2021-10-08T19:20:55.504 INFO:teuthology.orchestra.run.smithi157.stderr: 2021-10-08T19:20:55.504 INFO:teuthology.orchestra.run.smithi157.stderr:You can access the Ceph CLI with: 2021-10-08T19:20:55.504 INFO:teuthology.orchestra.run.smithi157.stderr: 2021-10-08T19:20:55.504 INFO:teuthology.orchestra.run.smithi157.stderr: sudo /sbin/cephadm shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:20:55.505 INFO:teuthology.orchestra.run.smithi157.stderr: 2021-10-08T19:20:55.505 INFO:teuthology.orchestra.run.smithi157.stderr:Please consider enabling telemetry to help improve Ceph: 2021-10-08T19:20:55.505 INFO:teuthology.orchestra.run.smithi157.stderr: 2021-10-08T19:20:55.505 INFO:teuthology.orchestra.run.smithi157.stderr: ceph telemetry on 2021-10-08T19:20:55.505 INFO:teuthology.orchestra.run.smithi157.stderr: 2021-10-08T19:20:55.506 INFO:teuthology.orchestra.run.smithi157.stderr:For more information see: 2021-10-08T19:20:55.506 INFO:teuthology.orchestra.run.smithi157.stderr: 2021-10-08T19:20:55.506 INFO:teuthology.orchestra.run.smithi157.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-10-08T19:20:55.506 INFO:teuthology.orchestra.run.smithi157.stderr: 2021-10-08T19:20:55.506 INFO:teuthology.orchestra.run.smithi157.stderr:Bootstrap complete. 2021-10-08T19:20:55.538 INFO:tasks.cephadm:Fetching config... 2021-10-08T19:20:55.540 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:20:55.541 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-10-08T19:20:55.596 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-10-08T19:20:55.596 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:20:55.597 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-10-08T19:20:55.652 INFO:tasks.cephadm:Fetching mon keyring... 2021-10-08T19:20:55.652 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:20:55.653 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-10-08T19:20:55.717 INFO:tasks.cephadm:Fetching pub ssh key... 2021-10-08T19:20:55.719 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:20:55.719 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-10-08T19:20:55.772 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-10-08T19:20:55.773 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcCKL7KURkNC1cNPa0lXcCTQv33ACm+ns7YCQQ5T7OGHze4iBsUJopXO0CnZs4YacbCu2lFvfmEkKagIul7SV/glsamUDOpXCIPXnBfhnCsF4UQ1mwLlXD94+xE7jquTj2qt6KruC451Xumy65RuR82YBgS0YDJEPPQZJYjZBWtYdrV4h0UuNYKsm2SUo3xXGMFE7KGWq1XrhgKQu69hfBrkBUKjjQC72xcyc80AI/nAraQZF15iGx5rLhstVWT8YMeLh91wwlmqkMCtSsZ+q4bqXr3A0FPIYhSB8CIj06YqV/elSPUVXlywhcJZ/HbxPwRdQLhfOtKtbAHB8K+egRB13xbhbv5aJ9juQg+zlYybmqe15iX0W9+NiBumEIdMyJf+ZWaKYeb6lyD7/IGFD7rI/MwNmrIH6/8vQ+mT9BGLrbt80fdcLqTAf3C9snzlVEkhT7lK7qO9hYafdJ6QB7n6yuKbUYsxFejEOTMbmVIP/hGUhRVgPe+nnhhOqWcF8= ceph-906d7a14-286c-11ec-8c25-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-10-08T19:20:55.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2510067271' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-10-08T19:20:55.845 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcCKL7KURkNC1cNPa0lXcCTQv33ACm+ns7YCQQ5T7OGHze4iBsUJopXO0CnZs4YacbCu2lFvfmEkKagIul7SV/glsamUDOpXCIPXnBfhnCsF4UQ1mwLlXD94+xE7jquTj2qt6KruC451Xumy65RuR82YBgS0YDJEPPQZJYjZBWtYdrV4h0UuNYKsm2SUo3xXGMFE7KGWq1XrhgKQu69hfBrkBUKjjQC72xcyc80AI/nAraQZF15iGx5rLhstVWT8YMeLh91wwlmqkMCtSsZ+q4bqXr3A0FPIYhSB8CIj06YqV/elSPUVXlywhcJZ/HbxPwRdQLhfOtKtbAHB8K+egRB13xbhbv5aJ9juQg+zlYybmqe15iX0W9+NiBumEIdMyJf+ZWaKYeb6lyD7/IGFD7rI/MwNmrIH6/8vQ+mT9BGLrbt80fdcLqTAf3C9snzlVEkhT7lK7qO9hYafdJ6QB7n6yuKbUYsxFejEOTMbmVIP/hGUhRVgPe+nnhhOqWcF8= ceph-906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:55.855 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcCKL7KURkNC1cNPa0lXcCTQv33ACm+ns7YCQQ5T7OGHze4iBsUJopXO0CnZs4YacbCu2lFvfmEkKagIul7SV/glsamUDOpXCIPXnBfhnCsF4UQ1mwLlXD94+xE7jquTj2qt6KruC451Xumy65RuR82YBgS0YDJEPPQZJYjZBWtYdrV4h0UuNYKsm2SUo3xXGMFE7KGWq1XrhgKQu69hfBrkBUKjjQC72xcyc80AI/nAraQZF15iGx5rLhstVWT8YMeLh91wwlmqkMCtSsZ+q4bqXr3A0FPIYhSB8CIj06YqV/elSPUVXlywhcJZ/HbxPwRdQLhfOtKtbAHB8K+egRB13xbhbv5aJ9juQg+zlYybmqe15iX0W9+NiBumEIdMyJf+ZWaKYeb6lyD7/IGFD7rI/MwNmrIH6/8vQ+mT9BGLrbt80fdcLqTAf3C9snzlVEkhT7lK7qO9hYafdJ6QB7n6yuKbUYsxFejEOTMbmVIP/hGUhRVgPe+nnhhOqWcF8= ceph-906d7a14-286c-11ec-8c25-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-10-08T19:20:55.897 INFO:teuthology.orchestra.run.smithi196.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcCKL7KURkNC1cNPa0lXcCTQv33ACm+ns7YCQQ5T7OGHze4iBsUJopXO0CnZs4YacbCu2lFvfmEkKagIul7SV/glsamUDOpXCIPXnBfhnCsF4UQ1mwLlXD94+xE7jquTj2qt6KruC451Xumy65RuR82YBgS0YDJEPPQZJYjZBWtYdrV4h0UuNYKsm2SUo3xXGMFE7KGWq1XrhgKQu69hfBrkBUKjjQC72xcyc80AI/nAraQZF15iGx5rLhstVWT8YMeLh91wwlmqkMCtSsZ+q4bqXr3A0FPIYhSB8CIj06YqV/elSPUVXlywhcJZ/HbxPwRdQLhfOtKtbAHB8K+egRB13xbhbv5aJ9juQg+zlYybmqe15iX0W9+NiBumEIdMyJf+ZWaKYeb6lyD7/IGFD7rI/MwNmrIH6/8vQ+mT9BGLrbt80fdcLqTAf3C9snzlVEkhT7lK7qO9hYafdJ6QB7n6yuKbUYsxFejEOTMbmVIP/hGUhRVgPe+nnhhOqWcF8= ceph-906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:55.908 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-10-08T19:20:56.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:56 smithi157 ceph-mon[32847]: mgrmap e13: y(active, since 6s) 2021-10-08T19:20:57.737 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.735+0000 7f3d9ffff700 1 -- 172.21.15.157:0/160519421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 msgr2=0x7f3da00f8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:57.738 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.735+0000 7f3d9ffff700 1 --2- 172.21.15.157:0/160519421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 0x7f3da00f8390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009fb0 tx=0x7f3d90009b30 comp rx=0 tx=0).stop 2021-10-08T19:20:57.738 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.735+0000 7f3d9ffff700 1 -- 172.21.15.157:0/160519421 shutdown_connections 2021-10-08T19:20:57.738 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.735+0000 7f3d9ffff700 1 --2- 172.21.15.157:0/160519421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 0x7f3da00f8390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:57.739 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.735+0000 7f3d9ffff700 1 -- 172.21.15.157:0/160519421 >> 172.21.15.157:0/160519421 conn(0x7f3da00f36d0 msgr2=0x7f3da00f5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:57.739 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.735+0000 7f3d9ffff700 1 -- 172.21.15.157:0/160519421 shutdown_connections 2021-10-08T19:20:57.739 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.735+0000 7f3d9ffff700 1 -- 172.21.15.157:0/160519421 wait complete. 2021-10-08T19:20:57.739 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.736+0000 7f3d9ffff700 1 Processor -- start 2021-10-08T19:20:57.740 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.736+0000 7f3d9ffff700 1 -- start start 2021-10-08T19:20:57.740 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.736+0000 7f3d9ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 0x7f3da0107760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:57.740 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.736+0000 7f3d9ffff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da0107ca0 con 0x7f3da00f7f80 2021-10-08T19:20:57.740 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.736+0000 7f3d9effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 0x7f3da0107760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:57.740 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.736+0000 7f3d9effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 0x7f3da0107760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39588/0 (socket says 172.21.15.157:39588) 2021-10-08T19:20:57.741 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.736+0000 7f3d9effd700 1 -- 172.21.15.157:0/2721316966 learned_addr learned my addr 172.21.15.157:0/2721316966 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:20:57.741 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.737+0000 7f3d9effd700 1 -- 172.21.15.157:0/2721316966 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90005040 con 0x7f3da00f7f80 2021-10-08T19:20:57.741 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.737+0000 7f3d9effd700 1 --2- 172.21.15.157:0/2721316966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 0x7f3da0107760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009da0 tx=0x7f3d90009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:57.741 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.737+0000 7f3d877fe700 1 -- 172.21.15.157:0/2721316966 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d9001a070 con 0x7f3da00f7f80 2021-10-08T19:20:57.741 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.737+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da0107ea0 con 0x7f3da00f7f80 2021-10-08T19:20:57.742 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.737+0000 7f3d877fe700 1 -- 172.21.15.157:0/2721316966 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f3d90014d00 con 0x7f3da00f7f80 2021-10-08T19:20:57.742 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.737+0000 7f3d877fe700 1 -- 172.21.15.157:0/2721316966 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d9001ebd0 con 0x7f3da00f7f80 2021-10-08T19:20:57.742 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.737+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da0108b40 con 0x7f3da00f7f80 2021-10-08T19:20:57.743 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.738+0000 7f3d877fe700 1 -- 172.21.15.157:0/2721316966 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7f3d90025030 con 0x7f3da00f7f80 2021-10-08T19:20:57.744 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.738+0000 7f3d877fe700 1 --2- 172.21.15.157:0/2721316966 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3d880336f0 0x7f3d88035ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:20:57.744 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.738+0000 7f3d877fe700 1 -- 172.21.15.157:0/2721316966 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f3d90045370 con 0x7f3da00f7f80 2021-10-08T19:20:57.744 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.738+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da0108330 con 0x7f3da00f7f80 2021-10-08T19:20:57.744 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.738+0000 7f3d9e7fc700 1 --2- 172.21.15.157:0/2721316966 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3d880336f0 0x7f3d88035ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:20:57.744 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.738+0000 7f3d9e7fc700 1 --2- 172.21.15.157:0/2721316966 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3d880336f0 0x7f3d88035ba0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d940096a0 tx=0x7f3d94006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:20:57.745 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.742+0000 7f3d877fe700 1 -- 172.21.15.157:0/2721316966 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f3d90023070 con 0x7f3da00f7f80 2021-10-08T19:20:57.902 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.901+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f3da005a9f0 con 0x7f3da00f7f80 2021-10-08T19:20:57.906 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.904+0000 7f3d877fe700 1 -- 172.21.15.157:0/2721316966 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3d90013990 con 0x7f3da00f7f80 2021-10-08T19:20:57.907 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.906+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3d880336f0 msgr2=0x7f3d88035ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:57.907 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.906+0000 7f3d9ffff700 1 --2- 172.21.15.157:0/2721316966 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3d880336f0 0x7f3d88035ba0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d940096a0 tx=0x7f3d94006b40 comp rx=0 tx=0).stop 2021-10-08T19:20:57.908 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.906+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 msgr2=0x7f3da0107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:20:57.908 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.906+0000 7f3d9ffff700 1 --2- 172.21.15.157:0/2721316966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 0x7f3da0107760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009da0 tx=0x7f3d90009b30 comp rx=0 tx=0).stop 2021-10-08T19:20:57.908 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.906+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 shutdown_connections 2021-10-08T19:20:57.908 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.906+0000 7f3d9ffff700 1 --2- 172.21.15.157:0/2721316966 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3d880336f0 0x7f3d88035ba0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:57.909 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.906+0000 7f3d9ffff700 1 --2- 172.21.15.157:0/2721316966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3da00f7f80 0x7f3da0107760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:20:57.909 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.906+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 >> 172.21.15.157:0/2721316966 conn(0x7f3da00f36d0 msgr2=0x7f3da00f44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:20:57.909 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.907+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 shutdown_connections 2021-10-08T19:20:57.909 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:20:57.907+0000 7f3d9ffff700 1 -- 172.21.15.157:0/2721316966 wait complete. 2021-10-08T19:20:58.468 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2021-10-08T19:20:58.468 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2021-10-08T19:20:59.026 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2721316966' entity='client.admin' 2021-10-08T19:20:59.027 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:58 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:20:59.027 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:58 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:20:59.027 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:58 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:20:59.027 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:20:58 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi157", "caps": []}]: dispatch 2021-10-08T19:21:00.318 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: Deploying daemon agent.smithi157 on smithi157 2021-10-08T19:21:00.319 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: poll took 8714.718 ms: 1 events 2021-10-08T19:21:00.319 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.179 seconds 2021-10-08T19:21:00.319 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:00.319 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:00.319 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:00.320 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:00.320 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:00.320 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:00.320 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:00.321 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:00 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.458+0000 7f775dd78700 1 -- 172.21.15.157:0/2709024300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 msgr2=0x7f77580f84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.458+0000 7f775dd78700 1 --2- 172.21.15.157:0/2709024300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 0x7f77580f84e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7748009fb0 tx=0x7f7748009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.458+0000 7f775dd78700 1 -- 172.21.15.157:0/2709024300 shutdown_connections 2021-10-08T19:21:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.458+0000 7f775dd78700 1 --2- 172.21.15.157:0/2709024300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 0x7f77580f84e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:00.461 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.459+0000 7f775dd78700 1 -- 172.21.15.157:0/2709024300 >> 172.21.15.157:0/2709024300 conn(0x7f77580f38e0 msgr2=0x7f77580f5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:00.461 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.459+0000 7f775dd78700 1 -- 172.21.15.157:0/2709024300 shutdown_connections 2021-10-08T19:21:00.461 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.459+0000 7f775dd78700 1 -- 172.21.15.157:0/2709024300 wait complete. 2021-10-08T19:21:00.461 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.459+0000 7f775dd78700 1 Processor -- start 2021-10-08T19:21:00.462 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.459+0000 7f775dd78700 1 -- start start 2021-10-08T19:21:00.462 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.459+0000 7f775dd78700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 0x7f775806d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:00.462 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.459+0000 7f775dd78700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775806b710 con 0x7f77580f80d0 2021-10-08T19:21:00.464 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.459+0000 7f77577fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 0x7f775806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:00.464 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.460+0000 7f77577fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 0x7f775806d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39596/0 (socket says 172.21.15.157:39596) 2021-10-08T19:21:00.464 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.460+0000 7f77577fe700 1 -- 172.21.15.157:0/1506662766 learned_addr learned my addr 172.21.15.157:0/1506662766 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:21:00.464 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.460+0000 7f77577fe700 1 -- 172.21.15.157:0/1506662766 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7748005040 con 0x7f77580f80d0 2021-10-08T19:21:00.465 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.460+0000 7f77577fe700 1 --2- 172.21.15.157:0/1506662766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 0x7f775806d290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7748004dd0 tx=0x7f7748009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:00.465 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.460+0000 7f773ffff700 1 -- 172.21.15.157:0/1506662766 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f774801a070 con 0x7f77580f80d0 2021-10-08T19:21:00.465 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.460+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775806b910 con 0x7f77580f80d0 2021-10-08T19:21:00.465 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.460+0000 7f773ffff700 1 -- 172.21.15.157:0/1506662766 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f7748014d00 con 0x7f77580f80d0 2021-10-08T19:21:00.466 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.460+0000 7f773ffff700 1 -- 172.21.15.157:0/1506662766 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f774801eb80 con 0x7f77580f80d0 2021-10-08T19:21:00.466 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.460+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775806bda0 con 0x7f77580f80d0 2021-10-08T19:21:00.466 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.461+0000 7f773ffff700 1 -- 172.21.15.157:0/1506662766 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7f7748025030 con 0x7f77580f80d0 2021-10-08T19:21:00.466 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.461+0000 7f773ffff700 1 --2- 172.21.15.157:0/1506662766 >> v2:172.21.15.157:6800/3606206634 conn(0x7f77400336f0 0x7f7740035ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:00.466 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.461+0000 7f773ffff700 1 -- 172.21.15.157:0/1506662766 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f774801ee40 con 0x7f77580f80d0 2021-10-08T19:21:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.461+0000 7f7756ffd700 1 --2- 172.21.15.157:0/1506662766 >> v2:172.21.15.157:6800/3606206634 conn(0x7f77400336f0 0x7f7740035ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.462+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775805a9f0 con 0x7f77580f80d0 2021-10-08T19:21:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.462+0000 7f7756ffd700 1 --2- 172.21.15.157:0/1506662766 >> v2:172.21.15.157:6800/3606206634 conn(0x7f77400336f0 0x7f7740035ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f774c0096a0 tx=0x7f774c006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.466+0000 7f773ffff700 1 -- 172.21.15.157:0/1506662766 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7748023070 con 0x7f77580f80d0 2021-10-08T19:21:00.646 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.645+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f77580fd3f0 con 0x7f77400336f0 2021-10-08T19:21:00.649 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.648+0000 7f773ffff700 1 -- 172.21.15.157:0/1506662766 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f77580fd3f0 con 0x7f77400336f0 2021-10-08T19:21:00.652 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 >> v2:172.21.15.157:6800/3606206634 conn(0x7f77400336f0 msgr2=0x7f7740035ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:00.652 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 --2- 172.21.15.157:0/1506662766 >> v2:172.21.15.157:6800/3606206634 conn(0x7f77400336f0 0x7f7740035ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f774c0096a0 tx=0x7f774c006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:00.652 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 msgr2=0x7f775806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:00.652 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 --2- 172.21.15.157:0/1506662766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 0x7f775806d290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7748004dd0 tx=0x7f7748009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:00.653 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 shutdown_connections 2021-10-08T19:21:00.653 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 --2- 172.21.15.157:0/1506662766 >> v2:172.21.15.157:6800/3606206634 conn(0x7f77400336f0 0x7f7740035ba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:00.653 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 --2- 172.21.15.157:0/1506662766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77580f80d0 0x7f775806d290 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:00.653 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 >> 172.21.15.157:0/1506662766 conn(0x7f77580f38e0 msgr2=0x7f77580f4660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:00.653 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 shutdown_connections 2021-10-08T19:21:00.654 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:00.651+0000 7f775dd78700 1 -- 172.21.15.157:0/1506662766 wait complete. 2021-10-08T19:21:01.508 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi196 2021-10-08T19:21:01.509 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:21:01.509 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/etc/ceph/ceph.conf 2021-10-08T19:21:01.526 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:21:01.527 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:01.583 INFO:tasks.cephadm:Adding host smithi196 to orchestrator... 2021-10-08T19:21:01.583 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch host add smithi196 2021-10-08T19:21:01.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:01.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: Updating smithi157:/etc/ceph/ceph.conf 2021-10-08T19:21:01.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: poll took 1612.216 ms: 1 events 2021-10-08T19:21:01.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:01.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:01.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:01.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:01 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:04.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:21:03 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:21:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:05.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:04 smithi157 ceph-mon[32847]: Sending message to agent on host smithi157 2021-10-08T19:21:05.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:04 smithi157 ceph-mon[32847]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:21:05.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:04 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:05.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:04 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:21:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:06.057 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:05 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi157 2021-10-08T19:21:08.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:21:08 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:21:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:09.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:09 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:09.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:09 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:21:09.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:09 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:21:09.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:09 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:09.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:09 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:21:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:09.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:09 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:09.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:09 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:09.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:09 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:11.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:11 smithi157 ceph-mon[32847]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:13.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:13 smithi157 ceph-mon[32847]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:14.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:14 smithi157 ceph-mon[32847]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:16.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:16 smithi157 ceph-mon[32847]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:18.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:18 smithi157 ceph-mon[32847]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:20.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:20 smithi157 ceph-mon[32847]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:22.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:22 smithi157 ceph-mon[32847]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:24.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:24 smithi157 ceph-mon[32847]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:26.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:26 smithi157 ceph-mon[32847]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:28.779 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:28 smithi157 ceph-mon[32847]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:30 smithi157 ceph-mon[32847]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:32.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:21:31 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:21:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:32 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:21:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:32 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:21:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:32 smithi157 ceph-mon[32847]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:34.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:34 smithi157 ceph-mon[32847]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:36.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:36 smithi157 ceph-mon[32847]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:38.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:38 smithi157 ceph-mon[32847]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:40.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:40 smithi157 ceph-mon[32847]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:42.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:42 smithi157 ceph-mon[32847]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:44 smithi157 ceph-mon[32847]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:46.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:46 smithi157 ceph-mon[32847]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:48.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:48 smithi157 ceph-mon[32847]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:49.118 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.114+0000 7f7bc909b700 1 -- 172.21.15.196:0/3960797317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 msgr2=0x7f7bc40f84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:49.118 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.114+0000 7f7bc909b700 1 --2- 172.21.15.196:0/3960797317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 0x7f7bc40f84e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009fb0 tx=0x7f7bb4009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:49.118 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.114+0000 7f7bc909b700 1 -- 172.21.15.196:0/3960797317 shutdown_connections 2021-10-08T19:21:49.119 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.114+0000 7f7bc909b700 1 --2- 172.21.15.196:0/3960797317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 0x7f7bc40f84e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:49.119 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.114+0000 7f7bc909b700 1 -- 172.21.15.196:0/3960797317 >> 172.21.15.196:0/3960797317 conn(0x7f7bc40f38e0 msgr2=0x7f7bc40f5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:49.119 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.114+0000 7f7bc909b700 1 -- 172.21.15.196:0/3960797317 shutdown_connections 2021-10-08T19:21:49.119 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.114+0000 7f7bc909b700 1 -- 172.21.15.196:0/3960797317 wait complete. 2021-10-08T19:21:49.119 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.115+0000 7f7bc909b700 1 Processor -- start 2021-10-08T19:21:49.120 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.115+0000 7f7bc909b700 1 -- start start 2021-10-08T19:21:49.120 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.115+0000 7f7bc909b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 0x7f7bc41078d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:49.120 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.115+0000 7f7bc909b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4107e10 con 0x7f7bc40f80d0 2021-10-08T19:21:49.120 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.115+0000 7f7bc2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 0x7f7bc41078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:49.121 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.115+0000 7f7bc2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 0x7f7bc41078d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.196:59478/0 (socket says 172.21.15.196:59478) 2021-10-08T19:21:49.121 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.115+0000 7f7bc2d9d700 1 -- 172.21.15.196:0/1704552887 learned_addr learned my addr 172.21.15.196:0/1704552887 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:21:49.121 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.115+0000 7f7bc2d9d700 1 -- 172.21.15.196:0/1704552887 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4005040 con 0x7f7bc40f80d0 2021-10-08T19:21:49.121 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.116+0000 7f7bc2d9d700 1 --2- 172.21.15.196:0/1704552887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 0x7f7bc41078d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4000c00 tx=0x7f7bb4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:49.121 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.116+0000 7f7bbbfff700 1 -- 172.21.15.196:0/1704552887 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb401a070 con 0x7f7bc40f80d0 2021-10-08T19:21:49.122 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.116+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc4108010 con 0x7f7bc40f80d0 2021-10-08T19:21:49.122 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.116+0000 7f7bbbfff700 1 -- 172.21.15.196:0/1704552887 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f7bb4014d00 con 0x7f7bc40f80d0 2021-10-08T19:21:49.122 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.116+0000 7f7bbbfff700 1 -- 172.21.15.196:0/1704552887 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb401ec70 con 0x7f7bc40f80d0 2021-10-08T19:21:49.122 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.116+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc4108cb0 con 0x7f7bc40f80d0 2021-10-08T19:21:49.123 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.117+0000 7f7bbbfff700 1 -- 172.21.15.196:0/1704552887 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7f7bb4025030 con 0x7f7bc40f80d0 2021-10-08T19:21:49.123 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.117+0000 7f7bbbfff700 1 --2- 172.21.15.196:0/1704552887 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7bb00336f0 0x7f7bb0035ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:49.123 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.117+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc41084a0 con 0x7f7bc40f80d0 2021-10-08T19:21:49.123 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.117+0000 7f7bbbfff700 1 -- 172.21.15.196:0/1704552887 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f7bb40452e0 con 0x7f7bc40f80d0 2021-10-08T19:21:49.123 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.117+0000 7f7bba59c700 1 --2- 172.21.15.196:0/1704552887 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7bb00336f0 0x7f7bb0035ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:49.124 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.117+0000 7f7bba59c700 1 --2- 172.21.15.196:0/1704552887 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7bb00336f0 0x7f7bb0035ba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0096a0 tx=0x7f7bac006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:49.124 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.122+0000 7f7bbbfff700 1 -- 172.21.15.196:0/1704552887 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7bb4023020 con 0x7f7bc40f80d0 2021-10-08T19:21:49.281 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:49.281+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bc4108ef0 con 0x7f7bb00336f0 2021-10-08T19:21:49.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:49 smithi157 ceph-mon[32847]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:49.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:49 smithi157 ceph-mon[32847]: poll took 48341.528 ms: 1 events 2021-10-08T19:21:50.190 INFO:teuthology.orchestra.run.smithi196.stdout:Added host 'smithi196' with addr '172.21.15.196' 2021-10-08T19:21:50.190 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.188+0000 7f7bbbfff700 1 -- 172.21.15.196:0/1704552887 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7bc4108ef0 con 0x7f7bb00336f0 2021-10-08T19:21:50.192 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7bb00336f0 msgr2=0x7f7bb0035ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:50.193 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 --2- 172.21.15.196:0/1704552887 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7bb00336f0 0x7f7bb0035ba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0096a0 tx=0x7f7bac006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:50.193 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 msgr2=0x7f7bc41078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:50.193 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 --2- 172.21.15.196:0/1704552887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 0x7f7bc41078d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4000c00 tx=0x7f7bb4009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:50.193 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 shutdown_connections 2021-10-08T19:21:50.194 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 --2- 172.21.15.196:0/1704552887 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7bb00336f0 0x7f7bb0035ba0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:50.194 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 --2- 172.21.15.196:0/1704552887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc40f80d0 0x7f7bc41078d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:50.194 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 >> 172.21.15.196:0/1704552887 conn(0x7f7bc40f38e0 msgr2=0x7f7bc40f46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:50.194 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 shutdown_connections 2021-10-08T19:21:50.194 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:50.191+0000 7f7bc909b700 1 -- 172.21.15.196:0/1704552887 wait complete. 2021-10-08T19:21:50.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: Deploying cephadm binary to smithi196 2021-10-08T19:21:50.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.154 seconds 2021-10-08T19:21:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: Executing took 0.143 seconds 2021-10-08T19:21:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: Added host smithi196 2021-10-08T19:21:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:50.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:50.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:50 smithi157 ceph-mon[32847]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:50.834 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch host ls --format=json 2021-10-08T19:21:51.930 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:51.931 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:51.931 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:51.931 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:51.931 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:51 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:51.932 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]: dispatch 2021-10-08T19:21:51.932 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]': finished 2021-10-08T19:21:52.621 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.618+0000 7f09a9653700 1 -- 172.21.15.196:0/1982449766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 msgr2=0x7f09a40fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:52.621 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.618+0000 7f09a9653700 1 --2- 172.21.15.196:0/1982449766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 0x7f09a40fe4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0994009fb0 tx=0x7f0994009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:52.621 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.618+0000 7f09a9653700 1 -- 172.21.15.196:0/1982449766 shutdown_connections 2021-10-08T19:21:52.622 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.618+0000 7f09a9653700 1 --2- 172.21.15.196:0/1982449766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 0x7f09a40fe4a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:52.622 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.618+0000 7f09a9653700 1 -- 172.21.15.196:0/1982449766 >> 172.21.15.196:0/1982449766 conn(0x7f09a40f3d10 msgr2=0x7f09a40f6120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:52.622 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.618+0000 7f09a9653700 1 -- 172.21.15.196:0/1982449766 shutdown_connections 2021-10-08T19:21:52.622 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.618+0000 7f09a9653700 1 -- 172.21.15.196:0/1982449766 wait complete. 2021-10-08T19:21:52.623 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.619+0000 7f09a9653700 1 Processor -- start 2021-10-08T19:21:52.623 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.619+0000 7f09a9653700 1 -- start start 2021-10-08T19:21:52.623 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.619+0000 7f09a9653700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 0x7f09a410d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:52.624 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.619+0000 7f09a9653700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a410dec0 con 0x7f09a40fe0d0 2021-10-08T19:21:52.624 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.619+0000 7f09a2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 0x7f09a410d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:52.624 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.619+0000 7f09a2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 0x7f09a410d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.196:59484/0 (socket says 172.21.15.196:59484) 2021-10-08T19:21:52.624 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.619+0000 7f09a2ffd700 1 -- 172.21.15.196:0/3950979924 learned_addr learned my addr 172.21.15.196:0/3950979924 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:21:52.624 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.620+0000 7f09a2ffd700 1 -- 172.21.15.196:0/3950979924 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994005040 con 0x7f09a40fe0d0 2021-10-08T19:21:52.625 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.620+0000 7f09a2ffd700 1 --2- 172.21.15.196:0/3950979924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 0x7f09a410d980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09940045a0 tx=0x7f0994009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:52.625 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.620+0000 7f099bfff700 1 -- 172.21.15.196:0/3950979924 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f099401a070 con 0x7f09a40fe0d0 2021-10-08T19:21:52.625 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.620+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a410e0c0 con 0x7f09a40fe0d0 2021-10-08T19:21:52.625 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.620+0000 7f099bfff700 1 -- 172.21.15.196:0/3950979924 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f0994014d00 con 0x7f09a40fe0d0 2021-10-08T19:21:52.626 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.620+0000 7f099bfff700 1 -- 172.21.15.196:0/3950979924 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f099401eb40 con 0x7f09a40fe0d0 2021-10-08T19:21:52.626 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.620+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a410e550 con 0x7f09a40fe0d0 2021-10-08T19:21:52.627 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.621+0000 7f099bfff700 1 -- 172.21.15.196:0/3950979924 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7f099401ed70 con 0x7f09a40fe0d0 2021-10-08T19:21:52.627 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.621+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a405a9f0 con 0x7f09a40fe0d0 2021-10-08T19:21:52.628 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.621+0000 7f099bfff700 1 --2- 172.21.15.196:0/3950979924 >> v2:172.21.15.157:6800/3606206634 conn(0x7f09900336f0 0x7f0990035ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:52.628 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.621+0000 7f099bfff700 1 -- 172.21.15.196:0/3950979924 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f0994045280 con 0x7f09a40fe0d0 2021-10-08T19:21:52.628 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.621+0000 7f099a7fc700 1 --2- 172.21.15.196:0/3950979924 >> v2:172.21.15.157:6800/3606206634 conn(0x7f09900336f0 0x7f0990035ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:52.628 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.621+0000 7f099a7fc700 1 --2- 172.21.15.196:0/3950979924 >> v2:172.21.15.157:6800/3606206634 conn(0x7f09900336f0 0x7f0990035ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f098c0096a0 tx=0x7f098c006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:52.628 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.626+0000 7f099bfff700 1 -- 172.21.15.196:0/3950979924 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f0994013570 con 0x7f09a40fe0d0 2021-10-08T19:21:52.807 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.806+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09a40472f0 con 0x7f09900336f0 2021-10-08T19:21:52.809 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.808+0000 7f099bfff700 1 -- 172.21.15.196:0/3950979924 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f09a40472f0 con 0x7f09900336f0 2021-10-08T19:21:52.809 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:21:52.809 INFO:teuthology.orchestra.run.smithi196.stdout:[{"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}, {"addr": "172.21.15.196", "hostname": "smithi196", "labels": [], "status": ""}] 2021-10-08T19:21:52.810 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 >> v2:172.21.15.157:6800/3606206634 conn(0x7f09900336f0 msgr2=0x7f0990035ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:52.811 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 --2- 172.21.15.196:0/3950979924 >> v2:172.21.15.157:6800/3606206634 conn(0x7f09900336f0 0x7f0990035ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f098c0096a0 tx=0x7f098c006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:52.811 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 msgr2=0x7f09a410d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:52.811 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 --2- 172.21.15.196:0/3950979924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 0x7f09a410d980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09940045a0 tx=0x7f0994009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:52.811 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 shutdown_connections 2021-10-08T19:21:52.812 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 --2- 172.21.15.196:0/3950979924 >> v2:172.21.15.157:6800/3606206634 conn(0x7f09900336f0 0x7f0990035ba0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:52.812 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 --2- 172.21.15.196:0/3950979924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09a40fe0d0 0x7f09a410d980 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:52.812 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 >> 172.21.15.196:0/3950979924 conn(0x7f09a40f3d10 msgr2=0x7f09a40f4950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:52.812 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 shutdown_connections 2021-10-08T19:21:52.813 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:52.810+0000 7f09a9653700 1 -- 172.21.15.196:0/3950979924 wait complete. 2021-10-08T19:21:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: Deploying daemon agent.smithi196 on smithi196 2021-10-08T19:21:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.163 seconds 2021-10-08T19:21:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:53.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:53.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: Updating smithi196:/etc/ceph/ceph.conf 2021-10-08T19:21:53.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:53.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:53.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:53.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:53.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:53.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:53.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:53.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:53.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:53.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:52 smithi157 ceph-mon[32847]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:53.639 INFO:tasks.cephadm:Setting crush tunables to default 2021-10-08T19:21:53.640 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd crush tunables default 2021-10-08T19:21:54.535 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:54 smithi157 ceph-mon[32847]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:21:55.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:55 smithi157 ceph-mon[32847]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:55.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:55 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:55.914 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.908+0000 7f319ccf7700 1 -- 172.21.15.157:0/2452056756 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3194014810 con 0x7f31980fdf20 2021-10-08T19:21:55.914 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.909+0000 7f319ecfb700 1 -- 172.21.15.157:0/2452056756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 msgr2=0x7f31980fe2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:55.915 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.909+0000 7f319ecfb700 1 --2- 172.21.15.157:0/2452056756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 0x7f31980fe2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3194009fb0 tx=0x7f3194009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:55.915 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.909+0000 7f319ecfb700 1 -- 172.21.15.157:0/2452056756 shutdown_connections 2021-10-08T19:21:55.916 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.909+0000 7f319ecfb700 1 --2- 172.21.15.157:0/2452056756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 0x7f31980fe2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:55.916 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.909+0000 7f319ecfb700 1 -- 172.21.15.157:0/2452056756 >> 172.21.15.157:0/2452056756 conn(0x7f31980f3b40 msgr2=0x7f31980f5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:55.916 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.909+0000 7f319ecfb700 1 -- 172.21.15.157:0/2452056756 shutdown_connections 2021-10-08T19:21:55.916 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.909+0000 7f319ecfb700 1 -- 172.21.15.157:0/2452056756 wait complete. 2021-10-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.909+0000 7f319ecfb700 1 Processor -- start 2021-10-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.909+0000 7f319ecfb700 1 -- start start 2021-10-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f319ecfb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 0x7f319810d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f319ecfb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319810dd20 con 0x7f31980fdf20 2021-10-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f319dcf9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 0x7f319810d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:55.918 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f319dcf9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 0x7f319810d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39612/0 (socket says 172.21.15.157:39612) 2021-10-08T19:21:55.918 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f319dcf9700 1 -- 172.21.15.157:0/587688510 learned_addr learned my addr 172.21.15.157:0/587688510 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:21:55.918 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f319dcf9700 1 -- 172.21.15.157:0/587688510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194005040 con 0x7f31980fdf20 2021-10-08T19:21:55.918 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f319dcf9700 1 --2- 172.21.15.157:0/587688510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 0x7f319810d7e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f31940145a0 tx=0x7f3194009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:55.919 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f318e7fc700 1 -- 172.21.15.157:0/587688510 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f319401a070 con 0x7f31980fdf20 2021-10-08T19:21:55.919 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319810df20 con 0x7f31980fdf20 2021-10-08T19:21:55.919 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f318e7fc700 1 -- 172.21.15.157:0/587688510 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f3194014d00 con 0x7f31980fdf20 2021-10-08T19:21:55.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f318e7fc700 1 -- 172.21.15.157:0/587688510 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f319401eb10 con 0x7f31980fdf20 2021-10-08T19:21:55.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.910+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319810e3b0 con 0x7f31980fdf20 2021-10-08T19:21:55.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.911+0000 7f318e7fc700 1 -- 172.21.15.157:0/587688510 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7f3194025030 con 0x7f31980fdf20 2021-10-08T19:21:55.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.911+0000 7f318e7fc700 1 --2- 172.21.15.157:0/587688510 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3184033740 0x7f3184035bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:55.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.911+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319805a9f0 con 0x7f31980fdf20 2021-10-08T19:21:55.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.911+0000 7f318e7fc700 1 -- 172.21.15.157:0/587688510 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f31940453b0 con 0x7f31980fdf20 2021-10-08T19:21:55.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.911+0000 7f319d4f8700 1 --2- 172.21.15.157:0/587688510 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3184033740 0x7f3184035bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:55.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.912+0000 7f319d4f8700 1 --2- 172.21.15.157:0/587688510 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3184033740 0x7f3184035bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f31880096a0 tx=0x7f3188006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:55.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:55.916+0000 7f318e7fc700 1 -- 172.21.15.157:0/587688510 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f3194013da0 con 0x7f31980fdf20 2021-10-08T19:21:56.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:21:55 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:21:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:56.084 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.082+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f31980472f0 con 0x7f31980fdf20 2021-10-08T19:21:56.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:21:56 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:21:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:56.965 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.965+0000 7f318e7fc700 1 -- 172.21.15.157:0/587688510 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3194023070 con 0x7f31980fdf20 2021-10-08T19:21:56.967 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3184033740 msgr2=0x7f3184035bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:56.968 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 --2- 172.21.15.157:0/587688510 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3184033740 0x7f3184035bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f31880096a0 tx=0x7f3188006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:56.968 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 msgr2=0x7f319810d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:56.968 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 --2- 172.21.15.157:0/587688510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 0x7f319810d7e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f31940145a0 tx=0x7f3194009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:56.968 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 shutdown_connections 2021-10-08T19:21:56.969 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 --2- 172.21.15.157:0/587688510 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3184033740 0x7f3184035bf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:56.969 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 --2- 172.21.15.157:0/587688510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31980fdf20 0x7f319810d7e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:56.969 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 >> 172.21.15.157:0/587688510 conn(0x7f31980f3b40 msgr2=0x7f31980f4780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:56.969 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 shutdown_connections 2021-10-08T19:21:56.969 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:21:56.967+0000 7f319ecfb700 1 -- 172.21.15.157:0/587688510 wait complete. 2021-10-08T19:21:56.970 INFO:teuthology.orchestra.run.smithi157.stderr:adjusted tunables profile to default 2021-10-08T19:21:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:56 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:21:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:56 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:21:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:56 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:21:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/587688510' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-10-08T19:21:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:56 smithi157 ceph-mon[32847]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:57.526 INFO:tasks.cephadm:Adding mon.a on smithi157 2021-10-08T19:21:57.526 INFO:tasks.cephadm:Adding mon.c on smithi157 2021-10-08T19:21:57.527 INFO:tasks.cephadm:Adding mon.b on smithi196 2021-10-08T19:21:57.527 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch apply mon '3;smithi157:172.21.15.157=a;smithi157:[v2:172.21.15.157:3301,v1:172.21.15.157:6790]=c;smithi196:172.21.15.196=b' 2021-10-08T19:21:58.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:57 smithi157 ceph-mon[32847]: Sending message to agent on host smithi196 2021-10-08T19:21:58.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:57 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:21:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:21:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:57 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi196 2021-10-08T19:21:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/587688510' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-10-08T19:21:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:57 smithi157 ceph-mon[32847]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:21:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:21:58 smithi157 ceph-mon[32847]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:21:59.964 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.962+0000 7efcd1d17700 1 -- 172.21.15.196:0/1074283995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 msgr2=0x7efccc0fd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:59.964 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.962+0000 7efcd1d17700 1 --2- 172.21.15.196:0/1074283995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 0x7efccc0fd3a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009fb0 tx=0x7efcbc009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:59.965 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.962+0000 7efcd1d17700 1 -- 172.21.15.196:0/1074283995 shutdown_connections 2021-10-08T19:21:59.965 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.962+0000 7efcd1d17700 1 --2- 172.21.15.196:0/1074283995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 0x7efccc0fd3a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:59.965 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.962+0000 7efcd1d17700 1 -- 172.21.15.196:0/1074283995 >> 172.21.15.196:0/1074283995 conn(0x7efccc0f2bf0 msgr2=0x7efccc0f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:59.965 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.962+0000 7efcd1d17700 1 -- 172.21.15.196:0/1074283995 shutdown_connections 2021-10-08T19:21:59.965 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.962+0000 7efcd1d17700 1 -- 172.21.15.196:0/1074283995 wait complete. 2021-10-08T19:21:59.966 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.962+0000 7efcd1d17700 1 Processor -- start 2021-10-08T19:21:59.966 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.963+0000 7efcd1d17700 1 -- start start 2021-10-08T19:21:59.966 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.963+0000 7efcd1d17700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 0x7efccc10c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:59.966 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.963+0000 7efcd1d17700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc10cdb0 con 0x7efccc0fcfd0 2021-10-08T19:21:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.963+0000 7efccb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 0x7efccc10c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.963+0000 7efccb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 0x7efccc10c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.196:59492/0 (socket says 172.21.15.196:59492) 2021-10-08T19:21:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.963+0000 7efccb7fe700 1 -- 172.21.15.196:0/3516097595 learned_addr learned my addr 172.21.15.196:0/3516097595 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:21:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.964+0000 7efccb7fe700 1 -- 172.21.15.196:0/3516097595 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc005040 con 0x7efccc0fcfd0 2021-10-08T19:21:59.969 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.964+0000 7efccb7fe700 1 --2- 172.21.15.196:0/3516097595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 0x7efccc10c870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0045a0 tx=0x7efcbc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:59.970 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.964+0000 7efcc8ff9700 1 -- 172.21.15.196:0/3516097595 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcbc01a070 con 0x7efccc0fcfd0 2021-10-08T19:21:59.970 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.964+0000 7efcc8ff9700 1 -- 172.21.15.196:0/3516097595 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7efcbc014d00 con 0x7efccc0fcfd0 2021-10-08T19:21:59.970 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.964+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc10cfb0 con 0x7efccc0fcfd0 2021-10-08T19:21:59.970 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.964+0000 7efcc8ff9700 1 -- 172.21.15.196:0/3516097595 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcbc01eb40 con 0x7efccc0fcfd0 2021-10-08T19:21:59.971 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.964+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc10d380 con 0x7efccc0fcfd0 2021-10-08T19:21:59.971 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.965+0000 7efcc8ff9700 1 -- 172.21.15.196:0/3516097595 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7efcbc01ed70 con 0x7efccc0fcfd0 2021-10-08T19:21:59.971 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.965+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc05a9f0 con 0x7efccc0fcfd0 2021-10-08T19:21:59.972 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.965+0000 7efcc8ff9700 1 --2- 172.21.15.196:0/3516097595 >> v2:172.21.15.157:6800/3606206634 conn(0x7efcb80336f0 0x7efcb8035ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:59.972 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.965+0000 7efcc8ff9700 1 -- 172.21.15.196:0/3516097595 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7efcbc045560 con 0x7efccc0fcfd0 2021-10-08T19:21:59.972 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.966+0000 7efcc2ffd700 1 --2- 172.21.15.196:0/3516097595 >> v2:172.21.15.157:6800/3606206634 conn(0x7efcb80336f0 0x7efcb8035ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:59.972 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.966+0000 7efcc2ffd700 1 --2- 172.21.15.196:0/3516097595 >> v2:172.21.15.157:6800/3606206634 conn(0x7efcb80336f0 0x7efcb8035ba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efcb40096a0 tx=0x7efcb4006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:21:59.970+0000 7efcc8ff9700 1 -- 172.21.15.196:0/3516097595 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7efcbc0137a0 con 0x7efccc0fcfd0 2021-10-08T19:22:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.153+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi157:172.21.15.157=a;smithi157:[v2:172.21.15.157:3301,v1:172.21.15.157:6790]=c;smithi196:172.21.15.196=b", "target": ["mon-mgr", ""]}) v1 -- 0x7efccc107f30 con 0x7efcb80336f0 2021-10-08T19:22:00.159 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.158+0000 7efcc8ff9700 1 -- 172.21.15.196:0/3516097595 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7efccc107f30 con 0x7efcb80336f0 2021-10-08T19:22:00.159 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mon update... 2021-10-08T19:22:00.160 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.159+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 >> v2:172.21.15.157:6800/3606206634 conn(0x7efcb80336f0 msgr2=0x7efcb8035ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:00.161 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.159+0000 7efcd1d17700 1 --2- 172.21.15.196:0/3516097595 >> v2:172.21.15.157:6800/3606206634 conn(0x7efcb80336f0 0x7efcb8035ba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efcb40096a0 tx=0x7efcb4006b40 comp rx=0 tx=0).stop 2021-10-08T19:22:00.161 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.159+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 msgr2=0x7efccc10c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:00.161 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.159+0000 7efcd1d17700 1 --2- 172.21.15.196:0/3516097595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 0x7efccc10c870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0045a0 tx=0x7efcbc009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:00.161 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.160+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 shutdown_connections 2021-10-08T19:22:00.162 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.160+0000 7efcd1d17700 1 --2- 172.21.15.196:0/3516097595 >> v2:172.21.15.157:6800/3606206634 conn(0x7efcb80336f0 0x7efcb8035ba0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:00.162 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.160+0000 7efcd1d17700 1 --2- 172.21.15.196:0/3516097595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efccc0fcfd0 0x7efccc10c870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:00.162 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.160+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 >> 172.21.15.196:0/3516097595 conn(0x7efccc0f2bf0 msgr2=0x7efccc0f3830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:00.162 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.160+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 shutdown_connections 2021-10-08T19:22:00.163 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:00.160+0000 7efcd1d17700 1 -- 172.21.15.196:0/3516097595 wait complete. 2021-10-08T19:22:00.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:22:00 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:22:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:00.762 DEBUG:teuthology.orchestra.run.smithi157:mon.c> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.c.service 2021-10-08T19:22:00.770 DEBUG:teuthology.orchestra.run.smithi196:mon.b> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.b.service 2021-10-08T19:22:00.790 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:22:00.791 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:22:00.795 INFO:journalctl@ceph.mon.c.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:22:00.814 INFO:journalctl@ceph.mon.b.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:22:01.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:01.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:01.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:01.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:01.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:22:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:01.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:01.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:01.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:01.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi157:172.21.15.157=a;smithi157:[v2:172.21.15.157:3301,v1:172.21.15.157:6790]=c;smithi196:172.21.15.196=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:01.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: Saving service mon spec with placement smithi157:172.21.15.157=a;smithi157:[v2:172.21.15.157:3301,v1:172.21.15.157:6790]=c;smithi196:172.21.15.196=b;count:3 2021-10-08T19:22:01.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:01.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:01.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:01.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:01.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:01.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:01.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:01.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: Deploying daemon mon.c on smithi157 2021-10-08T19:22:01.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: poll took 7947.037 ms: 1 events 2021-10-08T19:22:01.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:01 smithi157 ceph-mon[32847]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:02.511 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.505+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3167381938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 msgr2=0x7f7e180fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:02.512 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.505+0000 7f7e1c8c1700 1 --2- 172.21.15.196:0/3167381938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 0x7f7e180fe4a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009fb0 tx=0x7f7e08009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:02.512 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.505+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3167381938 shutdown_connections 2021-10-08T19:22:02.512 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.505+0000 7f7e1c8c1700 1 --2- 172.21.15.196:0/3167381938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 0x7f7e180fe4a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:02.513 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.505+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3167381938 >> 172.21.15.196:0/3167381938 conn(0x7f7e180f3d10 msgr2=0x7f7e180f6120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:02.513 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.505+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3167381938 shutdown_connections 2021-10-08T19:22:02.513 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.505+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3167381938 wait complete. 2021-10-08T19:22:02.513 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.506+0000 7f7e1c8c1700 1 Processor -- start 2021-10-08T19:22:02.514 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.506+0000 7f7e1c8c1700 1 -- start start 2021-10-08T19:22:02.514 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.506+0000 7f7e1c8c1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 0x7f7e1810da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:02.514 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.506+0000 7f7e1c8c1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1810df80 con 0x7f7e180fe0d0 2021-10-08T19:22:02.515 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.506+0000 7f7e1659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 0x7f7e1810da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:02.515 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.506+0000 7f7e1659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 0x7f7e1810da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.196:59500/0 (socket says 172.21.15.196:59500) 2021-10-08T19:22:02.515 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.506+0000 7f7e1659c700 1 -- 172.21.15.196:0/3147266593 learned_addr learned my addr 172.21.15.196:0/3147266593 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:22:02.515 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.506+0000 7f7e1659c700 1 -- 172.21.15.196:0/3147266593 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08005040 con 0x7f7e180fe0d0 2021-10-08T19:22:02.516 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.507+0000 7f7e1659c700 1 --2- 172.21.15.196:0/3147266593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 0x7f7e1810da40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e080045a0 tx=0x7f7e08009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:02.516 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.507+0000 7f7e06ffd700 1 -- 172.21.15.196:0/3147266593 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e0801a070 con 0x7f7e180fe0d0 2021-10-08T19:22:02.516 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.507+0000 7f7e06ffd700 1 -- 172.21.15.196:0/3147266593 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f7e08014d00 con 0x7f7e180fe0d0 2021-10-08T19:22:02.516 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.507+0000 7f7e06ffd700 1 -- 172.21.15.196:0/3147266593 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e0801eb40 con 0x7f7e180fe0d0 2021-10-08T19:22:02.516 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.507+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1810e180 con 0x7f7e180fe0d0 2021-10-08T19:22:02.517 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.507+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1810e590 con 0x7f7e180fe0d0 2021-10-08T19:22:02.517 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.508+0000 7f7e06ffd700 1 -- 172.21.15.196:0/3147266593 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7f7e0801ed70 con 0x7f7e180fe0d0 2021-10-08T19:22:02.517 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.508+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1805a9f0 con 0x7f7e180fe0d0 2021-10-08T19:22:02.517 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.508+0000 7f7e06ffd700 1 --2- 172.21.15.196:0/3147266593 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e000336f0 0x7f7e00035ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:02.517 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.508+0000 7f7e06ffd700 1 -- 172.21.15.196:0/3147266593 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f7e080452e0 con 0x7f7e180fe0d0 2021-10-08T19:22:02.518 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.508+0000 7f7e15d9b700 1 --2- 172.21.15.196:0/3147266593 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e000336f0 0x7f7e00035ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:02.518 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.508+0000 7f7e15d9b700 1 --2- 172.21.15.196:0/3147266593 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e000336f0 0x7f7e00035ba0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0096a0 tx=0x7f7e0c006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:02.518 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.512+0000 7f7e06ffd700 1 -- 172.21.15.196:0/3147266593 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7e08013980 con 0x7f7e180fe0d0 2021-10-08T19:22:02.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:02 smithi157 ceph-mon[32847]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:02.734 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.734+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7e18109020 con 0x7f7e180fe0d0 2021-10-08T19:22:02.735 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.734+0000 7f7e06ffd700 1 -- 172.21.15.196:0/3147266593 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+694 (secure 0 0 0) 0x7f7e08023030 con 0x7f7e180fe0d0 2021-10-08T19:22:02.736 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:22:02.736 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":1,"fsid":"906d7a14-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:20:00.604350Z","created":"2021-10-08T19:20:00.604350Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-10-08T19:22:02.737 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.736+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e000336f0 msgr2=0x7f7e00035ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:02.737 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.736+0000 7f7e1c8c1700 1 --2- 172.21.15.196:0/3147266593 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e000336f0 0x7f7e00035ba0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0096a0 tx=0x7f7e0c006b40 comp rx=0 tx=0).stop 2021-10-08T19:22:02.738 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.736+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 msgr2=0x7f7e1810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:02.738 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.736+0000 7f7e1c8c1700 1 --2- 172.21.15.196:0/3147266593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 0x7f7e1810da40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e080045a0 tx=0x7f7e08009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:02.738 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.736+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 shutdown_connections 2021-10-08T19:22:02.738 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.736+0000 7f7e1c8c1700 1 --2- 172.21.15.196:0/3147266593 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e000336f0 0x7f7e00035ba0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:02.739 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.736+0000 7f7e1c8c1700 1 --2- 172.21.15.196:0/3147266593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e180fe0d0 0x7f7e1810da40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:02.739 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.736+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 >> 172.21.15.196:0/3147266593 conn(0x7f7e180f3d10 msgr2=0x7f7e180f5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:02.739 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.737+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 shutdown_connections 2021-10-08T19:22:02.739 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:02.737+0000 7f7e1c8c1700 1 -- 172.21.15.196:0/3147266593 wait complete. 2021-10-08T19:22:02.740 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 1 2021-10-08T19:22:03.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:02 smithi157 systemd[1]: Starting Ceph mon.c for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:22:03.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/3147266593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:22:03.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: set uid:gid to 167:167 (ceph:ceph) 2021-10-08T19:22:03.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev), process ceph-mon, pid 7 2021-10-08T19:22:03.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pidfile_write: ignore empty --pid-file 2021-10-08T19:22:03.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: load: jerasure load: lrc 2021-10-08T19:22:03.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: RocksDB version: 6.15.5 2021-10-08T19:22:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-10-08T19:22:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Compile date Oct 7 2021 2021-10-08T19:22:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: DB SUMMARY 2021-10-08T19:22:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: DB Session ID: S0EY7VJXT7FWJL5MB9J5 2021-10-08T19:22:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: CURRENT file: CURRENT 2021-10-08T19:22:03.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: IDENTITY file: IDENTITY 2021-10-08T19:22:03.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2021-10-08T19:22:03.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-10-08T19:22:03.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2021-10-08T19:22:03.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.error_if_exists: 0 2021-10-08T19:22:03.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.create_if_missing: 0 2021-10-08T19:22:03.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.paranoid_checks: 1 2021-10-08T19:22:03.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-10-08T19:22:03.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.env: 0x55ae791adb60 2021-10-08T19:22:03.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.fs: Posix File System 2021-10-08T19:22:03.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.info_log: 0x55ae7b898120 2021-10-08T19:22:03.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_file_opening_threads: 16 2021-10-08T19:22:03.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.statistics: (nil) 2021-10-08T19:22:03.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.use_fsync: 0 2021-10-08T19:22:03.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_log_file_size: 0 2021-10-08T19:22:03.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-10-08T19:22:03.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.log_file_time_to_roll: 0 2021-10-08T19:22:03.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.keep_log_file_num: 1000 2021-10-08T19:22:03.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.recycle_log_file_num: 0 2021-10-08T19:22:03.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.allow_fallocate: 1 2021-10-08T19:22:03.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 bash[41904]: ab5a87cca94f447e6a354aef1e9f8a3f18e3bf54bf2598524ee7ed819d33f56b 2021-10-08T19:22:03.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.allow_mmap_reads: 0 2021-10-08T19:22:03.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.allow_mmap_writes: 0 2021-10-08T19:22:03.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.use_direct_reads: 0 2021-10-08T19:22:03.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-10-08T19:22:03.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.create_missing_column_families: 0 2021-10-08T19:22:03.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.db_log_dir: 2021-10-08T19:22:03.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-10-08T19:22:03.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.table_cache_numshardbits: 6 2021-10-08T19:22:03.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.WAL_ttl_seconds: 0 2021-10-08T19:22:03.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.WAL_size_limit_MB: 0 2021-10-08T19:22:03.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-10-08T19:22:03.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-10-08T19:22:03.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.is_fd_close_on_exec: 1 2021-10-08T19:22:03.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.advise_random_on_open: 1 2021-10-08T19:22:03.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.db_write_buffer_size: 0 2021-10-08T19:22:03.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.write_buffer_manager: 0x55ae7b90de00 2021-10-08T19:22:03.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-10-08T19:22:03.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-10-08T19:22:03.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-10-08T19:22:03.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.use_adaptive_mutex: 0 2021-10-08T19:22:03.846 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.rate_limiter: (nil) 2021-10-08T19:22:03.846 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-10-08T19:22:03.846 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.wal_recovery_mode: 2 2021-10-08T19:22:03.846 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.enable_thread_tracking: 0 2021-10-08T19:22:03.846 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.enable_pipelined_write: 0 2021-10-08T19:22:03.847 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.unordered_write: 0 2021-10-08T19:22:03.847 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-10-08T19:22:03.847 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-10-08T19:22:03.847 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-10-08T19:22:03.847 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-10-08T19:22:03.848 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.row_cache: None 2021-10-08T19:22:03.848 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.wal_filter: None 2021-10-08T19:22:03.848 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-10-08T19:22:03.849 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.allow_ingest_behind: 0 2021-10-08T19:22:03.849 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.preserve_deletes: 0 2021-10-08T19:22:03.849 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.two_write_queues: 0 2021-10-08T19:22:03.849 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.manual_wal_flush: 0 2021-10-08T19:22:03.850 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.atomic_flush: 0 2021-10-08T19:22:03.850 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-10-08T19:22:03.850 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.persist_stats_to_disk: 0 2021-10-08T19:22:03.850 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.write_dbid_to_manifest: 0 2021-10-08T19:22:03.850 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.log_readahead_size: 0 2021-10-08T19:22:03.851 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-10-08T19:22:03.851 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.best_efforts_recovery: 0 2021-10-08T19:22:03.851 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-10-08T19:22:03.851 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-10-08T19:22:03.852 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.allow_data_in_errors: 0 2021-10-08T19:22:03.852 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.db_host_id: __hostname__ 2021-10-08T19:22:03.852 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_background_jobs: 2 2021-10-08T19:22:03.852 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_background_compactions: -1 2021-10-08T19:22:03.852 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_subcompactions: 1 2021-10-08T19:22:03.853 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-10-08T19:22:03.853 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-10-08T19:22:03.853 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.delayed_write_rate : 16777216 2021-10-08T19:22:03.853 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_total_wal_size: 0 2021-10-08T19:22:03.854 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-10-08T19:22:03.854 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.stats_dump_period_sec: 600 2021-10-08T19:22:03.854 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.stats_persist_period_sec: 600 2021-10-08T19:22:03.855 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-10-08T19:22:03.855 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_open_files: -1 2021-10-08T19:22:03.855 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bytes_per_sync: 0 2021-10-08T19:22:03.855 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.wal_bytes_per_sync: 0 2021-10-08T19:22:03.855 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.strict_bytes_per_sync: 0 2021-10-08T19:22:03.856 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_readahead_size: 0 2021-10-08T19:22:03.856 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_background_flushes: -1 2021-10-08T19:22:03.856 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Compression algorithms supported: 2021-10-08T19:22:03.856 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-10-08T19:22:03.857 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: kZSTD supported: 0 2021-10-08T19:22:03.857 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: kXpressCompression supported: 0 2021-10-08T19:22:03.857 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: kLZ4HCCompression supported: 1 2021-10-08T19:22:03.857 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: kLZ4Compression supported: 1 2021-10-08T19:22:03.857 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: kBZip2Compression supported: 0 2021-10-08T19:22:03.858 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: kZlibCompression supported: 1 2021-10-08T19:22:03.858 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: kSnappyCompression supported: 1 2021-10-08T19:22:03.858 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Fast CRC32 supported: Supported on x86 2021-10-08T19:22:03.858 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2021-10-08T19:22:03.859 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-10-08T19:22:03.859 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-10-08T19:22:03.859 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.merge_operator: 2021-10-08T19:22:03.859 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_filter: None 2021-10-08T19:22:03.860 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_filter_factory: None 2021-10-08T19:22:03.860 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.sst_partitioner_factory: None 2021-10-08T19:22:03.860 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.memtable_factory: SkipListFactory 2021-10-08T19:22:03.860 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.table_factory: BlockBasedTable 2021-10-08T19:22:03.861 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ae7b861b80) 2021-10-08T19:22:03.861 INFO:journalctl@ceph.mon.c.smithi157.stdout: cache_index_and_filter_blocks: 1 2021-10-08T19:22:03.861 INFO:journalctl@ceph.mon.c.smithi157.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-10-08T19:22:03.862 INFO:journalctl@ceph.mon.c.smithi157.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-10-08T19:22:03.862 INFO:journalctl@ceph.mon.c.smithi157.stdout: pin_top_level_index_and_filter: 1 2021-10-08T19:22:03.862 INFO:journalctl@ceph.mon.c.smithi157.stdout: index_type: 0 2021-10-08T19:22:03.862 INFO:journalctl@ceph.mon.c.smithi157.stdout: data_block_index_type: 0 2021-10-08T19:22:03.862 INFO:journalctl@ceph.mon.c.smithi157.stdout: index_shortening: 1 2021-10-08T19:22:03.863 INFO:journalctl@ceph.mon.c.smithi157.stdout: data_block_hash_table_util_ratio: 0.750000 2021-10-08T19:22:03.863 INFO:journalctl@ceph.mon.c.smithi157.stdout: hash_index_allow_collision: 1 2021-10-08T19:22:03.863 INFO:journalctl@ceph.mon.c.smithi157.stdout: checksum: 1 2021-10-08T19:22:03.864 INFO:journalctl@ceph.mon.c.smithi157.stdout: no_block_cache: 0 2021-10-08T19:22:03.864 INFO:journalctl@ceph.mon.c.smithi157.stdout: block_cache: 0x55ae7b896d10 2021-10-08T19:22:03.864 INFO:journalctl@ceph.mon.c.smithi157.stdout: block_cache_name: BinnedLRUCache 2021-10-08T19:22:03.864 INFO:journalctl@ceph.mon.c.smithi157.stdout: block_cache_options: 2021-10-08T19:22:03.864 INFO:journalctl@ceph.mon.c.smithi157.stdout: capacity : 536870912 2021-10-08T19:22:03.865 INFO:journalctl@ceph.mon.c.smithi157.stdout: num_shard_bits : 4 2021-10-08T19:22:03.865 INFO:journalctl@ceph.mon.c.smithi157.stdout: strict_capacity_limit : 0 2021-10-08T19:22:03.865 INFO:journalctl@ceph.mon.c.smithi157.stdout: high_pri_pool_ratio: 0.000 2021-10-08T19:22:03.865 INFO:journalctl@ceph.mon.c.smithi157.stdout: block_cache_compressed: (nil) 2021-10-08T19:22:03.866 INFO:journalctl@ceph.mon.c.smithi157.stdout: persistent_cache: (nil) 2021-10-08T19:22:03.866 INFO:journalctl@ceph.mon.c.smithi157.stdout: block_size: 4096 2021-10-08T19:22:03.866 INFO:journalctl@ceph.mon.c.smithi157.stdout: block_size_deviation: 10 2021-10-08T19:22:03.866 INFO:journalctl@ceph.mon.c.smithi157.stdout: block_restart_interval: 16 2021-10-08T19:22:03.867 INFO:journalctl@ceph.mon.c.smithi157.stdout: index_block_restart_interval: 1 2021-10-08T19:22:03.867 INFO:journalctl@ceph.mon.c.smithi157.stdout: metadata_block_size: 4096 2021-10-08T19:22:03.867 INFO:journalctl@ceph.mon.c.smithi157.stdout: partition_filters: 0 2021-10-08T19:22:03.867 INFO:journalctl@ceph.mon.c.smithi157.stdout: use_delta_encoding: 1 2021-10-08T19:22:03.868 INFO:journalctl@ceph.mon.c.smithi157.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-10-08T19:22:03.868 INFO:journalctl@ceph.mon.c.smithi157.stdout: whole_key_filtering: 1 2021-10-08T19:22:03.868 INFO:journalctl@ceph.mon.c.smithi157.stdout: verify_compression: 0 2021-10-08T19:22:03.868 INFO:journalctl@ceph.mon.c.smithi157.stdout: read_amp_bytes_per_bit: 0 2021-10-08T19:22:03.868 INFO:journalctl@ceph.mon.c.smithi157.stdout: format_version: 4 2021-10-08T19:22:03.869 INFO:journalctl@ceph.mon.c.smithi157.stdout: enable_index_compression: 1 2021-10-08T19:22:03.869 INFO:journalctl@ceph.mon.c.smithi157.stdout: block_align: 0 2021-10-08T19:22:03.869 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.write_buffer_size: 33554432 2021-10-08T19:22:03.869 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_write_buffer_number: 2 2021-10-08T19:22:03.869 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compression: NoCompression 2021-10-08T19:22:03.870 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bottommost_compression: Disabled 2021-10-08T19:22:03.870 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.prefix_extractor: nullptr 2021-10-08T19:22:03.870 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-10-08T19:22:03.870 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.num_levels: 7 2021-10-08T19:22:03.870 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-10-08T19:22:03.871 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-10-08T19:22:03.871 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-10-08T19:22:03.871 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-10-08T19:22:03.871 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-10-08T19:22:03.872 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-10-08T19:22:03.872 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-10-08T19:22:03.872 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:22:03.872 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-10-08T19:22:03.872 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-10-08T19:22:03.873 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compression_opts.window_bits: -14 2021-10-08T19:22:03.873 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compression_opts.level: 32767 2021-10-08T19:22:03.873 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compression_opts.strategy: 0 2021-10-08T19:22:03.873 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-10-08T19:22:03.873 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:22:03.874 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-10-08T19:22:03.874 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compression_opts.enabled: false 2021-10-08T19:22:03.874 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-10-08T19:22:03.874 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-10-08T19:22:03.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-10-08T19:22:03.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.target_file_size_base: 67108864 2021-10-08T19:22:03.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.target_file_size_multiplier: 1 2021-10-08T19:22:03.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-10-08T19:22:03.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-10-08T19:22:03.876 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-10-08T19:22:03.876 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-10-08T19:22:03.876 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-10-08T19:22:03.876 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-10-08T19:22:03.877 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-10-08T19:22:03.877 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-10-08T19:22:03.877 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-10-08T19:22:03.877 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-10-08T19:22:03.878 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-10-08T19:22:03.878 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-10-08T19:22:03.878 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.arena_block_size: 4194304 2021-10-08T19:22:03.878 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-10-08T19:22:03.878 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-10-08T19:22:03.879 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-10-08T19:22:03.879 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.disable_auto_compactions: 0 2021-10-08T19:22:03.879 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-10-08T19:22:03.879 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-10-08T19:22:03.880 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-10-08T19:22:03.880 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-10-08T19:22:03.880 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-10-08T19:22:03.880 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-10-08T19:22:03.880 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-10-08T19:22:03.881 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-10-08T19:22:03.881 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-10-08T19:22:03.881 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-10-08T19:22:03.881 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.table_properties_collectors: 2021-10-08T19:22:03.882 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.inplace_update_support: 0 2021-10-08T19:22:03.882 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.inplace_update_num_locks: 10000 2021-10-08T19:22:03.882 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-10-08T19:22:03.882 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-10-08T19:22:03.882 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.memtable_huge_page_size: 0 2021-10-08T19:22:03.883 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.bloom_locality: 0 2021-10-08T19:22:03.883 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.max_successive_merges: 0 2021-10-08T19:22:03.883 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.optimize_filters_for_hits: 0 2021-10-08T19:22:03.883 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.paranoid_file_checks: 0 2021-10-08T19:22:03.884 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.force_consistency_checks: 1 2021-10-08T19:22:03.884 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.report_bg_io_stats: 0 2021-10-08T19:22:03.884 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.ttl: 2592000 2021-10-08T19:22:03.884 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.periodic_compaction_seconds: 0 2021-10-08T19:22:03.885 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.enable_blob_files: false 2021-10-08T19:22:03.885 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.min_blob_size: 0 2021-10-08T19:22:03.885 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.blob_file_size: 268435456 2021-10-08T19:22:03.885 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.blob_compression_type: NoCompression 2021-10-08T19:22:03.885 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.enable_blob_garbage_collection: false 2021-10-08T19:22:03.886 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-10-08T19:22:03.886 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-10-08T19:22:03.886 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2021-10-08T19:22:03.886 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2021-10-08T19:22:03.887 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720923467434, "job": 1, "event": "recovery_started", "wal_files": [4]} 2021-10-08T19:22:03.887 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2021-10-08T19:22:03.887 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-10-08T19:22:03.887 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720923467826, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720923, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "f4b38e89-213d-44e2-bd08-fd4260db390c", "db_session_id": "S0EY7VJXT7FWJL5MB9J5"}} 2021-10-08T19:22:03.887 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2021-10-08T19:22:03.888 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720923468286, "job": 1, "event": "recovery_finished"} 2021-10-08T19:22:03.888 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-10-08T19:22:03.888 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55ae7b8b2a80 2021-10-08T19:22:03.888 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: DB pointer 0x55ae7b8c2000 2021-10-08T19:22:03.889 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-10-08T19:22:03.889 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-10-08T19:22:03.889 INFO:journalctl@ceph.mon.c.smithi157.stdout: ** DB Stats ** 2021-10-08T19:22:03.889 INFO:journalctl@ceph.mon.c.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:22:03.889 INFO:journalctl@ceph.mon.c.smithi157.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-10-08T19:22:03.890 INFO:journalctl@ceph.mon.c.smithi157.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-10-08T19:22:03.890 INFO:journalctl@ceph.mon.c.smithi157.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:22:03.890 INFO:journalctl@ceph.mon.c.smithi157.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-10-08T19:22:03.890 INFO:journalctl@ceph.mon.c.smithi157.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-10-08T19:22:03.891 INFO:journalctl@ceph.mon.c.smithi157.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:22:03.891 INFO:journalctl@ceph.mon.c.smithi157.stdout: 2021-10-08T19:22:03.891 INFO:journalctl@ceph.mon.c.smithi157.stdout: ** Compaction Stats [default] ** 2021-10-08T19:22:03.891 INFO:journalctl@ceph.mon.c.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:22:03.891 INFO:journalctl@ceph.mon.c.smithi157.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:22:03.892 INFO:journalctl@ceph.mon.c.smithi157.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:03.892 INFO:journalctl@ceph.mon.c.smithi157.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:03.892 INFO:journalctl@ceph.mon.c.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:03.892 INFO:journalctl@ceph.mon.c.smithi157.stdout: 2021-10-08T19:22:03.893 INFO:journalctl@ceph.mon.c.smithi157.stdout: ** Compaction Stats [default] ** 2021-10-08T19:22:03.893 INFO:journalctl@ceph.mon.c.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:22:03.893 INFO:journalctl@ceph.mon.c.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:22:03.893 INFO:journalctl@ceph.mon.c.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:03.893 INFO:journalctl@ceph.mon.c.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:22:03.894 INFO:journalctl@ceph.mon.c.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:22:03.894 INFO:journalctl@ceph.mon.c.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:22:03.894 INFO:journalctl@ceph.mon.c.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:22:03.894 INFO:journalctl@ceph.mon.c.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:22:03.894 INFO:journalctl@ceph.mon.c.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:22:03.895 INFO:journalctl@ceph.mon.c.smithi157.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:22:03.895 INFO:journalctl@ceph.mon.c.smithi157.stdout: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:22:03.895 INFO:journalctl@ceph.mon.c.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:22:03.895 INFO:journalctl@ceph.mon.c.smithi157.stdout: 2021-10-08T19:22:03.896 INFO:journalctl@ceph.mon.c.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:22:03.896 INFO:journalctl@ceph.mon.c.smithi157.stdout: 2021-10-08T19:22:03.896 INFO:journalctl@ceph.mon.c.smithi157.stdout: ** Compaction Stats [default] ** 2021-10-08T19:22:03.896 INFO:journalctl@ceph.mon.c.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:22:03.896 INFO:journalctl@ceph.mon.c.smithi157.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:22:03.897 INFO:journalctl@ceph.mon.c.smithi157.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:03.897 INFO:journalctl@ceph.mon.c.smithi157.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:03.897 INFO:journalctl@ceph.mon.c.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-10-08T19:22:03.897 INFO:journalctl@ceph.mon.c.smithi157.stdout: 2021-10-08T19:22:03.897 INFO:journalctl@ceph.mon.c.smithi157.stdout: ** Compaction Stats [default] ** 2021-10-08T19:22:03.898 INFO:journalctl@ceph.mon.c.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:22:03.898 INFO:journalctl@ceph.mon.c.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:22:03.898 INFO:journalctl@ceph.mon.c.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:03.898 INFO:journalctl@ceph.mon.c.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:22:03.899 INFO:journalctl@ceph.mon.c.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:22:03.899 INFO:journalctl@ceph.mon.c.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:22:03.899 INFO:journalctl@ceph.mon.c.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:22:03.899 INFO:journalctl@ceph.mon.c.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:22:03.900 INFO:journalctl@ceph.mon.c.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:22:03.900 INFO:journalctl@ceph.mon.c.smithi157.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:22:03.900 INFO:journalctl@ceph.mon.c.smithi157.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:22:03.900 INFO:journalctl@ceph.mon.c.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:22:03.900 INFO:journalctl@ceph.mon.c.smithi157.stdout: 2021-10-08T19:22:03.901 INFO:journalctl@ceph.mon.c.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:22:03.901 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c does not exist in monmap, will attempt to join an existing cluster 2021-10-08T19:22:03.901 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: using public_addrv [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:22:03.901 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: starting mon.c rank -1 at public addrs [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] at bind addrs [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:22:03.902 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 systemd[1]: Started Ceph mon.c for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:22:03.902 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(???) e0 preinit fsid 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:22:03.902 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).mds e1 new map 2021-10-08T19:22:03.902 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).mds e1 print_map 2021-10-08T19:22:03.902 INFO:journalctl@ceph.mon.c.smithi157.stdout: e1 2021-10-08T19:22:03.903 INFO:journalctl@ceph.mon.c.smithi157.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-10-08T19:22:03.903 INFO:journalctl@ceph.mon.c.smithi157.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-10-08T19:22:03.903 INFO:journalctl@ceph.mon.c.smithi157.stdout: legacy client fscid: -1 2021-10-08T19:22:03.903 INFO:journalctl@ceph.mon.c.smithi157.stdout: 2021-10-08T19:22:03.903 INFO:journalctl@ceph.mon.c.smithi157.stdout: No filesystems configured 2021-10-08T19:22:03.904 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-10-08T19:22:03.904 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-10-08T19:22:03.904 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-10-08T19:22:03.904 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-10-08T19:22:03.905 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-10-08T19:22:03.905 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-10-08T19:22:03.905 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2021-10-08T19:22:03.905 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:22:03.905 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:22:03.906 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:22:03.906 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.906 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.906 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.906 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.907 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:03.907 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:21:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:03.907 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.907 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.907 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.908 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.908 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.908 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.908 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.908 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.909 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.909 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:03.909 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: poll took 48341.528 ms: 1 events 2021-10-08T19:22:03.909 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Deploying cephadm binary to smithi196 2021-10-08T19:22:03.909 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:03.910 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:03.910 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.154 seconds 2021-10-08T19:22:03.910 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Executing took 0.143 seconds 2021-10-08T19:22:03.910 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.911 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Added host smithi196 2021-10-08T19:22:03.911 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:03.911 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:03.911 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:03.911 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.912 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.912 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.912 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:22:03.912 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.913 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:03.913 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]: dispatch 2021-10-08T19:22:03.913 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]': finished 2021-10-08T19:22:03.913 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Deploying daemon agent.smithi196 on smithi196 2021-10-08T19:22:03.913 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.163 seconds 2021-10-08T19:22:03.914 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.914 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:03.914 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:03.914 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:03.914 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Updating smithi196:/etc/ceph/ceph.conf 2021-10-08T19:22:03.915 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:22:03.915 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.915 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.915 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:03.915 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:03.916 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:03.916 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:03.916 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.916 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:03.917 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.917 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:22:03.917 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.917 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.917 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.918 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:03.918 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:21:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:03.918 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/587688510' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-10-08T19:22:03.918 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.918 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Sending message to agent on host smithi196 2021-10-08T19:22:03.919 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:21:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:03.919 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi196 2021-10-08T19:22:03.919 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/587688510' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-10-08T19:22:03.919 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:03.920 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.920 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.920 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:03.920 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:03.921 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:03.921 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:22:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:03.921 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:03.921 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:03.921 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.922 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi157:172.21.15.157=a;smithi157:[v2:172.21.15.157:3301,v1:172.21.15.157:6790]=c;smithi196:172.21.15.196=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:03.922 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Saving service mon spec with placement smithi157:172.21.15.157=a;smithi157:[v2:172.21.15.157:3301,v1:172.21.15.157:6790]=c;smithi196:172.21.15.196=b;count:3 2021-10-08T19:22:03.922 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.922 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:03.923 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:03.923 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:03.923 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:03.923 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:03.923 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:03.924 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: Deploying daemon mon.c on smithi157 2021-10-08T19:22:03.924 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: poll took 7947.037 ms: 1 events 2021-10-08T19:22:03.924 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.924 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:03.924 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/3147266593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:22:03.925 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-10-08T19:22:03.925 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:03 smithi157 ceph-mon[42114]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2021-10-08T19:22:04.280 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:22:04.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:22:08.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:22:08.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: mon.a calling monitor election 2021-10-08T19:22:08.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: poll took 2976.557 ms: 1 events 2021-10-08T19:22:08.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:08.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: mon.c calling monitor election 2021-10-08T19:22:08.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:08.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:08.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:22:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: monmap e2: 2 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0]} 2021-10-08T19:22:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: fsmap 2021-10-08T19:22:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:08.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: mgrmap e13: y(active, since 79s) 2021-10-08T19:22:08.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: overall HEALTH_OK 2021-10-08T19:22:08.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:08.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:08.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:08.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:22:08.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: mon.a calling monitor election 2021-10-08T19:22:08.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: poll took 2976.557 ms: 1 events 2021-10-08T19:22:08.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:08.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: mon.c calling monitor election 2021-10-08T19:22:08.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:08.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:08.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:08.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:22:08.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: monmap e2: 2 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0]} 2021-10-08T19:22:08.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: fsmap 2021-10-08T19:22:08.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:08.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: mgrmap e13: y(active, since 79s) 2021-10-08T19:22:08.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: overall HEALTH_OK 2021-10-08T19:22:08.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:08.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:08.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:09.017 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.013+0000 7fa9f759e700 1 -- 172.21.15.196:0/3544409334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9e0003280 msgr2=0x7fa9e0005700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:09.017 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.013+0000 7fa9f759e700 1 --2- 172.21.15.196:0/3544409334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9e0003280 0x7fa9e0005700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80f8000 tx=0x7fa9e800b040 comp rx=0 tx=0).stop 2021-10-08T19:22:09.018 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.013+0000 7fa9f759e700 1 -- 172.21.15.196:0/3544409334 shutdown_connections 2021-10-08T19:22:09.018 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.013+0000 7fa9f759e700 1 --2- 172.21.15.196:0/3544409334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9e0003280 0x7fa9e0005700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:09.018 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.013+0000 7fa9f759e700 1 -- 172.21.15.196:0/3544409334 >> 172.21.15.196:0/3544409334 conn(0x7fa9f80f29e0 msgr2=0x7fa9f80f4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:09.019 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.013+0000 7fa9f759e700 1 -- 172.21.15.196:0/3544409334 shutdown_connections 2021-10-08T19:22:09.019 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.013+0000 7fa9f759e700 1 -- 172.21.15.196:0/3544409334 wait complete. 2021-10-08T19:22:09.019 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.014+0000 7fa9f759e700 1 Processor -- start 2021-10-08T19:22:09.020 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.014+0000 7fa9f759e700 1 -- start start 2021-10-08T19:22:09.020 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.014+0000 7fa9f759e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 0x7fa9f8108970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:09.020 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.014+0000 7fa9f759e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9f8108eb0 0x7fa9f8111820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:09.020 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.014+0000 7fa9f759e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81093b0 con 0x7fa9f8108eb0 2021-10-08T19:22:09.020 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.014+0000 7fa9f759e700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81094f0 con 0x7fa9e0003280 2021-10-08T19:22:09.021 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.014+0000 7fa9f659c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 0x7fa9f8108970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:09.021 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.014+0000 7fa9f5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9f8108eb0 0x7fa9f8111820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:09.021 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f659c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 0x7fa9f8108970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.196:44354/0 (socket says 172.21.15.196:44354) 2021-10-08T19:22:09.021 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f659c700 1 -- 172.21.15.196:0/1588879653 learned_addr learned my addr 172.21.15.196:0/1588879653 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:22:09.022 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f659c700 1 -- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 msgr2=0x7fa9f8108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2021-10-08T19:22:09.022 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f659c700 1 -- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 msgr2=0x7fa9f8108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-10-08T19:22:09.022 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f659c700 1 --2- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 0x7fa9f8108970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-10-08T19:22:09.022 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f659c700 1 --2- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 0x7fa9f8108970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:22:09.023 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f5d9b700 1 -- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 msgr2=0x7fa9f8108970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:22:09.023 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f5d9b700 1 --2- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 0x7fa9f8108970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:09.023 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f5d9b700 1 -- 172.21.15.196:0/1588879653 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e8005040 con 0x7fa9f8108eb0 2021-10-08T19:22:09.023 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f5d9b700 1 --2- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9f8108eb0 0x7fa9f8111820 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009390 tx=0x7fa9ec006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:09.024 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9e6ffd700 1 -- 172.21.15.196:0/1588879653 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fa9ec0105b0 con 0x7fa9f8108eb0 2021-10-08T19:22:09.024 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9e6ffd700 1 -- 172.21.15.196:0/1588879653 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fa9ec010b90 con 0x7fa9f8108eb0 2021-10-08T19:22:09.024 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f8111d60 con 0x7fa9f8108eb0 2021-10-08T19:22:09.024 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9e6ffd700 1 -- 172.21.15.196:0/1588879653 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fa9ec011b30 con 0x7fa9f8108eb0 2021-10-08T19:22:09.024 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.015+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f8112250 con 0x7fa9f8108eb0 2021-10-08T19:22:09.025 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.016+0000 7fa9e6ffd700 1 -- 172.21.15.196:0/1588879653 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7fa9ec00f070 con 0x7fa9f8108eb0 2021-10-08T19:22:09.025 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.016+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f805a9f0 con 0x7fa9f8108eb0 2021-10-08T19:22:09.025 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.016+0000 7fa9e6ffd700 1 --2- 172.21.15.196:0/1588879653 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa9d8033890 0x7fa9d8035d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:09.025 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.016+0000 7fa9e6ffd700 1 -- 172.21.15.196:0/1588879653 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fa9ec0441f0 con 0x7fa9f8108eb0 2021-10-08T19:22:09.026 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.016+0000 7fa9f659c700 1 --2- 172.21.15.196:0/1588879653 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa9d8033890 0x7fa9d8035d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:09.026 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.017+0000 7fa9f659c700 1 --2- 172.21.15.196:0/1588879653 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa9d8033890 0x7fa9d8035d40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800b010 tx=0x7fa9e8002040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:09.027 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.021+0000 7fa9e6ffd700 1 -- 172.21.15.196:0/1588879653 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fa9ec0208a0 con 0x7fa9f8108eb0 2021-10-08T19:22:09.265 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.264+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa9f80fe130 con 0x7fa9f8108eb0 2021-10-08T19:22:09.265 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.265+0000 7fa9e6ffd700 1 -- 172.21.15.196:0/1588879653 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+964 (secure 0 0 0) 0x7fa9ec019df0 con 0x7fa9f8108eb0 2021-10-08T19:22:09.266 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:22:09.266 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":2,"fsid":"906d7a14-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:22:03.489391Z","created":"2021-10-08T19:20:00.604350Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-10-08T19:22:09.268 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.266+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa9d8033890 msgr2=0x7fa9d8035d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:09.268 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.266+0000 7fa9f759e700 1 --2- 172.21.15.196:0/1588879653 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa9d8033890 0x7fa9d8035d40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800b010 tx=0x7fa9e8002040 comp rx=0 tx=0).stop 2021-10-08T19:22:09.268 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.267+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9f8108eb0 msgr2=0x7fa9f8111820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:09.268 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.267+0000 7fa9f759e700 1 --2- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9f8108eb0 0x7fa9f8111820 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009390 tx=0x7fa9ec006e20 comp rx=0 tx=0).stop 2021-10-08T19:22:09.269 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.267+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 shutdown_connections 2021-10-08T19:22:09.269 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.267+0000 7fa9f759e700 1 --2- 172.21.15.196:0/1588879653 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa9d8033890 0x7fa9d8035d40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:09.269 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.267+0000 7fa9f759e700 1 --2- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9e0003280 0x7fa9f8108970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:09.269 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.267+0000 7fa9f759e700 1 --2- 172.21.15.196:0/1588879653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9f8108eb0 0x7fa9f8111820 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:09.270 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.267+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 >> 172.21.15.196:0/1588879653 conn(0x7fa9f80f29e0 msgr2=0x7fa9f80faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:09.270 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.267+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 shutdown_connections 2021-10-08T19:22:09.270 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:09.267+0000 7fa9f759e700 1 -- 172.21.15.196:0/1588879653 wait complete. 2021-10-08T19:22:09.270 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 2 2021-10-08T19:22:09.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:09 smithi157 ceph-mon[32847]: Deploying daemon mon.b on smithi196 2021-10-08T19:22:09.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:09 smithi157 ceph-mon[32847]: poll took 5005.715 ms: 1 events 2021-10-08T19:22:09.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/1588879653' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:22:09.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:09 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:09.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:09 smithi157 ceph-mon[42114]: Deploying daemon mon.b on smithi196 2021-10-08T19:22:09.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:09 smithi157 ceph-mon[42114]: poll took 5005.715 ms: 1 events 2021-10-08T19:22:09.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/1588879653' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:22:09.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:09 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:10.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:10 smithi157 ceph-mon[32847]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:10.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:10 smithi157 ceph-mon[42114]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:11.368 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:22:11.369 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:22:12.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:12 smithi157 ceph-mon[32847]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:12.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:12 smithi157 ceph-mon[42114]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.276 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:12 smithi196 systemd[1]: Started Ceph mon.b for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:22:13.277 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:12 smithi196 ceph-mon[34258]: starting mon.b rank -1 at public addrs [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] at bind addrs [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:22:13.277 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:12 smithi196 ceph-mon[34258]: mon.b@-1(???) e0 preinit fsid 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:22:13.277 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).mds e1 new map 2021-10-08T19:22:13.277 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).mds e1 print_map 2021-10-08T19:22:13.278 INFO:journalctl@ceph.mon.b.smithi196.stdout: e1 2021-10-08T19:22:13.278 INFO:journalctl@ceph.mon.b.smithi196.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-10-08T19:22:13.278 INFO:journalctl@ceph.mon.b.smithi196.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-10-08T19:22:13.278 INFO:journalctl@ceph.mon.b.smithi196.stdout: legacy client fscid: -1 2021-10-08T19:22:13.279 INFO:journalctl@ceph.mon.b.smithi196.stdout: 2021-10-08T19:22:13.279 INFO:journalctl@ceph.mon.b.smithi196.stdout: No filesystems configured 2021-10-08T19:22:13.279 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-10-08T19:22:13.279 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-10-08T19:22:13.279 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-10-08T19:22:13.280 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-10-08T19:22:13.280 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-10-08T19:22:13.280 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-10-08T19:22:13.280 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2021-10-08T19:22:13.280 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:22:13.281 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:22:13.281 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:22:13.281 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.281 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.281 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.282 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.282 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:13.282 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:21:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:13.282 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.283 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.283 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.283 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.283 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.283 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.284 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.284 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.284 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.284 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:13.284 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: poll took 48341.528 ms: 1 events 2021-10-08T19:22:13.285 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Deploying cephadm binary to smithi196 2021-10-08T19:22:13.285 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:13.285 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:13.285 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.154 seconds 2021-10-08T19:22:13.285 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Executing took 0.143 seconds 2021-10-08T19:22:13.286 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.286 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Added host smithi196 2021-10-08T19:22:13.286 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:13.287 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:13.287 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:13.288 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.288 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.288 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.288 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:22:13.288 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.289 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:13.289 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]: dispatch 2021-10-08T19:22:13.289 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]': finished 2021-10-08T19:22:13.289 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Deploying daemon agent.smithi196 on smithi196 2021-10-08T19:22:13.290 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.163 seconds 2021-10-08T19:22:13.290 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.291 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:13.291 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:13.291 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:13.291 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Updating smithi196:/etc/ceph/ceph.conf 2021-10-08T19:22:13.291 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:22:13.292 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.292 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.292 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:13.292 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:13.293 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:13.293 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:13.293 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.293 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:13.293 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:22:13.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:13.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:21:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:13.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/587688510' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-10-08T19:22:13.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Sending message to agent on host smithi196 2021-10-08T19:22:13.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:21:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:13.296 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi196 2021-10-08T19:22:13.296 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/587688510' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-10-08T19:22:13.296 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:13.296 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.297 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.297 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:13.297 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:13.297 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:13.297 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:22:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:13.298 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:13.298 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:13.298 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.298 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi157:172.21.15.157=a;smithi157:[v2:172.21.15.157:3301,v1:172.21.15.157:6790]=c;smithi196:172.21.15.196=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:13.298 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Saving service mon spec with placement smithi157:172.21.15.157=a;smithi157:[v2:172.21.15.157:3301,v1:172.21.15.157:6790]=c;smithi196:172.21.15.196=b;count:3 2021-10-08T19:22:13.299 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.299 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:13.299 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:13.299 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:13.300 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.300 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:13.300 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:13.300 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Deploying daemon mon.c on smithi157 2021-10-08T19:22:13.300 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: poll took 7947.037 ms: 1 events 2021-10-08T19:22:13.301 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.301 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.301 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/3147266593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:22:13.301 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:22:13.301 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.a calling monitor election 2021-10-08T19:22:13.302 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:13.302 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: poll took 2976.557 ms: 1 events 2021-10-08T19:22:13.302 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.302 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:13.302 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:13.303 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.c calling monitor election 2021-10-08T19:22:13.303 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.303 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:13.303 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:13.303 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.304 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:13.304 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:22:13.304 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: monmap e2: 2 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0]} 2021-10-08T19:22:13.304 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: fsmap 2021-10-08T19:22:13.305 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:13.305 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mgrmap e13: y(active, since 79s) 2021-10-08T19:22:13.305 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: overall HEALTH_OK 2021-10-08T19:22:13.305 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:13.305 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:13.306 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:13.306 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: Deploying daemon mon.b on smithi196 2021-10-08T19:22:13.306 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: poll took 5005.715 ms: 1 events 2021-10-08T19:22:13.306 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/1588879653' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:22:13.307 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:13.307 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.307 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.307 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-10-08T19:22:13.307 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:13 smithi196 ceph-mon[34258]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-10-08T19:22:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:22:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: mon.a calling monitor election 2021-10-08T19:22:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: mon.c calling monitor election 2021-10-08T19:22:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: poll took 4164.970 ms: 1 events 2021-10-08T19:22:18.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:18.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:18.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:22:18.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: monmap e3: 3 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],b=[v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0],c=[v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0]} 2021-10-08T19:22:18.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: fsmap 2021-10-08T19:22:18.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:18.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: mgrmap e13: y(active, since 89s) 2021-10-08T19:22:18.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-10-08T19:22:18.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2021-10-08T19:22:18.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-10-08T19:22:18.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: mon.b (rank 2) addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] is down (out of quorum) 2021-10-08T19:22:18.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:18.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:18.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:18.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:18.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:22:18.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: mon.a calling monitor election 2021-10-08T19:22:18.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: mon.c calling monitor election 2021-10-08T19:22:18.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:18.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: poll took 4164.970 ms: 1 events 2021-10-08T19:22:18.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:18.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:18.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:18.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:22:18.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: monmap e3: 3 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],b=[v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0],c=[v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0]} 2021-10-08T19:22:18.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: fsmap 2021-10-08T19:22:18.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:18.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: mgrmap e13: y(active, since 89s) 2021-10-08T19:22:18.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-10-08T19:22:18.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2021-10-08T19:22:18.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-10-08T19:22:18.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: mon.b (rank 2) addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] is down (out of quorum) 2021-10-08T19:22:18.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:18.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:18.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:18.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:18 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: Sending message to agent on host smithi196 2021-10-08T19:22:19.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: Sending message to agent on host smithi157 2021-10-08T19:22:19.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: Updating smithi157:/etc/ceph/ceph.conf 2021-10-08T19:22:19.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: Updating smithi196:/etc/ceph/ceph.conf 2021-10-08T19:22:19.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: poll took 5004.597 ms: 1 events 2021-10-08T19:22:19.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:19.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:19.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:19.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:19.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: Reconfiguring mon.a (unknown last config time)... 2021-10-08T19:22:19.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:19.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:22:19.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:19.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: Reconfiguring daemon mon.a on smithi157 2021-10-08T19:22:19.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:19.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:19.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: Sending message to agent on host smithi196 2021-10-08T19:22:19.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: Sending message to agent on host smithi157 2021-10-08T19:22:19.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: Updating smithi157:/etc/ceph/ceph.conf 2021-10-08T19:22:19.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: Updating smithi196:/etc/ceph/ceph.conf 2021-10-08T19:22:19.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: poll took 5004.597 ms: 1 events 2021-10-08T19:22:19.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:19.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:19.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:19.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:19.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: Reconfiguring mon.a (unknown last config time)... 2021-10-08T19:22:19.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:19.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:22:19.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:19.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: Reconfiguring daemon mon.a on smithi157 2021-10-08T19:22:19.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:19.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:19 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:19.475 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.473+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1285213010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc96c005ef0 msgr2=0x7fc96c008350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:19.475 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.473+0000 7fc98a9b0700 1 --2- 172.21.15.196:0/1285213010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc96c005ef0 0x7fc96c008350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9840f8160 tx=0x7fc974002040 comp rx=0 tx=0).stop 2021-10-08T19:22:19.475 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.473+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1285213010 shutdown_connections 2021-10-08T19:22:19.476 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.473+0000 7fc98a9b0700 1 --2- 172.21.15.196:0/1285213010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc96c005ef0 0x7fc96c008350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:19.476 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.473+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1285213010 >> 172.21.15.196:0/1285213010 conn(0x7fc9840f2bf0 msgr2=0x7fc9840f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:19.476 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.473+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1285213010 shutdown_connections 2021-10-08T19:22:19.476 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.473+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1285213010 wait complete. 2021-10-08T19:22:19.477 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.474+0000 7fc98a9b0700 1 Processor -- start 2021-10-08T19:22:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc98a9b0700 1 -- start start 2021-10-08T19:22:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc98a9b0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 0x7fc98410dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc98a9b0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98410e210 0x7fc984107b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc98a9b0700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9841080b0 0x7fc984108520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc98a9b0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98410e900 con 0x7fc98410e210 2021-10-08T19:22:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc98a9b0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc984114b00 con 0x7fc96c005ef0 2021-10-08T19:22:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc98a9b0700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc984114c70 con 0x7fc9841080b0 2021-10-08T19:22:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc983fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 0x7fc98410dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc983fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 0x7fc98410dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:48824/0 (socket says 172.21.15.196:48824) 2021-10-08T19:22:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc983fff700 1 -- 172.21.15.196:0/1628531645 learned_addr learned my addr 172.21.15.196:0/1628531645 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:22:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc9837fe700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98410e210 0x7fc984107b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc983fff700 1 -- 172.21.15.196:0/1628531645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 msgr2=0x7fc98410dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2021-10-08T19:22:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc983fff700 1 -- 172.21.15.196:0/1628531645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 msgr2=0x7fc98410dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-10-08T19:22:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc983fff700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 0x7fc98410dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-10-08T19:22:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc988f4d700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9841080b0 0x7fc984108520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.475+0000 7fc983fff700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 0x7fc98410dcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:22:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc9837fe700 1 -- 172.21.15.196:0/1628531645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9841080b0 msgr2=0x7fc984108520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc9837fe700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9841080b0 0x7fc984108520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc9837fe700 1 -- 172.21.15.196:0/1628531645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 msgr2=0x7fc98410dcd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:22:19.485 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc9837fe700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 0x7fc98410dcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:19.485 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc9837fe700 1 -- 172.21.15.196:0/1628531645 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974005040 con 0x7fc98410e210 2021-10-08T19:22:19.485 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc9837fe700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98410e210 0x7fc984107b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc978009410 tx=0x7fc978006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:19.485 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc980ff9700 1 -- 172.21.15.196:0/1628531645 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9780105b0 con 0x7fc98410e210 2021-10-08T19:22:19.485 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc980ff9700 1 -- 172.21.15.196:0/1628531645 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fc978010b90 con 0x7fc98410e210 2021-10-08T19:22:19.486 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc980ff9700 1 -- 172.21.15.196:0/1628531645 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978011b50 con 0x7fc98410e210 2021-10-08T19:22:19.486 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc984114f50 con 0x7fc98410e210 2021-10-08T19:22:19.486 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.476+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9841153b0 con 0x7fc98410e210 2021-10-08T19:22:19.487 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.477+0000 7fc980ff9700 1 -- 172.21.15.196:0/1628531645 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7fc97800f070 con 0x7fc98410e210 2021-10-08T19:22:19.487 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.477+0000 7fc980ff9700 1 --2- 172.21.15.196:0/1628531645 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc970033bd0 0x7fc970036080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:19.487 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.477+0000 7fc980ff9700 1 -- 172.21.15.196:0/1628531645 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fc978044220 con 0x7fc98410e210 2021-10-08T19:22:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.477+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98405a9f0 con 0x7fc98410e210 2021-10-08T19:22:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.477+0000 7fc983fff700 1 --2- 172.21.15.196:0/1628531645 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc970033bd0 0x7fc970036080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.478+0000 7fc983fff700 1 --2- 172.21.15.196:0/1628531645 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc970033bd0 0x7fc970036080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc974009ba0 tx=0x7fc974002040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.482+0000 7fc980ff9700 1 -- 172.21.15.196:0/1628531645 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fc97800e470 con 0x7fc98410e210 2021-10-08T19:22:19.726 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.725+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc9840472f0 con 0x7fc98410e210 2021-10-08T19:22:19.727 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.725+0000 7fc980ff9700 1 -- 172.21.15.196:0/1628531645 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1232 (secure 0 0 0) 0x7fc97800f300 con 0x7fc98410e210 2021-10-08T19:22:19.727 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-10-08T19:22:19.728 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":3,"fsid":"906d7a14-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:22:13.012832Z","created":"2021-10-08T19:20:00.604350Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-10-08T19:22:19.729 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc970033bd0 msgr2=0x7fc970036080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:19.729 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 --2- 172.21.15.196:0/1628531645 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc970033bd0 0x7fc970036080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc974009ba0 tx=0x7fc974002040 comp rx=0 tx=0).stop 2021-10-08T19:22:19.729 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98410e210 msgr2=0x7fc984107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:19.730 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98410e210 0x7fc984107b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc978009410 tx=0x7fc978006e20 comp rx=0 tx=0).stop 2021-10-08T19:22:19.730 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 shutdown_connections 2021-10-08T19:22:19.730 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 --2- 172.21.15.196:0/1628531645 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc970033bd0 0x7fc970036080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:19.730 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9841080b0 0x7fc984108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:19.730 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc96c005ef0 0x7fc98410dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:19.731 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 --2- 172.21.15.196:0/1628531645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98410e210 0x7fc984107b70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:19.731 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 >> 172.21.15.196:0/1628531645 conn(0x7fc9840f2bf0 msgr2=0x7fc9840610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:19.731 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 shutdown_connections 2021-10-08T19:22:19.731 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:19.727+0000 7fc98a9b0700 1 -- 172.21.15.196:0/1628531645 wait complete. 2021-10-08T19:22:19.732 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 3 2021-10-08T19:22:20.350 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:22:20.351 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mon.a calling monitor election 2021-10-08T19:22:20.351 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mon.c calling monitor election 2021-10-08T19:22:20.351 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:20.351 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:22:20.351 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: poll took 4164.970 ms: 1 events 2021-10-08T19:22:20.352 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:20.352 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:20.352 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:20.352 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:20.353 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:20.353 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:20.353 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:20.353 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:22:20.353 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: monmap e3: 3 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],b=[v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0],c=[v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0]} 2021-10-08T19:22:20.354 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: fsmap 2021-10-08T19:22:20.354 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:20.354 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mgrmap e13: y(active, since 89s) 2021-10-08T19:22:20.354 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-10-08T19:22:20.354 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2021-10-08T19:22:20.355 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-10-08T19:22:20.355 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mon.b (rank 2) addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] is down (out of quorum) 2021-10-08T19:22:20.355 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:20.355 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:20.356 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:20.356 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:20.356 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Sending message to agent on host smithi196 2021-10-08T19:22:20.356 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Sending message to agent on host smithi157 2021-10-08T19:22:20.356 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Updating smithi157:/etc/ceph/ceph.conf 2021-10-08T19:22:20.357 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Updating smithi196:/etc/ceph/ceph.conf 2021-10-08T19:22:20.357 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: poll took 5004.597 ms: 1 events 2021-10-08T19:22:20.357 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:20.357 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:20.357 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:20.358 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:20.358 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Reconfiguring mon.a (unknown last config time)... 2021-10-08T19:22:20.358 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:20.358 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:22:20.359 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:20.359 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Reconfiguring daemon mon.a on smithi157 2021-10-08T19:22:20.359 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:20.359 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:20.360 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-10-08T19:22:20.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph config generate-minimal-conf 2021-10-08T19:22:20.606 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:22:20 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:22:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mon.b calling monitor election 2021-10-08T19:22:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mon.b calling monitor election 2021-10-08T19:22:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mon.c calling monitor election 2021-10-08T19:22:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mon.a calling monitor election 2021-10-08T19:22:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-10-08T19:22:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: poll took 1248.716 ms: 1 events 2021-10-08T19:22:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: monmap e3: 3 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],b=[v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0],c=[v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0]} 2021-10-08T19:22:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: fsmap 2021-10-08T19:22:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: mgrmap e13: y(active, since 91s) 2021-10-08T19:22:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-10-08T19:22:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Cluster is now healthy 2021-10-08T19:22:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: overall HEALTH_OK 2021-10-08T19:22:20.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:20.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Reconfiguring mon.c (monmap changed)... 2021-10-08T19:22:20.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:20.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:22:20.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:20.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: Reconfiguring daemon mon.c on smithi157 2021-10-08T19:22:20.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:20.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:20.893 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: mon.b calling monitor election 2021-10-08T19:22:20.894 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: mon.b calling monitor election 2021-10-08T19:22:20.894 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: mon.c calling monitor election 2021-10-08T19:22:20.894 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: mon.a calling monitor election 2021-10-08T19:22:20.895 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-10-08T19:22:20.895 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: poll took 1248.716 ms: 1 events 2021-10-08T19:22:20.895 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: monmap e3: 3 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],b=[v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0],c=[v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0]} 2021-10-08T19:22:20.896 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: fsmap 2021-10-08T19:22:20.896 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:20.896 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: mgrmap e13: y(active, since 91s) 2021-10-08T19:22:20.897 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-10-08T19:22:20.897 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: Cluster is now healthy 2021-10-08T19:22:20.897 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: overall HEALTH_OK 2021-10-08T19:22:20.897 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:20.897 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: Reconfiguring mon.c (monmap changed)... 2021-10-08T19:22:20.898 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:20.898 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:22:20.898 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:20.898 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: Reconfiguring daemon mon.c on smithi157 2021-10-08T19:22:20.899 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:20.899 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:20.899 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: mon.b calling monitor election 2021-10-08T19:22:20.899 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: mon.b calling monitor election 2021-10-08T19:22:20.900 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: mon.c calling monitor election 2021-10-08T19:22:20.900 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: mon.a calling monitor election 2021-10-08T19:22:20.900 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-10-08T19:22:20.900 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: poll took 1248.716 ms: 1 events 2021-10-08T19:22:20.901 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: monmap e3: 3 mons at {a=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],b=[v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0],c=[v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0]} 2021-10-08T19:22:20.901 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: fsmap 2021-10-08T19:22:20.901 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:20.901 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: mgrmap e13: y(active, since 91s) 2021-10-08T19:22:20.901 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-10-08T19:22:20.902 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: Cluster is now healthy 2021-10-08T19:22:20.902 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: overall HEALTH_OK 2021-10-08T19:22:20.902 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:20.902 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: Reconfiguring mon.c (monmap changed)... 2021-10-08T19:22:20.902 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:20.903 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:22:20.903 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:20.903 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: Reconfiguring daemon mon.c on smithi157 2021-10-08T19:22:20.903 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:20.904 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:21.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:21 smithi157 ceph-mon[32847]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:22:21.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:21 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:22:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:21.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:21 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:21.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:21 smithi157 ceph-mon[42114]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:22:21.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:21 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:22:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:21.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:21 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:21.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:21 smithi196 ceph-mon[34258]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:22:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:21 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:22:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:21 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:22:22.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:22:22 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:22:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:23.239 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/1267786167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80feee0 msgr2=0x7f3dd80f8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:23.239 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/1267786167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80feee0 0x7f3dd80f8610 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc004620 tx=0x7f3dcc009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:23.239 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/1267786167 shutdown_connections 2021-10-08T19:22:23.240 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/1267786167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd80f8d40 0x7f3dd8105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:23.240 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/1267786167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd80fe5d0 0x7f3dd80fe9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:23.240 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/1267786167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80feee0 0x7f3dd80f8610 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:23.240 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/1267786167 >> 172.21.15.157:0/1267786167 conn(0x7f3dd80f4190 msgr2=0x7f3dd80f65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:23.240 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/1267786167 shutdown_connections 2021-10-08T19:22:23.241 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/1267786167 wait complete. 2021-10-08T19:22:23.241 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 Processor -- start 2021-10-08T19:22:23.241 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.236+0000 7f3ddc9e8700 1 -- start start 2021-10-08T19:22:23.241 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3ddc9e8700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80f8d40 0x7f3dd806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:23.242 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3ddc9e8700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd80fe5d0 0x7f3dd806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:23.242 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3ddc9e8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd80feee0 0x7f3dd8116e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:23.242 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3ddc9e8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd806c4f0 con 0x7f3dd80feee0 2021-10-08T19:22:23.242 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3ddc9e8700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8117380 con 0x7f3dd80fe5d0 2021-10-08T19:22:23.242 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3ddc9e8700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81174f0 con 0x7f3dd80f8d40 2021-10-08T19:22:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd6d9d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80f8d40 0x7f3dd806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd759e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd80feee0 0x7f3dd8116e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd6d9d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80f8d40 0x7f3dd806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:48900/0 (socket says 172.21.15.157:48900) 2021-10-08T19:22:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd6d9d700 1 -- 172.21.15.157:0/3557970817 learned_addr learned my addr 172.21.15.157:0/3557970817 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:22:23.244 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd659c700 1 --2- 172.21.15.157:0/3557970817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd80fe5d0 0x7f3dd806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:23.244 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd6d9d700 1 -- 172.21.15.157:0/3557970817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd80fe5d0 msgr2=0x7f3dd806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:23.244 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd6d9d700 1 --2- 172.21.15.157:0/3557970817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd80fe5d0 0x7f3dd806bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:23.244 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd6d9d700 1 -- 172.21.15.157:0/3557970817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd80feee0 msgr2=0x7f3dd8116e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:23.244 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd6d9d700 1 --2- 172.21.15.157:0/3557970817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd80feee0 0x7f3dd8116e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:23.245 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd6d9d700 1 -- 172.21.15.157:0/3557970817 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8005040 con 0x7f3dd80f8d40 2021-10-08T19:22:23.245 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd759e700 1 --2- 172.21.15.157:0/3557970817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd80feee0 0x7f3dd8116e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:22:23.245 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dd6d9d700 1 --2- 172.21.15.157:0/3557970817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80f8d40 0x7f3dd806b6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80049e0 tx=0x7f3dc8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:23.245 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dbb7fe700 1 -- 172.21.15.157:0/3557970817 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8007e50 con 0x7f3dd80f8d40 2021-10-08T19:22:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dbb7fe700 1 -- 172.21.15.157:0/3557970817 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f3dc800f040 con 0x7f3dd80f8d40 2021-10-08T19:22:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc005040 con 0x7f3dd80f8d40 2021-10-08T19:22:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.237+0000 7f3dbb7fe700 1 -- 172.21.15.157:0/3557970817 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80139d0 con 0x7f3dd80f8d40 2021-10-08T19:22:23.247 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.238+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd8117b20 con 0x7f3dd80f8d40 2021-10-08T19:22:23.248 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.238+0000 7f3dbb7fe700 1 -- 172.21.15.157:0/3557970817 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7f3dc800e630 con 0x7f3dd80f8d40 2021-10-08T19:22:23.248 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.238+0000 7f3dbb7fe700 1 --2- 172.21.15.157:0/3557970817 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3dc0033930 0x7f3dc0035de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:23.249 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.238+0000 7f3dbb7fe700 1 -- 172.21.15.157:0/3557970817 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f3dc8044570 con 0x7f3dd80f8d40 2021-10-08T19:22:23.249 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.238+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd80f7d90 con 0x7f3dd80f8d40 2021-10-08T19:22:23.250 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.238+0000 7f3dd659c700 1 --2- 172.21.15.157:0/3557970817 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3dc0033930 0x7f3dc0035de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:23.251 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.239+0000 7f3dd659c700 1 --2- 172.21.15.157:0/3557970817 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3dc0033930 0x7f3dc0035de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0045f0 tx=0x7f3dcc017040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:23.252 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.244+0000 7f3dbb7fe700 1 -- 172.21.15.157:0/3557970817 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f3dc800e8c0 con 0x7f3dd80f8d40 2021-10-08T19:22:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:23.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:23.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:22:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:23.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:23.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: poll took 1942.329 ms: 1 events 2021-10-08T19:22:23.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:23.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: Reconfiguring mon.b (monmap changed)... 2021-10-08T19:22:23.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:23.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:22:23.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:23.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[32847]: Reconfiguring daemon mon.b on smithi196 2021-10-08T19:22:23.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:23.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:23.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:22:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:23.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:23.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: poll took 1942.329 ms: 1 events 2021-10-08T19:22:23.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:23.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: Reconfiguring mon.b (monmap changed)... 2021-10-08T19:22:23.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:23.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:22:23.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:23.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:23 smithi157 ceph-mon[42114]: Reconfiguring daemon mon.b on smithi196 2021-10-08T19:22:23.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:22:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: poll took 1942.329 ms: 1 events 2021-10-08T19:22:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: Reconfiguring mon.b (monmap changed)... 2021-10-08T19:22:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:22:23.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:23.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:23 smithi196 ceph-mon[34258]: Reconfiguring daemon mon.b on smithi196 2021-10-08T19:22:23.412 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.411+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3dd80472f0 con 0x7f3dd80f8d40 2021-10-08T19:22:23.413 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.412+0000 7f3dbb7fe700 1 -- 172.21.15.157:0/3557970817 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7f3dc8011730 con 0x7f3dd80f8d40 2021-10-08T19:22:23.413 INFO:teuthology.orchestra.run.smithi157.stdout:# minimal ceph.conf for 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:22:23.413 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2021-10-08T19:22:23.414 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:22:23.414 INFO:teuthology.orchestra.run.smithi157.stdout: mon_host = [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:22:23.415 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3dc0033930 msgr2=0x7f3dc0035de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:23.415 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/3557970817 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3dc0033930 0x7f3dc0035de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0045f0 tx=0x7f3dcc017040 comp rx=0 tx=0).stop 2021-10-08T19:22:23.415 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80f8d40 msgr2=0x7f3dd806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:23.415 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/3557970817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80f8d40 0x7f3dd806b6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80049e0 tx=0x7f3dc8009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:23.416 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 shutdown_connections 2021-10-08T19:22:23.416 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/3557970817 >> v2:172.21.15.157:6800/3606206634 conn(0x7f3dc0033930 0x7f3dc0035de0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:23.416 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/3557970817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd80feee0 0x7f3dd8116e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:23.416 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/3557970817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dd80f8d40 0x7f3dd806b6c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:23.417 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 --2- 172.21.15.157:0/3557970817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd80fe5d0 0x7f3dd806bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:23.417 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 >> 172.21.15.157:0/3557970817 conn(0x7f3dd80f4190 msgr2=0x7f3dd80f59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:23.417 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 shutdown_connections 2021-10-08T19:22:23.417 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:23.414+0000 7f3ddc9e8700 1 -- 172.21.15.157:0/3557970817 wait complete. 2021-10-08T19:22:24.345 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-10-08T19:22:24.346 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:22:24.346 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2021-10-08T19:22:24.375 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3557970817' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:24.375 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:24.375 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:24.375 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:24.376 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:24.376 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:24.376 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3557970817' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:24.377 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:24.377 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:24.377 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:24.377 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:24.377 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:24.379 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:22:24.379 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:22:24.446 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:22:24.446 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.conf 2021-10-08T19:22:24.471 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3557970817' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:24.471 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:24.472 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:24.472 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:24.473 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:24.473 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:24.476 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:22:24.476 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:22:24.540 INFO:tasks.cephadm:Adding mgr.y on smithi157 2021-10-08T19:22:24.541 INFO:tasks.cephadm:Adding mgr.x on smithi196 2021-10-08T19:22:24.542 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch apply mgr '2;smithi157=y;smithi196=x' 2021-10-08T19:22:25.321 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:25 smithi196 ceph-mon[34258]: poll took 1134.887 ms: 1 events 2021-10-08T19:22:25.321 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:25 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:25.321 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:25 smithi196 ceph-mon[34258]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:25.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:25 smithi157 ceph-mon[32847]: poll took 1134.887 ms: 1 events 2021-10-08T19:22:25.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:25 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:25.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:25 smithi157 ceph-mon[32847]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:25.580 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:22:25 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:22:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:25.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:25 smithi157 ceph-mon[42114]: poll took 1134.887 ms: 1 events 2021-10-08T19:22:25.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:25 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:25.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:25 smithi157 ceph-mon[42114]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:26.248 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.244+0000 7f7e7e634700 1 -- 172.21.15.196:0/3529502865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 msgr2=0x7f7e780ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:26.248 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.244+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3529502865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 0x7f7e780ff9b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009a60 tx=0x7f7e70004d10 comp rx=0 tx=0).stop 2021-10-08T19:22:26.248 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.244+0000 7f7e7e634700 1 -- 172.21.15.196:0/3529502865 shutdown_connections 2021-10-08T19:22:26.249 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.244+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3529502865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 0x7f7e780ff9b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:26.249 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.244+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3529502865 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e780f74c0 0x7f7e780f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:26.249 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.244+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3529502865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e780f8760 0x7f7e780f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:26.249 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.244+0000 7f7e7e634700 1 -- 172.21.15.196:0/3529502865 >> 172.21.15.196:0/3529502865 conn(0x7f7e780f2cd0 msgr2=0x7f7e780f50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:26.249 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.244+0000 7f7e7e634700 1 -- 172.21.15.196:0/3529502865 shutdown_connections 2021-10-08T19:22:26.250 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.244+0000 7f7e7e634700 1 -- 172.21.15.196:0/3529502865 wait complete. 2021-10-08T19:22:26.250 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7e634700 1 Processor -- start 2021-10-08T19:22:26.250 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7e634700 1 -- start start 2021-10-08T19:22:26.250 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7e634700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e780f74c0 0x7f7e78108640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:26.251 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7e634700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e780f8760 0x7f7e78108b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:26.251 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7e634700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 0x7f7e7810fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:26.251 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7e634700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78110150 con 0x7f7e780f74c0 2021-10-08T19:22:26.251 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7e634700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e781102c0 con 0x7f7e780f90f0 2021-10-08T19:22:26.252 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7e634700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78110480 con 0x7f7e780f8760 2021-10-08T19:22:26.252 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7cbd1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 0x7f7e7810fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:26.252 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7cbd1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 0x7f7e7810fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:48846/0 (socket says 172.21.15.196:48846) 2021-10-08T19:22:26.252 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7cbd1700 1 -- 172.21.15.196:0/3165813045 learned_addr learned my addr 172.21.15.196:0/3165813045 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:22:26.253 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e77fff700 1 --2- 172.21.15.196:0/3165813045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e780f74c0 0x7f7e78108640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:26.253 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e777fe700 1 --2- 172.21.15.196:0/3165813045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e780f8760 0x7f7e78108b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:26.253 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7cbd1700 1 -- 172.21.15.196:0/3165813045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e780f8760 msgr2=0x7f7e78108b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:26.253 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7cbd1700 1 --2- 172.21.15.196:0/3165813045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e780f8760 0x7f7e78108b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:26.253 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7cbd1700 1 -- 172.21.15.196:0/3165813045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e780f74c0 msgr2=0x7f7e78108640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:26.254 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7cbd1700 1 --2- 172.21.15.196:0/3165813045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e780f74c0 0x7f7e78108640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:26.254 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.245+0000 7f7e7cbd1700 1 -- 172.21.15.196:0/3165813045 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e70009640 con 0x7f7e780f90f0 2021-10-08T19:22:26.254 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.246+0000 7f7e7cbd1700 1 --2- 172.21.15.196:0/3165813045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 0x7f7e7810fc10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000b630 tx=0x7f7e70004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:26.255 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.246+0000 7f7e74ff9700 1 -- 172.21.15.196:0/3165813045 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7000e030 con 0x7f7e780f90f0 2021-10-08T19:22:26.255 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.246+0000 7f7e74ff9700 1 -- 172.21.15.196:0/3165813045 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f7e70009450 con 0x7f7e780f90f0 2021-10-08T19:22:26.255 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.246+0000 7f7e74ff9700 1 -- 172.21.15.196:0/3165813045 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70012680 con 0x7f7e780f90f0 2021-10-08T19:22:26.255 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.246+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e78110700 con 0x7f7e780f90f0 2021-10-08T19:22:26.256 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.246+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e78110b60 con 0x7f7e780f90f0 2021-10-08T19:22:26.256 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.246+0000 7f7e74ff9700 1 -- 172.21.15.196:0/3165813045 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7f7e7002c070 con 0x7f7e780f90f0 2021-10-08T19:22:26.256 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.247+0000 7f7e74ff9700 1 --2- 172.21.15.196:0/3165813045 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e600339e0 0x7f7e60035e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:26.256 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.247+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e780289c0 con 0x7f7e780f90f0 2021-10-08T19:22:26.256 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.247+0000 7f7e74ff9700 1 -- 172.21.15.196:0/3165813045 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f7e70046770 con 0x7f7e780f90f0 2021-10-08T19:22:26.257 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.247+0000 7f7e77fff700 1 --2- 172.21.15.196:0/3165813045 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e600339e0 0x7f7e60035e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:26.257 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.247+0000 7f7e77fff700 1 --2- 172.21.15.196:0/3165813045 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e600339e0 0x7f7e60035e90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7e780f85c0 tx=0x7f7e6800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:26.258 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.252+0000 7f7e74ff9700 1 -- 172.21.15.196:0/3165813045 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7e70017070 con 0x7f7e780f90f0 2021-10-08T19:22:26.421 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.421+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi157=y;smithi196=x", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e78059800 con 0x7f7e600339e0 2021-10-08T19:22:26.426 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.426+0000 7f7e74ff9700 1 -- 172.21.15.196:0/3165813045 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7e78059800 con 0x7f7e600339e0 2021-10-08T19:22:26.426 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mgr update... 2021-10-08T19:22:26.428 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e600339e0 msgr2=0x7f7e60035e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:26.428 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3165813045 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e600339e0 0x7f7e60035e90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7e780f85c0 tx=0x7f7e6800b040 comp rx=0 tx=0).stop 2021-10-08T19:22:26.428 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 msgr2=0x7f7e7810fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:26.429 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3165813045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 0x7f7e7810fc10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000b630 tx=0x7f7e70004d10 comp rx=0 tx=0).stop 2021-10-08T19:22:26.429 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 shutdown_connections 2021-10-08T19:22:26.429 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3165813045 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7e600339e0 0x7f7e60035e90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:26.429 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3165813045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e780f90f0 0x7f7e7810fc10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:26.430 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3165813045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e780f74c0 0x7f7e78108640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:26.430 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 --2- 172.21.15.196:0/3165813045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e780f8760 0x7f7e78108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:26.430 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 >> 172.21.15.196:0/3165813045 conn(0x7f7e780f2cd0 msgr2=0x7f7e78061e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:26.430 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 shutdown_connections 2021-10-08T19:22:26.431 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:22:26.428+0000 7f7e7e634700 1 -- 172.21.15.196:0/3165813045 wait complete. 2021-10-08T19:22:26.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:26 smithi196 ceph-mon[34258]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:26 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:26 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:22:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:26 smithi196 ceph-mon[34258]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:26.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:26.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:26.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:26.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:26.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:22:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:26.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:26.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:26.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:26.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[32847]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:26.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:26.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[42114]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:26.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:26.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:26.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:22:25] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:26.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:26.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:26.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:26.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:26 smithi157 ceph-mon[42114]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:27.008 DEBUG:teuthology.orchestra.run.smithi196:mgr.x> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.x.service 2021-10-08T19:22:27.011 INFO:tasks.cephadm:Deploying OSDs... 2021-10-08T19:22:27.011 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:22:27.012 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2021-10-08T19:22:27.032 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-08T19:22:27.032 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-08T19:22:27.039 INFO:journalctl@ceph.mgr.x.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:22:27.090 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-08T19:22:27.090 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:22:27.090 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 115770 Links: 1 2021-10-08T19:22:27.091 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:22:27.091 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:22:27.091 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2021-10-08 19:22:23.517171074 +0000 2021-10-08T19:22:27.091 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2021-10-08 19:15:03.124283225 +0000 2021-10-08T19:22:27.091 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2021-10-08 19:15:03.124283225 +0000 2021-10-08T19:22:27.092 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2021-10-08T19:22:27.102 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2021-10-08T19:22:27.103 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2021-10-08T19:22:27.103 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000128693 s, 4.0 MB/s 2021-10-08T19:22:27.107 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-08T19:22:27.164 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-08T19:22:27.165 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:22:27.165 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 115834 Links: 1 2021-10-08T19:22:27.165 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:22:27.165 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:22:27.165 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2021-10-08 19:22:23.517171074 +0000 2021-10-08T19:22:27.166 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2021-10-08 19:15:03.464276843 +0000 2021-10-08T19:22:27.166 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2021-10-08 19:15:03.464276843 +0000 2021-10-08T19:22:27.166 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2021-10-08T19:22:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2021-10-08T19:22:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2021-10-08T19:22:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000119253 s, 4.3 MB/s 2021-10-08T19:22:27.178 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-08T19:22:27.234 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-08T19:22:27.234 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:22:27.235 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 116774 Links: 1 2021-10-08T19:22:27.235 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:22:27.235 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:22:27.235 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2021-10-08 19:22:23.517171074 +0000 2021-10-08T19:22:27.236 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2021-10-08 19:15:03.806270424 +0000 2021-10-08T19:22:27.236 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2021-10-08 19:15:03.806270424 +0000 2021-10-08T19:22:27.236 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2021-10-08T19:22:27.244 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2021-10-08T19:22:27.244 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2021-10-08T19:22:27.245 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000113148 s, 4.5 MB/s 2021-10-08T19:22:27.247 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-08T19:22:27.302 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-08T19:22:27.303 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:22:27.303 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 115924 Links: 1 2021-10-08T19:22:27.303 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:22:27.303 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:22:27.304 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2021-10-08 19:22:23.517171074 +0000 2021-10-08T19:22:27.304 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2021-10-08 19:15:04.234262390 +0000 2021-10-08T19:22:27.304 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2021-10-08 19:15:04.234262390 +0000 2021-10-08T19:22:27.304 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2021-10-08T19:22:27.312 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2021-10-08T19:22:27.312 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2021-10-08T19:22:27.312 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 9.2672e-05 s, 5.5 MB/s 2021-10-08T19:22:27.315 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:22:27.315 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2021-10-08T19:22:27.330 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-08T19:22:27.331 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-08T19:22:27.393 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-08T19:22:27.393 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:22:27.394 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 106108 Links: 1 2021-10-08T19:22:27.394 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:22:27.394 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:22:27.394 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2021-10-08 19:22:20.719373306 +0000 2021-10-08T19:22:27.395 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2021-10-08 19:15:03.127800537 +0000 2021-10-08T19:22:27.395 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2021-10-08 19:15:03.127800537 +0000 2021-10-08T19:22:27.395 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2021-10-08T19:22:27.402 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2021-10-08T19:22:27.403 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2021-10-08T19:22:27.403 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000264592 s, 1.9 MB/s 2021-10-08T19:22:27.405 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-08T19:22:27.459 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-08T19:22:27.460 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:22:27.460 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 106157 Links: 1 2021-10-08T19:22:27.460 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:22:27.460 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:22:27.461 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2021-10-08 19:22:20.719373306 +0000 2021-10-08T19:22:27.461 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2021-10-08 19:15:03.480792824 +0000 2021-10-08T19:22:27.461 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2021-10-08 19:15:03.480792824 +0000 2021-10-08T19:22:27.461 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2021-10-08T19:22:27.469 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2021-10-08T19:22:27.469 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2021-10-08T19:22:27.469 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000189418 s, 2.7 MB/s 2021-10-08T19:22:27.471 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 109406 Links: 1 2021-10-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:22:27.526 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:22:27.526 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2021-10-08 19:22:20.719373306 +0000 2021-10-08T19:22:27.526 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2021-10-08 19:15:03.840784957 +0000 2021-10-08T19:22:27.526 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2021-10-08 19:15:03.840784957 +0000 2021-10-08T19:22:27.527 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2021-10-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2021-10-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2021-10-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000204975 s, 2.5 MB/s 2021-10-08T19:22:27.537 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-08T19:22:27.590 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-08T19:22:27.590 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:22:27.590 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 104428 Links: 1 2021-10-08T19:22:27.591 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:22:27.591 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:22:27.591 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2021-10-08 19:22:20.719373306 +0000 2021-10-08T19:22:27.591 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2021-10-08 19:15:04.235776326 +0000 2021-10-08T19:22:27.592 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2021-10-08 19:15:04.235776326 +0000 2021-10-08T19:22:27.592 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2021-10-08T19:22:27.597 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi157=y;smithi196=x", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:27.597 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: Saving service mgr spec with placement smithi157=y;smithi196=x;count:2 2021-10-08T19:22:27.598 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:27.598 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:27.598 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:27.598 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:27.599 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:27.599 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:22:27.599 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-10-08T19:22:27.599 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:22:27.599 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:27.600 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: Deploying daemon mgr.x on smithi196 2021-10-08T19:22:27.600 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:27 smithi196 ceph-mon[34258]: poll took 2753.380 ms: 1 events 2021-10-08T19:22:27.601 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2021-10-08T19:22:27.601 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2021-10-08T19:22:27.601 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000160735 s, 3.2 MB/s 2021-10-08T19:22:27.602 INFO:tasks.cephadm:Deploying osd.0 on smithi157 with /dev/vg_nvme/lv_4... 2021-10-08T19:22:27.603 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-10-08T19:22:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi157=y;smithi196=x", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: Saving service mgr spec with placement smithi157=y;smithi196=x;count:2 2021-10-08T19:22:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:22:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-10-08T19:22:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:22:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:27.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: Deploying daemon mgr.x on smithi196 2021-10-08T19:22:27.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[32847]: poll took 2753.380 ms: 1 events 2021-10-08T19:22:27.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi157=y;smithi196=x", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:27.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: Saving service mgr spec with placement smithi157=y;smithi196=x;count:2 2021-10-08T19:22:27.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:27.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:27.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:27.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:27.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:27.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:22:27.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-10-08T19:22:27.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:22:27.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:27.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: Deploying daemon mgr.x on smithi196 2021-10-08T19:22:27.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:27 smithi157 ceph-mon[42114]: poll took 2753.380 ms: 1 events 2021-10-08T19:22:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:28 smithi196 ceph-mon[34258]: poll took 1191.000 ms: 1 events 2021-10-08T19:22:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:28 smithi196 ceph-mon[34258]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:28.618 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:22:28 smithi196 systemd[1]: Starting Ceph mgr.x for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:22:28.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:28 smithi157 ceph-mon[32847]: poll took 1191.000 ms: 1 events 2021-10-08T19:22:28.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:28 smithi157 ceph-mon[32847]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:28.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:28 smithi157 ceph-mon[42114]: poll took 1191.000 ms: 1 events 2021-10-08T19:22:28.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:28 smithi157 ceph-mon[42114]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:29.587 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-10-08T19:22:29.588 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-10-08T19:22:29.588 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2021-10-08T19:22:29.588 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2021-10-08T19:22:29.589 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00842536 s, 1.2 GB/s 2021-10-08T19:22:29.589 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2021-10-08T19:22:29.616 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:22:29 smithi196 ceph-mgr[36288]: -- 172.21.15.196:0/3607548569 <== mon.2 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5580e669a340 con 0x5580e6672800 2021-10-08T19:22:29.617 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:22:29 smithi196 bash[36076]: 19848b210193a2f8d67e87b3c60ee44476c0b86db8ff577e33f3e07c71ed3144 2021-10-08T19:22:29.617 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:22:29 smithi196 systemd[1]: Started Ceph mgr.x for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:22:30.305 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi157:vg_nvme/lv_4 2021-10-08T19:22:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: Sending message to agent on host smithi196 2021-10-08T19:22:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:30.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:30.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: Reconfiguring mgr.y (unknown last config time)... 2021-10-08T19:22:30.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:22:30.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:22:30.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:30.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: Reconfiguring daemon mgr.y on smithi157 2021-10-08T19:22:30.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:30.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:30.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: Sending message to agent on host smithi196 2021-10-08T19:22:30.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:30.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:30.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:30.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:30.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:30.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: Reconfiguring mgr.y (unknown last config time)... 2021-10-08T19:22:30.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:22:30.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:22:30.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:30.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: Reconfiguring daemon mgr.y on smithi157 2021-10-08T19:22:30.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:30.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: Sending message to agent on host smithi196 2021-10-08T19:22:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: Reconfiguring mgr.y (unknown last config time)... 2021-10-08T19:22:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:22:30.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:22:30.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:30.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: Reconfiguring daemon mgr.y on smithi157 2021-10-08T19:22:30.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:31.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:31 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi196 2021-10-08T19:22:31.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:31 smithi157 ceph-mon[32847]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:31.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:31 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi196 2021-10-08T19:22:31.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:31 smithi157 ceph-mon[42114]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:31.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:31 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi196 2021-10-08T19:22:31.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:31 smithi196 ceph-mon[34258]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.507+0000 7fdcdb382700 1 -- 172.21.15.157:0/2771525137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcd40f9830 msgr2=0x7fdcd40f9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.507+0000 7fdcdb382700 1 --2- 172.21.15.157:0/2771525137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcd40f9830 0x7fdcd40f9c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4004620 tx=0x7fdcc4009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:32.511 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.507+0000 7fdcdb382700 1 -- 172.21.15.157:0/2771525137 shutdown_connections 2021-10-08T19:22:32.511 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.507+0000 7fdcdb382700 1 --2- 172.21.15.157:0/2771525137 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcd40fa1c0 0x7fdcd4100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:32.511 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.507+0000 7fdcdb382700 1 --2- 172.21.15.157:0/2771525137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcd40f8590 0x7fdcd40f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:32.511 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.507+0000 7fdcdb382700 1 --2- 172.21.15.157:0/2771525137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcd40f9830 0x7fdcd40f9c80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.507+0000 7fdcdb382700 1 -- 172.21.15.157:0/2771525137 >> 172.21.15.157:0/2771525137 conn(0x7fdcd40f3d80 msgr2=0x7fdcd40f61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.507+0000 7fdcdb382700 1 -- 172.21.15.157:0/2771525137 shutdown_connections 2021-10-08T19:22:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.507+0000 7fdcdb382700 1 -- 172.21.15.157:0/2771525137 wait complete. 2021-10-08T19:22:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcdb382700 1 Processor -- start 2021-10-08T19:22:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcdb382700 1 -- start start 2021-10-08T19:22:32.513 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcdb382700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcd40f8590 0x7fdcd4108930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:32.513 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcdb382700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcd40f9830 0x7fdcd4108e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:32.513 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcdb382700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcd40fa1c0 0x7fdcd410ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:32.513 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcdb382700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4110440 con 0x7fdcd40f9830 2021-10-08T19:22:32.514 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcdb382700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41105b0 con 0x7fdcd40fa1c0 2021-10-08T19:22:32.514 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcdb382700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4110770 con 0x7fdcd40f8590 2021-10-08T19:22:32.514 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd911e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcd40f8590 0x7fdcd4108930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:32.514 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd891d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcd40f9830 0x7fdcd4108e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:32.515 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd911e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcd40f8590 0x7fdcd4108930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:48916/0 (socket says 172.21.15.157:48916) 2021-10-08T19:22:32.515 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd911e700 1 -- 172.21.15.157:0/1724128864 learned_addr learned my addr 172.21.15.157:0/1724128864 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:22:32.515 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd991f700 1 --2- 172.21.15.157:0/1724128864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcd40fa1c0 0x7fdcd410ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:32.515 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd911e700 1 -- 172.21.15.157:0/1724128864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcd40fa1c0 msgr2=0x7fdcd410ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:32.516 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd911e700 1 --2- 172.21.15.157:0/1724128864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcd40fa1c0 0x7fdcd410ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:32.516 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd911e700 1 -- 172.21.15.157:0/1724128864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcd40f9830 msgr2=0x7fdcd4108e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:32.516 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd911e700 1 --2- 172.21.15.157:0/1724128864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcd40f9830 0x7fdcd4108e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:32.516 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd911e700 1 -- 172.21.15.157:0/1724128864 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0005040 con 0x7fdcd40f8590 2021-10-08T19:22:32.516 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.508+0000 7fdcd911e700 1 --2- 172.21.15.157:0/1724128864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcd40f8590 0x7fdcd4108930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00049e0 tx=0x7fdcd0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:32.517 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.509+0000 7fdcc9ffb700 1 -- 172.21.15.157:0/1724128864 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000e050 con 0x7fdcd40f8590 2021-10-08T19:22:32.517 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.509+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc4005040 con 0x7fdcd40f8590 2021-10-08T19:22:32.517 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.509+0000 7fdcc9ffb700 1 -- 172.21.15.157:0/1724128864 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fdcd000f040 con 0x7fdcd40f8590 2021-10-08T19:22:32.517 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.509+0000 7fdcc9ffb700 1 -- 172.21.15.157:0/1724128864 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0014880 con 0x7fdcd40f8590 2021-10-08T19:22:32.518 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.509+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd406ba20 con 0x7fdcd40f8590 2021-10-08T19:22:32.518 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.509+0000 7fdcc9ffb700 1 -- 172.21.15.157:0/1724128864 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 13) v1 ==== 40519+0+0 (secure 0 0 0) 0x7fdcd001b030 con 0x7fdcd40f8590 2021-10-08T19:22:32.518 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.510+0000 7fdcc9ffb700 1 --2- 172.21.15.157:0/1724128864 >> v2:172.21.15.157:6800/3606206634 conn(0x7fdcc00339e0 0x7fdcc0035e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:32.518 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.510+0000 7fdcc9ffb700 1 -- 172.21.15.157:0/1724128864 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fdcd0043fb0 con 0x7fdcd40f8590 2021-10-08T19:22:32.518 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.510+0000 7fdcd891d700 1 --2- 172.21.15.157:0/1724128864 >> v2:172.21.15.157:6800/3606206634 conn(0x7fdcc00339e0 0x7fdcc0035e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:32.519 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.510+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4047b50 con 0x7fdcd40f8590 2021-10-08T19:22:32.519 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.510+0000 7fdcd891d700 1 --2- 172.21.15.157:0/1724128864 >> v2:172.21.15.157:6800/3606206634 conn(0x7fdcc00339e0 0x7fdcc0035e90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009da0 tx=0x7fdcc4009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:32.520 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.514+0000 7fdcc9ffb700 1 -- 172.21.15.157:0/1724128864 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fdcd0019020 con 0x7fdcd40f8590 2021-10-08T19:22:32.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[32847]: poll took 1773.488 ms: 1 events 2021-10-08T19:22:32.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:32.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:32.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:32.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:32.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:32.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:32.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[32847]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:32.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[42114]: poll took 1773.488 ms: 1 events 2021-10-08T19:22:32.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:32.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:32.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:32 smithi157 ceph-mon[42114]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:32.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:32 smithi196 ceph-mon[34258]: poll took 1773.488 ms: 1 events 2021-10-08T19:22:32.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:32.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:32.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:32.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:32.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:32.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:32 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:32.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:32 smithi196 ceph-mon[34258]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:32.683 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:32.683+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcd41035a0 con 0x7fdcc00339e0 2021-10-08T19:22:33.479 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:22:33 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:22:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:33.480 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[32847]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:33.480 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:22:33.480 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:22:33.481 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:33.481 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[32847]: poll took 1375.293 ms: 1 events 2021-10-08T19:22:33.481 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[42114]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:33.482 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:22:33.482 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:22:33.482 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:33.482 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:33 smithi157 ceph-mon[42114]: poll took 1375.293 ms: 1 events 2021-10-08T19:22:33.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:33 smithi196 ceph-mon[34258]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:33.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:33 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:22:33.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:33 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:22:33.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:33 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:33.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:33 smithi196 ceph-mon[34258]: poll took 1375.293 ms: 1 events 2021-10-08T19:22:34.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:34.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:34.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:34.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:34.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:22:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:34.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:34.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:34.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:34.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[32847]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:34.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:34.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[42114]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:34.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:34.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:34.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:22:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:34.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:34.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:34.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:34.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:34 smithi157 ceph-mon[42114]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:34.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:34 smithi196 ceph-mon[34258]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:34 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:34 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:22:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:34 smithi196 ceph-mon[34258]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:35.579 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:35.577+0000 7fdcc9ffb700 1 -- 172.21.15.157:0/1724128864 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mgrmap(e 14) v1 ==== 80730+0+0 (secure 0 0 0) 0x7fdcd003f070 con 0x7fdcd40f8590 2021-10-08T19:22:35.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: Standby manager daemon x started 2021-10-08T19:22:35.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:22:35.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:22:35.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:22:35.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:22:35.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/621974164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0872c520-e1e2-49e4-b0d2-02dad0732102"}]: dispatch 2021-10-08T19:22:35.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/621974164' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0872c520-e1e2-49e4-b0d2-02dad0732102"}]': finished 2021-10-08T19:22:35.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: osdmap e5: 1 total, 0 up, 1 in 2021-10-08T19:22:35.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:35.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/689119632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:22:35.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: Standby manager daemon x started 2021-10-08T19:22:35.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:22:35.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:22:35.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:22:35.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:22:35.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/621974164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0872c520-e1e2-49e4-b0d2-02dad0732102"}]: dispatch 2021-10-08T19:22:35.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/621974164' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0872c520-e1e2-49e4-b0d2-02dad0732102"}]': finished 2021-10-08T19:22:35.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: osdmap e5: 1 total, 0 up, 1 in 2021-10-08T19:22:35.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:35.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/689119632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:22:35.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: Standby manager daemon x started 2021-10-08T19:22:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:22:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:22:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:22:35.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: from='mgr.? 172.21.15.196:0/3321427260' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:22:35.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/621974164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0872c520-e1e2-49e4-b0d2-02dad0732102"}]: dispatch 2021-10-08T19:22:35.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/621974164' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0872c520-e1e2-49e4-b0d2-02dad0732102"}]': finished 2021-10-08T19:22:35.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: osdmap e5: 1 total, 0 up, 1 in 2021-10-08T19:22:35.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:35.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/689119632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:22:36.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:36 smithi196 ceph-mon[34258]: mgrmap e14: y(active, since 106s), standbys: x 2021-10-08T19:22:36.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:36 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:22:36.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:36 smithi196 ceph-mon[34258]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:36 smithi157 ceph-mon[32847]: mgrmap e14: y(active, since 106s), standbys: x 2021-10-08T19:22:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:36 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:22:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:36 smithi157 ceph-mon[32847]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:37.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:36 smithi157 ceph-mon[42114]: mgrmap e14: y(active, since 106s), standbys: x 2021-10-08T19:22:37.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:36 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:22:37.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:36 smithi157 ceph-mon[42114]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:38.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:38 smithi196 ceph-mon[34258]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:38.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:38 smithi157 ceph-mon[32847]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:38.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:38 smithi157 ceph-mon[42114]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:39.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:39 smithi157 ceph-mon[32847]: poll took 5372.465 ms: 1 events 2021-10-08T19:22:39.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:39 smithi157 ceph-mon[42114]: poll took 5372.465 ms: 1 events 2021-10-08T19:22:39.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:39 smithi196 ceph-mon[34258]: poll took 5372.465 ms: 1 events 2021-10-08T19:22:40.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:40 smithi157 ceph-mon[32847]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:40.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:40 smithi157 ceph-mon[42114]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:40.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:40 smithi196 ceph-mon[34258]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:41.649 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:41 smithi157 ceph-mon[32847]: poll took 2118.623 ms: 1 events 2021-10-08T19:22:41.649 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:41 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-10-08T19:22:41.649 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:41 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:41.649 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:41 smithi157 ceph-mon[32847]: Deploying daemon osd.0 on smithi157 2021-10-08T19:22:41.650 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:41 smithi157 ceph-mon[42114]: poll took 2118.623 ms: 1 events 2021-10-08T19:22:41.650 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:41 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-10-08T19:22:41.650 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:41 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:41.651 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:41 smithi157 ceph-mon[42114]: Deploying daemon osd.0 on smithi157 2021-10-08T19:22:41.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:41 smithi196 ceph-mon[34258]: poll took 2118.623 ms: 1 events 2021-10-08T19:22:41.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:41 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-10-08T19:22:41.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:41 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:41.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:41 smithi196 ceph-mon[34258]: Deploying daemon osd.0 on smithi157 2021-10-08T19:22:42.853 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:42 smithi157 ceph-mon[32847]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:42.853 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:42 smithi157 ceph-mon[42114]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:42.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:42 smithi196 ceph-mon[34258]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:44.271 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 0 on host 'smithi157' 2021-10-08T19:22:44.272 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.268+0000 7fdcc9ffb700 1 -- 172.21.15.157:0/1724128864 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdcd41035a0 con 0x7fdcc00339e0 2021-10-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 >> v2:172.21.15.157:6800/3606206634 conn(0x7fdcc00339e0 msgr2=0x7fdcc0035e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:44.274 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 --2- 172.21.15.157:0/1724128864 >> v2:172.21.15.157:6800/3606206634 conn(0x7fdcc00339e0 0x7fdcc0035e90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009da0 tx=0x7fdcc4009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:44.274 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcd40f8590 msgr2=0x7fdcd4108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:44.274 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 --2- 172.21.15.157:0/1724128864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcd40f8590 0x7fdcd4108930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00049e0 tx=0x7fdcd0009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:44.274 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 shutdown_connections 2021-10-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 --2- 172.21.15.157:0/1724128864 >> v2:172.21.15.157:6800/3606206634 conn(0x7fdcc00339e0 0x7fdcc0035e90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 --2- 172.21.15.157:0/1724128864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcd40fa1c0 0x7fdcd410ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 --2- 172.21.15.157:0/1724128864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcd40f8590 0x7fdcd4108930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:44.276 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 --2- 172.21.15.157:0/1724128864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcd40f9830 0x7fdcd4108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:44.276 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 >> 172.21.15.157:0/1724128864 conn(0x7fdcd40f3d80 msgr2=0x7fdcd40fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:44.276 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 shutdown_connections 2021-10-08T19:22:44.276 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:44.272+0000 7fdcdb382700 1 -- 172.21.15.157:0/1724128864 wait complete. 2021-10-08T19:22:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: poll took 3101.345 ms: 1 events 2021-10-08T19:22:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:22:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi157 to 15124M 2021-10-08T19:22:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:44.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:44.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:44.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: poll took 3101.345 ms: 1 events 2021-10-08T19:22:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:22:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi157 to 15124M 2021-10-08T19:22:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:44.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.866 DEBUG:teuthology.orchestra.run.smithi157:osd.0> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.0.service 2021-10-08T19:22:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: poll took 3101.345 ms: 1 events 2021-10-08T19:22:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:22:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi157 to 15124M 2021-10-08T19:22:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:44.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:44.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:44.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:44.873 INFO:tasks.cephadm:Deploying osd.1 on smithi157 with /dev/vg_nvme/lv_3... 2021-10-08T19:22:44.873 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-10-08T19:22:44.908 INFO:journalctl@ceph.osd.0.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:22:46.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:46 smithi157 ceph-mon[42114]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:46.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:46 smithi157 ceph-mon[32847]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:46.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:46 smithi196 ceph-mon[34258]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:47.455 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-10-08T19:22:47.455 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-10-08T19:22:47.455 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2021-10-08T19:22:47.456 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2021-10-08T19:22:47.456 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108606 s, 965 MB/s 2021-10-08T19:22:47.456 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2021-10-08T19:22:47.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:47 smithi157 ceph-mon[32847]: from='osd.0 v2:172.21.15.157:6801/1113941339' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:22:47.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:47 smithi157 ceph-mon[32847]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:22:47.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:47 smithi157 ceph-mon[42114]: from='osd.0 v2:172.21.15.157:6801/1113941339' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:22:47.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:47 smithi157 ceph-mon[42114]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:22:47.830 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:22:47 smithi157 conmon[47549]: 2021-10-08T19:22:47.472+0000 7efd075c50c0 -1 osd.0 0 log_to_monitors {default=true} 2021-10-08T19:22:47.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:47 smithi196 ceph-mon[34258]: from='osd.0 v2:172.21.15.157:6801/1113941339' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:22:47.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:47 smithi196 ceph-mon[34258]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:22:48.059 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi157:vg_nvme/lv_3 2021-10-08T19:22:48.802 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[32847]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-10-08T19:22:48.802 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[32847]: osdmap e6: 1 total, 0 up, 1 in 2021-10-08T19:22:48.803 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:48.803 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[32847]: from='osd.0 v2:172.21.15.157:6801/1113941339' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:22:48.804 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[32847]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:22:48.804 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[32847]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:48.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[42114]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-10-08T19:22:48.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[42114]: osdmap e6: 1 total, 0 up, 1 in 2021-10-08T19:22:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[42114]: from='osd.0 v2:172.21.15.157:6801/1113941339' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:22:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[42114]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:22:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:48 smithi157 ceph-mon[42114]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:48.808 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:22:48 smithi157 conmon[47549]: 2021-10-08T19:22:48.540+0000 7efcfdd6d700 -1 osd.0 0 waiting for initial osdmap 2021-10-08T19:22:48.808 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:22:48 smithi157 conmon[47549]: 2021-10-08T19:22:48.542+0000 7efcf8704700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:22:48.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:48 smithi196 ceph-mon[34258]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-10-08T19:22:48.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:48 smithi196 ceph-mon[34258]: osdmap e6: 1 total, 0 up, 1 in 2021-10-08T19:22:48.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:48 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:48.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:48 smithi196 ceph-mon[34258]: from='osd.0 v2:172.21.15.157:6801/1113941339' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:22:48.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:48 smithi196 ceph-mon[34258]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:22:48.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:48 smithi196 ceph-mon[34258]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:49.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:49 smithi157 ceph-mon[32847]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:22:49.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:49 smithi157 ceph-mon[32847]: osdmap e7: 1 total, 0 up, 1 in 2021-10-08T19:22:49.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:49.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:49.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:49 smithi157 ceph-mon[42114]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:22:49.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:49 smithi157 ceph-mon[42114]: osdmap e7: 1 total, 0 up, 1 in 2021-10-08T19:22:49.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:49 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:49.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:49 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:49.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:49 smithi196 ceph-mon[34258]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:22:49.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:49 smithi196 ceph-mon[34258]: osdmap e7: 1 total, 0 up, 1 in 2021-10-08T19:22:49.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:49 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:49.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:49 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:50.350 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 -- 172.21.15.157:0/118929619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80f9a70 msgr2=0x7febf80f9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:50.350 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 --2- 172.21.15.157:0/118929619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80f9a70 0x7febf80f9ec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7febe00046e0 tx=0x7febe0009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:50.351 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 -- 172.21.15.157:0/118929619 shutdown_connections 2021-10-08T19:22:50.351 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 --2- 172.21.15.157:0/118929619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf80fa400 0x7febf8100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:50.351 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 --2- 172.21.15.157:0/118929619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80f87d0 0x7febf80f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:50.351 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 --2- 172.21.15.157:0/118929619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80f9a70 0x7febf80f9ec0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:50.351 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 -- 172.21.15.157:0/118929619 >> 172.21.15.157:0/118929619 conn(0x7febf80f4000 msgr2=0x7febf80f6410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:50.352 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 -- 172.21.15.157:0/118929619 shutdown_connections 2021-10-08T19:22:50.352 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 -- 172.21.15.157:0/118929619 wait complete. 2021-10-08T19:22:50.352 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 Processor -- start 2021-10-08T19:22:50.352 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.349+0000 7febfdd2b700 1 -- start start 2021-10-08T19:22:50.354 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febfdd2b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf80f87d0 0x7febf806d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:50.354 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febfdd2b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80f9a70 0x7febf806b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:50.354 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febfdd2b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80fa400 0x7febf806bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:50.354 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febfdd2b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf806c360 con 0x7febf80f87d0 2021-10-08T19:22:50.355 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febfdd2b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf806c4d0 con 0x7febf80f9a70 2021-10-08T19:22:50.356 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febfdd2b700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf8112b80 con 0x7febf80fa400 2021-10-08T19:22:50.356 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf80f87d0 0x7febf806d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:50.356 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf7fff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80fa400 0x7febf806bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:50.356 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf80f87d0 0x7febf806d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39732/0 (socket says 172.21.15.157:39732) 2021-10-08T19:22:50.356 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf7fff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80fa400 0x7febf806bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:48984/0 (socket says 172.21.15.157:48984) 2021-10-08T19:22:50.357 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf77fe700 1 -- 172.21.15.157:0/558685824 learned_addr learned my addr 172.21.15.157:0/558685824 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:22:50.357 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf6ffd700 1 --2- 172.21.15.157:0/558685824 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80f9a70 0x7febf806b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:50.357 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf77fe700 1 -- 172.21.15.157:0/558685824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80fa400 msgr2=0x7febf806bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:50.358 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf77fe700 1 --2- 172.21.15.157:0/558685824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80fa400 0x7febf806bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:50.358 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf77fe700 1 -- 172.21.15.157:0/558685824 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80f9a70 msgr2=0x7febf806b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:50.358 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf77fe700 1 --2- 172.21.15.157:0/558685824 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80f9a70 0x7febf806b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:50.359 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf77fe700 1 -- 172.21.15.157:0/558685824 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8005040 con 0x7febf80f87d0 2021-10-08T19:22:50.359 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf7fff700 1 --2- 172.21.15.157:0/558685824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80fa400 0x7febf806bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:22:50.359 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febf77fe700 1 --2- 172.21.15.157:0/558685824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf80f87d0 0x7febf806d0b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7febf000d870 tx=0x7febf0004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:50.359 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.350+0000 7febeffff700 1 -- 172.21.15.157:0/558685824 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00125a0 con 0x7febf80f87d0 2021-10-08T19:22:50.359 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.351+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe0005040 con 0x7febf80f87d0 2021-10-08T19:22:50.360 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.351+0000 7febeffff700 1 -- 172.21.15.157:0/558685824 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7febf000f040 con 0x7febf80f87d0 2021-10-08T19:22:50.360 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.351+0000 7febeffff700 1 -- 172.21.15.157:0/558685824 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0013ad0 con 0x7febf80f87d0 2021-10-08T19:22:50.360 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.351+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf8113130 con 0x7febf80f87d0 2021-10-08T19:22:50.360 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.352+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf8062bc0 con 0x7febf80f87d0 2021-10-08T19:22:50.360 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.352+0000 7febeffff700 1 -- 172.21.15.157:0/558685824 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 14) v1 ==== 80730+0+0 (secure 0 0 0) 0x7febf0012700 con 0x7febf80f87d0 2021-10-08T19:22:50.361 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.352+0000 7febeffff700 1 --2- 172.21.15.157:0/558685824 >> v2:172.21.15.157:6800/3606206634 conn(0x7febe4063460 0x7febe4065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:50.361 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.352+0000 7febeffff700 1 -- 172.21.15.157:0/558685824 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1537+0+0 (secure 0 0 0) 0x7febf007ec00 con 0x7febf80f87d0 2021-10-08T19:22:50.361 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.352+0000 7febf6ffd700 1 --2- 172.21.15.157:0/558685824 >> v2:172.21.15.157:6800/3606206634 conn(0x7febe4063460 0x7febe4065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:50.362 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.353+0000 7febf6ffd700 1 --2- 172.21.15.157:0/558685824 >> v2:172.21.15.157:6800/3606206634 conn(0x7febe4063460 0x7febe4065910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7febe00046b0 tx=0x7febe0009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:50.362 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.357+0000 7febeffff700 1 -- 172.21.15.157:0/558685824 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7febf0084020 con 0x7febf80f87d0 2021-10-08T19:22:50.551 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:22:50.550+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7febf8103730 con 0x7febe4063460 2021-10-08T19:22:50.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:22:50 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:22:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[32847]: purged_snaps scrub starts 2021-10-08T19:22:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[32847]: purged_snaps scrub ok 2021-10-08T19:22:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[32847]: osd.0 v2:172.21.15.157:6801/1113941339 boot 2021-10-08T19:22:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[32847]: osdmap e8: 1 total, 1 up, 1 in 2021-10-08T19:22:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:50.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[32847]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:50.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[42114]: purged_snaps scrub starts 2021-10-08T19:22:50.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[42114]: purged_snaps scrub ok 2021-10-08T19:22:50.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[42114]: osd.0 v2:172.21.15.157:6801/1113941339 boot 2021-10-08T19:22:50.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[42114]: osdmap e8: 1 total, 1 up, 1 in 2021-10-08T19:22:50.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:50.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:50.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:50.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:50 smithi157 ceph-mon[42114]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:50.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:50 smithi196 ceph-mon[34258]: purged_snaps scrub starts 2021-10-08T19:22:50.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:50 smithi196 ceph-mon[34258]: purged_snaps scrub ok 2021-10-08T19:22:50.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:50 smithi196 ceph-mon[34258]: osd.0 v2:172.21.15.157:6801/1113941339 boot 2021-10-08T19:22:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:50 smithi196 ceph-mon[34258]: osdmap e8: 1 total, 1 up, 1 in 2021-10-08T19:22:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:50 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:22:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:50 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:50 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:50.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:50 smithi196 ceph-mon[34258]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:51.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: osdmap e9: 1 total, 1 up, 1 in 2021-10-08T19:22:51.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:51.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: Detected new or changed devices on smithi157 2021-10-08T19:22:51.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:51.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:22:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:51.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: from='client.14241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:51.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:22:51.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:22:51.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:51.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[42114]: poll took 6295.072 ms: 1 events 2021-10-08T19:22:51.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: osdmap e9: 1 total, 1 up, 1 in 2021-10-08T19:22:51.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:51.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: Detected new or changed devices on smithi157 2021-10-08T19:22:51.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:51.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:22:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:51.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: from='client.14241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:51.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:22:51.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:22:51.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:51.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:51 smithi157 ceph-mon[32847]: poll took 6295.072 ms: 1 events 2021-10-08T19:22:51.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: osdmap e9: 1 total, 1 up, 1 in 2021-10-08T19:22:51.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:51.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: Detected new or changed devices on smithi157 2021-10-08T19:22:51.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:22:51.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:22:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:51.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: from='client.14241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:51.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:22:51.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:22:51.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:51.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:51 smithi196 ceph-mon[34258]: poll took 6295.072 ms: 1 events 2021-10-08T19:22:52.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:52 smithi157 ceph-mon[32847]: pgmap v60: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:52.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:52 smithi157 ceph-mon[42114]: pgmap v60: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:52.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:52 smithi196 ceph-mon[34258]: pgmap v60: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:53.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4280380238' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c8904ce-90a6-414e-bedb-2c8cbdd3649b"}]: dispatch 2021-10-08T19:22:53.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c8904ce-90a6-414e-bedb-2c8cbdd3649b"}]: dispatch 2021-10-08T19:22:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c8904ce-90a6-414e-bedb-2c8cbdd3649b"}]': finished 2021-10-08T19:22:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[32847]: osdmap e10: 2 total, 1 up, 2 in 2021-10-08T19:22:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:22:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2469499591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:22:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4280380238' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c8904ce-90a6-414e-bedb-2c8cbdd3649b"}]: dispatch 2021-10-08T19:22:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c8904ce-90a6-414e-bedb-2c8cbdd3649b"}]: dispatch 2021-10-08T19:22:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c8904ce-90a6-414e-bedb-2c8cbdd3649b"}]': finished 2021-10-08T19:22:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[42114]: osdmap e10: 2 total, 1 up, 2 in 2021-10-08T19:22:53.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:22:53.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2469499591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:22:53.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4280380238' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c8904ce-90a6-414e-bedb-2c8cbdd3649b"}]: dispatch 2021-10-08T19:22:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c8904ce-90a6-414e-bedb-2c8cbdd3649b"}]: dispatch 2021-10-08T19:22:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c8904ce-90a6-414e-bedb-2c8cbdd3649b"}]': finished 2021-10-08T19:22:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:53 smithi196 ceph-mon[34258]: osdmap e10: 2 total, 1 up, 2 in 2021-10-08T19:22:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:22:53.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2469499591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:22:54.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:54 smithi157 ceph-mon[32847]: pgmap v62: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:54.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:54 smithi157 ceph-mon[42114]: pgmap v62: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:54.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:54 smithi196 ceph-mon[34258]: pgmap v62: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:56.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:56 smithi157 ceph-mon[32847]: poll took 5415.293 ms: 1 events 2021-10-08T19:22:56.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:56 smithi157 ceph-mon[32847]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:56.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:56 smithi157 ceph-mon[42114]: poll took 5415.293 ms: 1 events 2021-10-08T19:22:56.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:56 smithi157 ceph-mon[42114]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:56.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:56 smithi196 ceph-mon[34258]: poll took 5415.293 ms: 1 events 2021-10-08T19:22:56.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:56 smithi196 ceph-mon[34258]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:57.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:22:56 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:22:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:58.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:58.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:57 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:58.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:57 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:22:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:57 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:57 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:22:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:58.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:22:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:57 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:22:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:57 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:22:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:58 smithi157 ceph-mon[32847]: pgmap v64: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:59.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:58 smithi157 ceph-mon[42114]: pgmap v64: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:22:59.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:58 smithi196 ceph-mon[34258]: pgmap v64: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:00.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:59 smithi157 ceph-mon[42114]: poll took 2364.005 ms: 1 events 2021-10-08T19:23:00.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:59 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-10-08T19:23:00.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:59 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:00.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:22:59 smithi157 ceph-mon[42114]: Deploying daemon osd.1 on smithi157 2021-10-08T19:23:00.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:59 smithi157 ceph-mon[32847]: poll took 2364.005 ms: 1 events 2021-10-08T19:23:00.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:59 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-10-08T19:23:00.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:59 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:00.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:22:59 smithi157 ceph-mon[32847]: Deploying daemon osd.1 on smithi157 2021-10-08T19:23:00.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:59 smithi196 ceph-mon[34258]: poll took 2364.005 ms: 1 events 2021-10-08T19:23:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:59 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-10-08T19:23:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:59 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:22:59 smithi196 ceph-mon[34258]: Deploying daemon osd.1 on smithi157 2021-10-08T19:23:01.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:00 smithi157 ceph-mon[32847]: pgmap v65: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:01.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:00 smithi157 ceph-mon[42114]: pgmap v65: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:00 smithi196 ceph-mon[34258]: pgmap v65: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:02.609 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 1 on host 'smithi157' 2021-10-08T19:23:02.610 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.608+0000 7febeffff700 1 -- 172.21.15.157:0/558685824 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7febf8103730 con 0x7febe4063460 2021-10-08T19:23:02.612 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 >> v2:172.21.15.157:6800/3606206634 conn(0x7febe4063460 msgr2=0x7febe4065910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:02.612 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 --2- 172.21.15.157:0/558685824 >> v2:172.21.15.157:6800/3606206634 conn(0x7febe4063460 0x7febe4065910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7febe00046b0 tx=0x7febe0009b30 comp rx=0 tx=0).stop 2021-10-08T19:23:02.612 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf80f87d0 msgr2=0x7febf806d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:02.612 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 --2- 172.21.15.157:0/558685824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf80f87d0 0x7febf806d0b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7febf000d870 tx=0x7febf0004e80 comp rx=0 tx=0).stop 2021-10-08T19:23:02.613 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 shutdown_connections 2021-10-08T19:23:02.613 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 --2- 172.21.15.157:0/558685824 >> v2:172.21.15.157:6800/3606206634 conn(0x7febe4063460 0x7febe4065910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:02.613 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 --2- 172.21.15.157:0/558685824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febf80fa400 0x7febf806bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:02.613 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 --2- 172.21.15.157:0/558685824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf80f87d0 0x7febf806d0b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:02.613 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 --2- 172.21.15.157:0/558685824 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80f9a70 0x7febf806b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:02.614 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.611+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 >> 172.21.15.157:0/558685824 conn(0x7febf80f4000 msgr2=0x7febf80f7290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:02.614 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.612+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 shutdown_connections 2021-10-08T19:23:02.614 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:02.612+0000 7febfdd2b700 1 -- 172.21.15.157:0/558685824 wait complete. 2021-10-08T19:23:02.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:02 smithi196 ceph-mon[34258]: pgmap v66: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:02.634 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:02 smithi157 ceph-mon[32847]: pgmap v66: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:02.635 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:02 smithi157 ceph-mon[42114]: pgmap v66: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:03.204 DEBUG:teuthology.orchestra.run.smithi157:osd.1> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.1.service 2021-10-08T19:23:03.206 INFO:tasks.cephadm:Deploying osd.2 on smithi157 with /dev/vg_nvme/lv_2... 2021-10-08T19:23:03.207 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-10-08T19:23:03.233 INFO:journalctl@ceph.osd.1.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:23:03.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: poll took 3288.186 ms: 1 events 2021-10-08T19:23:03.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:03.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:03.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:03.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:03.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:03.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi157 to 7562M 2021-10-08T19:23:03.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:03.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:03.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:03.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.658 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: poll took 3288.186 ms: 1 events 2021-10-08T19:23:03.658 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:03.658 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:03.658 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.659 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:03.659 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:03.659 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.659 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:03.660 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi157 to 7562M 2021-10-08T19:23:03.660 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.660 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.661 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:03.661 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:03.661 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:03.661 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.662 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: poll took 3288.186 ms: 1 events 2021-10-08T19:23:03.662 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:03.662 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:03.662 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.663 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:03.663 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:03.663 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.663 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:03.663 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi157 to 7562M 2021-10-08T19:23:03.664 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.664 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:03.664 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:03.664 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:03.664 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:03.665 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:04.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:04 smithi157 ceph-mon[32847]: pgmap v67: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:04.847 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:04 smithi157 ceph-mon[42114]: pgmap v67: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:04.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:04 smithi196 ceph-mon[34258]: pgmap v67: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:05.210 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-10-08T19:23:05.210 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-10-08T19:23:05.210 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2021-10-08T19:23:05.211 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2021-10-08T19:23:05.211 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00946783 s, 1.1 GB/s 2021-10-08T19:23:05.211 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2021-10-08T19:23:05.721 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi157:vg_nvme/lv_2 2021-10-08T19:23:06.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:05 smithi157 ceph-mon[32847]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:23:06.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:05 smithi157 ceph-mon[42114]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:23:06.079 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:05 smithi157 conmon[51806]: 2021-10-08T19:23:05.811+0000 7f9f48cba0c0 -1 osd.1 0 log_to_monitors {default=true} 2021-10-08T19:23:06.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:05 smithi196 ceph-mon[34258]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:23:07.217 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:06 smithi157 conmon[51806]: 2021-10-08T19:23:06.871+0000 7f9f3f462700 -1 osd.1 0 waiting for initial osdmap 2021-10-08T19:23:07.218 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:06 smithi157 conmon[51806]: 2021-10-08T19:23:06.875+0000 7f9f39df9700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:23:07.218 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[32847]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-10-08T19:23:07.219 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[32847]: osdmap e11: 2 total, 1 up, 2 in 2021-10-08T19:23:07.219 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:07.219 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[32847]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:23:07.219 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[32847]: pgmap v69: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:07.220 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[32847]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:23:07.220 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[32847]: osdmap e12: 2 total, 1 up, 2 in 2021-10-08T19:23:07.220 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:07.220 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[42114]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-10-08T19:23:07.221 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[42114]: osdmap e11: 2 total, 1 up, 2 in 2021-10-08T19:23:07.221 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:07.221 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[42114]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:23:07.221 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[42114]: pgmap v69: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:07.222 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[42114]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:23:07.222 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[42114]: osdmap e12: 2 total, 1 up, 2 in 2021-10-08T19:23:07.222 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:06 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:07.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:06 smithi196 ceph-mon[34258]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-10-08T19:23:07.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:06 smithi196 ceph-mon[34258]: osdmap e11: 2 total, 1 up, 2 in 2021-10-08T19:23:07.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:06 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:07.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:06 smithi196 ceph-mon[34258]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:23:07.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:06 smithi196 ceph-mon[34258]: pgmap v69: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:07.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:06 smithi196 ceph-mon[34258]: from='osd.1 v2:172.21.15.157:6805/336233855' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:23:07.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:06 smithi196 ceph-mon[34258]: osdmap e12: 2 total, 1 up, 2 in 2021-10-08T19:23:07.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:06 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:07.395 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.392+0000 7f05badbe700 1 -- 172.21.15.157:0/2021496852 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f05b40f81c0 msgr2=0x7f05b40ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:07.395 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.392+0000 7f05badbe700 1 --2- 172.21.15.157:0/2021496852 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f05b40f81c0 0x7f05b40ffa70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009a60 tx=0x7f05ac004d10 comp rx=0 tx=0).stop 2021-10-08T19:23:07.396 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.392+0000 7f05badbe700 1 -- 172.21.15.157:0/2021496852 shutdown_connections 2021-10-08T19:23:07.396 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.392+0000 7f05badbe700 1 --2- 172.21.15.157:0/2021496852 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f05b40f81c0 0x7f05b40ffa70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:07.397 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.392+0000 7f05badbe700 1 --2- 172.21.15.157:0/2021496852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05b40f8ac0 0x7f05b40f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:07.397 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.392+0000 7f05badbe700 1 --2- 172.21.15.157:0/2021496852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b40f7810 0x7f05b40f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:07.397 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.392+0000 7f05badbe700 1 -- 172.21.15.157:0/2021496852 >> 172.21.15.157:0/2021496852 conn(0x7f05b40f2410 msgr2=0x7f05b40f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:07.397 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.392+0000 7f05badbe700 1 -- 172.21.15.157:0/2021496852 shutdown_connections 2021-10-08T19:23:07.397 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.392+0000 7f05badbe700 1 -- 172.21.15.157:0/2021496852 wait complete. 2021-10-08T19:23:07.398 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05badbe700 1 Processor -- start 2021-10-08T19:23:07.398 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05badbe700 1 -- start start 2021-10-08T19:23:07.398 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05badbe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b40f7810 0x7f05b40f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:07.398 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05badbe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05b40f81c0 0x7f05b410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:07.402 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05badbe700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f05b40f8ac0 0x7f05b410fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:07.402 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05badbe700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4110220 con 0x7f05b40f81c0 2021-10-08T19:23:07.402 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05badbe700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4110390 con 0x7f05b40f7810 2021-10-08T19:23:07.403 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05badbe700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4110550 con 0x7f05b40f8ac0 2021-10-08T19:23:07.403 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05b3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05b40f81c0 0x7f05b410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:07.403 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05b935b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f05b40f8ac0 0x7f05b410fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:07.403 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05b3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05b40f81c0 0x7f05b410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39800/0 (socket says 172.21.15.157:39800) 2021-10-08T19:23:07.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05b3fff700 1 -- 172.21.15.157:0/3469586632 learned_addr learned my addr 172.21.15.157:0/3469586632 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:23:07.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.393+0000 7f05b8b5a700 1 --2- 172.21.15.157:0/3469586632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b40f7810 0x7f05b40f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:07.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b3fff700 1 -- 172.21.15.157:0/3469586632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f05b40f8ac0 msgr2=0x7f05b410fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:07.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b3fff700 1 --2- 172.21.15.157:0/3469586632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f05b40f8ac0 0x7f05b410fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:07.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b3fff700 1 -- 172.21.15.157:0/3469586632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b40f7810 msgr2=0x7f05b40f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:07.405 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b3fff700 1 --2- 172.21.15.157:0/3469586632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b40f7810 0x7f05b40f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:07.405 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b3fff700 1 -- 172.21.15.157:0/3469586632 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a8005040 con 0x7f05b40f81c0 2021-10-08T19:23:07.405 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b935b700 1 --2- 172.21.15.157:0/3469586632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f05b40f8ac0 0x7f05b410fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:23:07.406 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b3fff700 1 --2- 172.21.15.157:0/3469586632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05b40f81c0 0x7f05b410d4d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c5b0 tx=0x7f05a0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:07.406 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b17fa700 1 -- 172.21.15.157:0/3469586632 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0016070 con 0x7f05b40f81c0 2021-10-08T19:23:07.407 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b17fa700 1 -- 172.21.15.157:0/3469586632 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f05a0011a10 con 0x7f05b40f81c0 2021-10-08T19:23:07.407 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac009640 con 0x7f05b40f81c0 2021-10-08T19:23:07.407 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05b17fa700 1 -- 172.21.15.157:0/3469586632 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00128f0 con 0x7f05b40f81c0 2021-10-08T19:23:07.408 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.394+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b4110b30 con 0x7f05b40f81c0 2021-10-08T19:23:07.408 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.395+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b4102420 con 0x7f05b40f81c0 2021-10-08T19:23:07.409 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.395+0000 7f05b17fa700 1 -- 172.21.15.157:0/3469586632 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 14) v1 ==== 80730+0+0 (secure 0 0 0) 0x7f05a0010050 con 0x7f05b40f81c0 2021-10-08T19:23:07.409 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.396+0000 7f05b17fa700 1 --2- 172.21.15.157:0/3469586632 >> v2:172.21.15.157:6800/3606206634 conn(0x7f05a4063460 0x7f05a4065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:07.409 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.396+0000 7f05b17fa700 1 -- 172.21.15.157:0/3469586632 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1689+0+0 (secure 0 0 0) 0x7f05a007e2f0 con 0x7f05b40f81c0 2021-10-08T19:23:07.410 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.396+0000 7f05b8b5a700 1 --2- 172.21.15.157:0/3469586632 >> v2:172.21.15.157:6800/3606206634 conn(0x7f05a4063460 0x7f05a4065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:07.410 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.396+0000 7f05b8b5a700 1 --2- 172.21.15.157:0/3469586632 >> v2:172.21.15.157:6800/3606206634 conn(0x7f05a4063460 0x7f05a4065910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05b4061850 tx=0x7f05a8009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:07.411 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.400+0000 7f05b17fa700 1 -- 172.21.15.157:0/3469586632 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f05a0051ff0 con 0x7f05b40f81c0 2021-10-08T19:23:07.567 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:07.567+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f05b41025e0 con 0x7f05a4063460 2021-10-08T19:23:08.141 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:08.142 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:08.142 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:08.142 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:08.142 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:08.143 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:08.143 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:08.143 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:08.143 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:08.144 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:07 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:08.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:07 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:07 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:07 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:07 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:08.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:07 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:09.210 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[32847]: purged_snaps scrub starts 2021-10-08T19:23:09.210 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[32847]: purged_snaps scrub ok 2021-10-08T19:23:09.211 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[32847]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:09.211 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[32847]: poll took 4973.274 ms: 1 events 2021-10-08T19:23:09.211 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[32847]: osd.1 v2:172.21.15.157:6805/336233855 boot 2021-10-08T19:23:09.211 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[32847]: osdmap e13: 2 total, 2 up, 2 in 2021-10-08T19:23:09.212 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:09.212 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[32847]: pgmap v72: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:09.212 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[42114]: purged_snaps scrub starts 2021-10-08T19:23:09.212 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[42114]: purged_snaps scrub ok 2021-10-08T19:23:09.213 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[42114]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:09.213 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[42114]: poll took 4973.274 ms: 1 events 2021-10-08T19:23:09.213 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[42114]: osd.1 v2:172.21.15.157:6805/336233855 boot 2021-10-08T19:23:09.213 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[42114]: osdmap e13: 2 total, 2 up, 2 in 2021-10-08T19:23:09.214 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:09.214 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:08 smithi157 ceph-mon[42114]: pgmap v72: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:09.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:08 smithi196 ceph-mon[34258]: purged_snaps scrub starts 2021-10-08T19:23:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:08 smithi196 ceph-mon[34258]: purged_snaps scrub ok 2021-10-08T19:23:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:08 smithi196 ceph-mon[34258]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:08 smithi196 ceph-mon[34258]: poll took 4973.274 ms: 1 events 2021-10-08T19:23:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:08 smithi196 ceph-mon[34258]: osd.1 v2:172.21.15.157:6805/336233855 boot 2021-10-08T19:23:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:08 smithi196 ceph-mon[34258]: osdmap e13: 2 total, 2 up, 2 in 2021-10-08T19:23:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:08 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:08 smithi196 ceph-mon[34258]: pgmap v72: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:10.845 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[32847]: osdmap e14: 2 total, 2 up, 2 in 2021-10-08T19:23:10.846 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1691852949' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7"}]: dispatch 2021-10-08T19:23:10.846 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7"}]: dispatch 2021-10-08T19:23:10.846 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7"}]': finished 2021-10-08T19:23:10.846 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[32847]: osdmap e15: 3 total, 2 up, 3 in 2021-10-08T19:23:10.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:10.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[32847]: pgmap v75: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:10.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1438892713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:10.847 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[42114]: osdmap e14: 2 total, 2 up, 2 in 2021-10-08T19:23:10.848 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1691852949' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7"}]: dispatch 2021-10-08T19:23:10.848 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7"}]: dispatch 2021-10-08T19:23:10.848 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7"}]': finished 2021-10-08T19:23:10.848 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[42114]: osdmap e15: 3 total, 2 up, 3 in 2021-10-08T19:23:10.849 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:10.849 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[42114]: pgmap v75: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:10.849 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1438892713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:10.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:10 smithi196 ceph-mon[34258]: osdmap e14: 2 total, 2 up, 2 in 2021-10-08T19:23:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1691852949' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7"}]: dispatch 2021-10-08T19:23:10.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7"}]: dispatch 2021-10-08T19:23:10.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7"}]': finished 2021-10-08T19:23:10.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:10 smithi196 ceph-mon[34258]: osdmap e15: 3 total, 2 up, 3 in 2021-10-08T19:23:10.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:10 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:10.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:10 smithi196 ceph-mon[34258]: pgmap v75: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:10.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1438892713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:12.610 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:12 smithi157 ceph-mon[32847]: pgmap v76: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:12.611 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:12 smithi157 ceph-mon[42114]: pgmap v76: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:12.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:12 smithi196 ceph-mon[34258]: pgmap v76: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:13.372 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:13 smithi157 ceph-mon[32847]: poll took 5230.255 ms: 1 events 2021-10-08T19:23:13.372 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:13 smithi157 ceph-mon[42114]: poll took 5230.255 ms: 1 events 2021-10-08T19:23:13.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:13 smithi196 ceph-mon[34258]: poll took 5230.255 ms: 1 events 2021-10-08T19:23:14.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:14 smithi196 ceph-mon[34258]: pgmap v77: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:14 smithi157 ceph-mon[32847]: pgmap v77: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:14 smithi157 ceph-mon[42114]: pgmap v77: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:16.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:16 smithi196 ceph-mon[34258]: pgmap v78: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-10-08T19:23:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:16.811 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:16 smithi157 ceph-mon[32847]: pgmap v78: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:16.811 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-10-08T19:23:16.811 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:16.812 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:16 smithi157 ceph-mon[42114]: pgmap v78: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:16.812 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-10-08T19:23:16.812 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:17.064 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:23:16 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:23:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:17.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:17 smithi196 ceph-mon[34258]: poll took 2791.296 ms: 1 events 2021-10-08T19:23:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:17 smithi196 ceph-mon[34258]: Deploying daemon osd.2 on smithi157 2021-10-08T19:23:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:17 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:17 smithi196 ceph-mon[34258]: Detected new or changed devices on smithi157 2021-10-08T19:23:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:17 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:23:17.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:17 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:23:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:18.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[32847]: poll took 2791.296 ms: 1 events 2021-10-08T19:23:18.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[32847]: Deploying daemon osd.2 on smithi157 2021-10-08T19:23:18.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:18.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[32847]: Detected new or changed devices on smithi157 2021-10-08T19:23:18.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:23:18.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:23:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:18.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[42114]: poll took 2791.296 ms: 1 events 2021-10-08T19:23:18.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[42114]: Deploying daemon osd.2 on smithi157 2021-10-08T19:23:18.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:18.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[42114]: Detected new or changed devices on smithi157 2021-10-08T19:23:18.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:23:18.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:17 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:23:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:18.960 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:18 smithi157 ceph-mon[32847]: pgmap v79: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:18.960 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:18 smithi157 ceph-mon[42114]: pgmap v79: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:19.076 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:18 smithi196 ceph-mon[34258]: pgmap v79: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:20.181 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 2 on host 'smithi157' 2021-10-08T19:23:20.182 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.179+0000 7f05b17fa700 1 -- 172.21.15.157:0/3469586632 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f05b41025e0 con 0x7f05a4063460 2021-10-08T19:23:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 >> v2:172.21.15.157:6800/3606206634 conn(0x7f05a4063460 msgr2=0x7f05a4065910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 --2- 172.21.15.157:0/3469586632 >> v2:172.21.15.157:6800/3606206634 conn(0x7f05a4063460 0x7f05a4065910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05b4061850 tx=0x7f05a8009b30 comp rx=0 tx=0).stop 2021-10-08T19:23:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05b40f81c0 msgr2=0x7f05b410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 --2- 172.21.15.157:0/3469586632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05b40f81c0 0x7f05b410d4d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c5b0 tx=0x7f05a0007e10 comp rx=0 tx=0).stop 2021-10-08T19:23:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 shutdown_connections 2021-10-08T19:23:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 --2- 172.21.15.157:0/3469586632 >> v2:172.21.15.157:6800/3606206634 conn(0x7f05a4063460 0x7f05a4065910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 --2- 172.21.15.157:0/3469586632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f05b40f8ac0 0x7f05b410fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 --2- 172.21.15.157:0/3469586632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b40f7810 0x7f05b40f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 --2- 172.21.15.157:0/3469586632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05b40f81c0 0x7f05b410d4d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 >> 172.21.15.157:0/3469586632 conn(0x7f05b40f2410 msgr2=0x7f05b40f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 shutdown_connections 2021-10-08T19:23:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:20.182+0000 7f05badbe700 1 -- 172.21.15.157:0/3469586632 wait complete. 2021-10-08T19:23:20.564 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:20.564 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:20.565 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.565 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:20.565 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.565 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:20.566 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:20.566 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:20.566 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.566 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.566 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:20.567 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:20.567 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:20.567 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.568 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:20.568 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:20.568 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.568 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:20.568 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.569 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:20.569 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:20.570 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:20.570 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.570 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.571 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:20.571 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:20.571 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:20.571 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:20.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:20.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:20.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:20.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:20.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:20.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:20.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:20.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:20.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:20.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:23:20 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:23:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:20.918 DEBUG:teuthology.orchestra.run.smithi157:osd.2> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.2.service 2021-10-08T19:23:20.921 INFO:tasks.cephadm:Deploying osd.3 on smithi157 with /dev/vg_nvme/lv_1... 2021-10-08T19:23:20.922 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-10-08T19:23:20.948 INFO:journalctl@ceph.osd.2.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:23:21.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:21 smithi157 ceph-mon[32847]: poll took 3430.073 ms: 1 events 2021-10-08T19:23:21.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:21 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi157 to 5041M 2021-10-08T19:23:21.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:21 smithi157 ceph-mon[32847]: pgmap v80: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:21.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:21 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:21.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:21 smithi157 ceph-mon[42114]: poll took 3430.073 ms: 1 events 2021-10-08T19:23:21.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:21 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi157 to 5041M 2021-10-08T19:23:21.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:21 smithi157 ceph-mon[42114]: pgmap v80: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:21.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:21 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:21.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:21 smithi196 ceph-mon[34258]: poll took 3430.073 ms: 1 events 2021-10-08T19:23:21.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:21 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi157 to 5041M 2021-10-08T19:23:21.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:21 smithi196 ceph-mon[34258]: pgmap v80: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:21.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:21 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:22.565 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:22 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:23:22.565 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:22 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:23:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:22.566 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:22 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:23:22.566 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:22 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:23:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:22.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:22 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:23:22.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:22 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:23:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:22.991 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-10-08T19:23:22.992 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-10-08T19:23:22.992 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2021-10-08T19:23:22.992 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2021-10-08T19:23:22.992 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00936118 s, 1.1 GB/s 2021-10-08T19:23:22.992 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2021-10-08T19:23:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:23 smithi157 ceph-mon[32847]: pgmap v81: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:23.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:23 smithi157 ceph-mon[42114]: pgmap v81: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:23.587 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi157:vg_nvme/lv_1 2021-10-08T19:23:23.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:23 smithi196 ceph-mon[34258]: pgmap v81: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:23.828 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:23 smithi157 conmon[56096]: 2021-10-08T19:23:23.394+0000 7f7a3fe470c0 -1 osd.2 0 log_to_monitors {default=true} 2021-10-08T19:23:24.319 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:24 smithi157 ceph-mon[32847]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:23:24.320 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:24 smithi157 ceph-mon[42114]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:23:24.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:24 smithi196 ceph-mon[34258]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:23:25.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.327+0000 7f9c148ed700 1 -- 172.21.15.157:0/2742450288 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f8730 msgr2=0x7f9c100f8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:25.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.327+0000 7f9c148ed700 1 --2- 172.21.15.157:0/2742450288 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f8730 0x7f9c100f8b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80046e0 tx=0x7f9bf8009b30 comp rx=0 tx=0).stop 2021-10-08T19:23:25.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.327+0000 7f9c148ed700 1 -- 172.21.15.157:0/2742450288 shutdown_connections 2021-10-08T19:23:25.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.327+0000 7f9c148ed700 1 --2- 172.21.15.157:0/2742450288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c100f90c0 0x7f9c100ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:25.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.327+0000 7f9c148ed700 1 --2- 172.21.15.157:0/2742450288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c100f7490 0x7f9c100f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:25.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.327+0000 7f9c148ed700 1 --2- 172.21.15.157:0/2742450288 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f8730 0x7f9c100f8b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:25.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.327+0000 7f9c148ed700 1 -- 172.21.15.157:0/2742450288 >> 172.21.15.157:0/2742450288 conn(0x7f9c100f2c80 msgr2=0x7f9c100f50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:25.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.327+0000 7f9c148ed700 1 -- 172.21.15.157:0/2742450288 shutdown_connections 2021-10-08T19:23:25.332 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.327+0000 7f9c148ed700 1 -- 172.21.15.157:0/2742450288 wait complete. 2021-10-08T19:23:25.332 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c148ed700 1 Processor -- start 2021-10-08T19:23:25.332 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c148ed700 1 -- start start 2021-10-08T19:23:25.332 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c148ed700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f7490 0x7f9c101088d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:25.332 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c148ed700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c100f8730 0x7f9c10108e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:25.333 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c148ed700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c100f90c0 0x7f9c1010fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:25.333 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c148ed700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c101103e0 con 0x7f9c100f90c0 2021-10-08T19:23:25.333 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c148ed700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10110550 con 0x7f9c100f8730 2021-10-08T19:23:25.333 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c148ed700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10110710 con 0x7f9c100f7490 2021-10-08T19:23:25.334 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0e59c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f7490 0x7f9c101088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:25.334 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0e59c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f7490 0x7f9c101088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49122/0 (socket says 172.21.15.157:49122) 2021-10-08T19:23:25.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0e59c700 1 -- 172.21.15.157:0/287809708 learned_addr learned my addr 172.21.15.157:0/287809708 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:23:25.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0ed9d700 1 --2- 172.21.15.157:0/287809708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c100f90c0 0x7f9c1010fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:25.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0dd9b700 1 --2- 172.21.15.157:0/287809708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c100f8730 0x7f9c10108e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:25.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0e59c700 1 -- 172.21.15.157:0/287809708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c100f8730 msgr2=0x7f9c10108e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:25.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0e59c700 1 --2- 172.21.15.157:0/287809708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c100f8730 0x7f9c10108e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:25.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0e59c700 1 -- 172.21.15.157:0/287809708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c100f90c0 msgr2=0x7f9c1010fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:25.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0e59c700 1 --2- 172.21.15.157:0/287809708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c100f90c0 0x7f9c1010fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:25.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.328+0000 7f9c0e59c700 1 -- 172.21.15.157:0/287809708 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00009640 con 0x7f9c100f7490 2021-10-08T19:23:25.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.329+0000 7f9c0e59c700 1 --2- 172.21.15.157:0/287809708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f7490 0x7f9c101088d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c00001cb0 tx=0x7f9c00004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:25.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.329+0000 7f9c06ffd700 1 -- 172.21.15.157:0/287809708 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000092e0 con 0x7f9c100f7490 2021-10-08T19:23:25.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.329+0000 7f9c06ffd700 1 -- 172.21.15.157:0/287809708 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f9c0000f040 con 0x7f9c100f7490 2021-10-08T19:23:25.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.329+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf8005040 con 0x7f9c100f7490 2021-10-08T19:23:25.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.329+0000 7f9c06ffd700 1 -- 172.21.15.157:0/287809708 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00007ad0 con 0x7f9c100f7490 2021-10-08T19:23:25.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.329+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c10110dd0 con 0x7f9c100f7490 2021-10-08T19:23:25.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.330+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10047b50 con 0x7f9c100f7490 2021-10-08T19:23:25.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.330+0000 7f9c06ffd700 1 -- 172.21.15.157:0/287809708 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 14) v1 ==== 80730+0+0 (secure 0 0 0) 0x7f9c0001b030 con 0x7f9c100f7490 2021-10-08T19:23:25.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.330+0000 7f9c06ffd700 1 --2- 172.21.15.157:0/287809708 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9bfc063460 0x7f9bfc065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:25.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.331+0000 7f9c06ffd700 1 -- 172.21.15.157:0/287809708 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 1981+0+0 (secure 0 0 0) 0x7f9c0007e900 con 0x7f9c100f7490 2021-10-08T19:23:25.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.331+0000 7f9c0dd9b700 1 --2- 172.21.15.157:0/287809708 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9bfc063460 0x7f9bfc065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:25.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.331+0000 7f9c0dd9b700 1 --2- 172.21.15.157:0/287809708 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9bfc063460 0x7f9bfc065910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005010 tx=0x7f9bf8009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:25.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.335+0000 7f9c06ffd700 1 -- 172.21.15.157:0/287809708 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f9c00048b00 con 0x7f9c100f7490 2021-10-08T19:23:25.504 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:25.503+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c10102520 con 0x7f9bfc063460 2021-10-08T19:23:25.532 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[42114]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-10-08T19:23:25.532 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[42114]: osdmap e16: 3 total, 2 up, 3 in 2021-10-08T19:23:25.533 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:25.533 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[42114]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:23:25.533 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[42114]: pgmap v83: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:25.534 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:25 smithi157 conmon[56096]: 2021-10-08T19:23:25.242+0000 7f7a365ef700 -1 osd.2 0 waiting for initial osdmap 2021-10-08T19:23:25.534 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:25 smithi157 conmon[56096]: 2021-10-08T19:23:25.246+0000 7f7a2f783700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:23:25.534 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[32847]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-10-08T19:23:25.535 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[32847]: osdmap e16: 3 total, 2 up, 3 in 2021-10-08T19:23:25.535 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:25.535 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[32847]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:23:25.535 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:25 smithi157 ceph-mon[32847]: pgmap v83: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:25.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:25 smithi196 ceph-mon[34258]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-10-08T19:23:25.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:25 smithi196 ceph-mon[34258]: osdmap e16: 3 total, 2 up, 3 in 2021-10-08T19:23:25.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:25 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:25.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:25 smithi196 ceph-mon[34258]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:23:25.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:25 smithi196 ceph-mon[34258]: pgmap v83: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:26.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[32847]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:23:26.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[32847]: osdmap e17: 3 total, 2 up, 3 in 2021-10-08T19:23:26.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:26.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:26.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:26.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:26.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:26.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[42114]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:23:26.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[42114]: osdmap e17: 3 total, 2 up, 3 in 2021-10-08T19:23:26.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:26.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:26.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:26.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:26.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:26 smithi196 ceph-mon[34258]: from='osd.2 v2:172.21.15.157:6809/2873488643' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:23:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:26 smithi196 ceph-mon[34258]: osdmap e17: 3 total, 2 up, 3 in 2021-10-08T19:23:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:27.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[32847]: purged_snaps scrub starts 2021-10-08T19:23:27.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[32847]: purged_snaps scrub ok 2021-10-08T19:23:27.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[32847]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:27.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[32847]: poll took 5337.442 ms: 1 events 2021-10-08T19:23:27.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[32847]: osd.2 v2:172.21.15.157:6809/2873488643 boot 2021-10-08T19:23:27.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[32847]: osdmap e18: 3 total, 3 up, 3 in 2021-10-08T19:23:27.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:27.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[32847]: pgmap v86: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:27.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[42114]: purged_snaps scrub starts 2021-10-08T19:23:27.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[42114]: purged_snaps scrub ok 2021-10-08T19:23:27.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[42114]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:27.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[42114]: poll took 5337.442 ms: 1 events 2021-10-08T19:23:27.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[42114]: osd.2 v2:172.21.15.157:6809/2873488643 boot 2021-10-08T19:23:27.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[42114]: osdmap e18: 3 total, 3 up, 3 in 2021-10-08T19:23:27.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:27.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:27 smithi157 ceph-mon[42114]: pgmap v86: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:27.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:27 smithi196 ceph-mon[34258]: purged_snaps scrub starts 2021-10-08T19:23:27.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:27 smithi196 ceph-mon[34258]: purged_snaps scrub ok 2021-10-08T19:23:27.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:27 smithi196 ceph-mon[34258]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:27.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:27 smithi196 ceph-mon[34258]: poll took 5337.442 ms: 1 events 2021-10-08T19:23:27.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:27 smithi196 ceph-mon[34258]: osd.2 v2:172.21.15.157:6809/2873488643 boot 2021-10-08T19:23:27.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:27 smithi196 ceph-mon[34258]: osdmap e18: 3 total, 3 up, 3 in 2021-10-08T19:23:27.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:23:27.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:27 smithi196 ceph-mon[34258]: pgmap v86: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:23:28.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[32847]: osdmap e19: 3 total, 3 up, 3 in 2021-10-08T19:23:28.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-10-08T19:23:28.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4224288023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8da5733-a379-4817-a7ec-f46eafc1120f"}]: dispatch 2021-10-08T19:23:28.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8da5733-a379-4817-a7ec-f46eafc1120f"}]: dispatch 2021-10-08T19:23:28.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]': finished 2021-10-08T19:23:28.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8da5733-a379-4817-a7ec-f46eafc1120f"}]': finished 2021-10-08T19:23:28.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[32847]: osdmap e20: 4 total, 3 up, 4 in 2021-10-08T19:23:28.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:28.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:23:28.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[42114]: osdmap e19: 3 total, 3 up, 3 in 2021-10-08T19:23:28.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-10-08T19:23:28.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4224288023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8da5733-a379-4817-a7ec-f46eafc1120f"}]: dispatch 2021-10-08T19:23:28.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8da5733-a379-4817-a7ec-f46eafc1120f"}]: dispatch 2021-10-08T19:23:28.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]': finished 2021-10-08T19:23:28.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8da5733-a379-4817-a7ec-f46eafc1120f"}]': finished 2021-10-08T19:23:28.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[42114]: osdmap e20: 4 total, 3 up, 4 in 2021-10-08T19:23:28.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:28.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:23:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:28 smithi196 ceph-mon[34258]: osdmap e19: 3 total, 3 up, 3 in 2021-10-08T19:23:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-10-08T19:23:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4224288023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8da5733-a379-4817-a7ec-f46eafc1120f"}]: dispatch 2021-10-08T19:23:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8da5733-a379-4817-a7ec-f46eafc1120f"}]: dispatch 2021-10-08T19:23:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]': finished 2021-10-08T19:23:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8da5733-a379-4817-a7ec-f46eafc1120f"}]': finished 2021-10-08T19:23:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:28 smithi196 ceph-mon[34258]: osdmap e20: 4 total, 3 up, 4 in 2021-10-08T19:23:28.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:28.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:23:29.523 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[32847]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:29.524 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/875508904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:29.524 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:23:29.524 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[32847]: osdmap e21: 4 total, 3 up, 4 in 2021-10-08T19:23:29.524 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:29.525 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[42114]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:29.525 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/875508904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:29.525 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:23:29.525 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[42114]: osdmap e21: 4 total, 3 up, 4 in 2021-10-08T19:23:29.526 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:29 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:29.526 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[57885]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:23:29.526 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[57885]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:29.526 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[57885]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:29.527 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[57885]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:29.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:29 smithi196 ceph-mon[34258]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:29.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/875508904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:29.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:29 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:23:29.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:29 smithi196 ceph-mon[34258]: osdmap e21: 4 total, 3 up, 4 in 2021-10-08T19:23:29.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:29 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:29.787 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[58073]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:23:29.788 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[58073]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:29.788 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[58073]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:29.788 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[58073]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:30.042 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[58078]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:23:30.043 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[58078]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:30.043 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[58078]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:30.043 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:29 smithi157 sudo[58078]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:30.261 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:30.260+0000 7f9c06ffd700 1 -- 172.21.15.157:0/287809708 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7f9c00080d70 con 0x7f9c100f7490 2021-10-08T19:23:30.303 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58268]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:23:30.304 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58268]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:30.304 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58268]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:30.304 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58268]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:30.304 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58463]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:23:30.305 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58463]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:30.305 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58463]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:30.305 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58463]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[32847]: osdmap e22: 4 total, 3 up, 4 in 2021-10-08T19:23:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[32847]: mgrmap e15: y(active, since 2m), standbys: x 2021-10-08T19:23:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[32847]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:30.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:30.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[42114]: osdmap e22: 4 total, 3 up, 4 in 2021-10-08T19:23:30.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:30.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[42114]: mgrmap e15: y(active, since 2m), standbys: x 2021-10-08T19:23:30.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:30 smithi157 ceph-mon[42114]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:30.581 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58468]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:23:30.581 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:30.581 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58468]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:30.581 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58468]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:30 smithi196 ceph-mon[34258]: osdmap e22: 4 total, 3 up, 4 in 2021-10-08T19:23:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:30 smithi196 ceph-mon[34258]: mgrmap e15: y(active, since 2m), standbys: x 2021-10-08T19:23:30.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:30 smithi196 ceph-mon[34258]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58495]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:23:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58495]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58495]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:30 smithi157 sudo[58495]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:31.338 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58531]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:23:31.338 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58531]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:31.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58531]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:31.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58531]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:31.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58534]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:23:31.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58534]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:31.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58534]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:31.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58534]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:31.993 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58570]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:23:31.994 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58570]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:31.994 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58570]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:31.994 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:31 smithi157 sudo[58570]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:32.085 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:31 smithi196 sudo[38213]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:23:32.085 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:31 smithi196 sudo[38213]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:32.085 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:31 smithi196 sudo[38213]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:32.085 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:31 smithi196 sudo[38213]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:32.313 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[32847]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:23:32.313 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[32847]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:23:32.314 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:32.314 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:32.314 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:32.315 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:32.315 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:32.315 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:32.315 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[42114]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:23:32.316 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[42114]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:23:32.316 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:32.316 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:32.316 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:32.316 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:32.317 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:32.317 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:32 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:32.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 sudo[38216]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:23:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 sudo[38216]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:23:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 sudo[38216]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:23:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 sudo[38216]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:23:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 ceph-mon[34258]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:23:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 ceph-mon[34258]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:23:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:32 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:23:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: poll took 5691.067 ms: 1 events 2021-10-08T19:23:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:23:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:23:33.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:33.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:33.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:33.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:23:33.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:33.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:33 smithi196 ceph-mon[34258]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 17 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:33.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:23:33.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: poll took 5691.067 ms: 1 events 2021-10-08T19:23:33.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:23:33.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:23:33.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:33.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:33.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:33.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:23:33.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:33.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[32847]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 17 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:33.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:23:33.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: poll took 5691.067 ms: 1 events 2021-10-08T19:23:33.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:23:33.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:23:33.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:33.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:33.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:33.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:23:33.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:33.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:33 smithi157 ceph-mon[42114]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 17 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:34.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[42114]: poll took 2410.946 ms: 1 events 2021-10-08T19:23:34.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-10-08T19:23:34.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:34.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[42114]: Deploying daemon osd.3 on smithi157 2021-10-08T19:23:34.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[42114]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:34.842 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[32847]: poll took 2410.946 ms: 1 events 2021-10-08T19:23:34.843 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-10-08T19:23:34.843 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:34.844 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[32847]: Deploying daemon osd.3 on smithi157 2021-10-08T19:23:34.844 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:34 smithi157 ceph-mon[32847]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:34 smithi196 ceph-mon[34258]: poll took 2410.946 ms: 1 events 2021-10-08T19:23:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-10-08T19:23:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:34 smithi196 ceph-mon[34258]: Deploying daemon osd.3 on smithi157 2021-10-08T19:23:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:34 smithi196 ceph-mon[34258]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:36.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:36 smithi196 ceph-mon[34258]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:36.693 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:36 smithi157 ceph-mon[32847]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:36.693 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:36 smithi157 ceph-mon[42114]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:38.198 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 3 on host 'smithi157' 2021-10-08T19:23:38.199 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.195+0000 7f9c06ffd700 1 -- 172.21.15.157:0/287809708 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9c10102520 con 0x7f9bfc063460 2021-10-08T19:23:38.200 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9bfc063460 msgr2=0x7f9bfc065910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:38.200 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 --2- 172.21.15.157:0/287809708 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9bfc063460 0x7f9bfc065910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005010 tx=0x7f9bf8009b30 comp rx=0 tx=0).stop 2021-10-08T19:23:38.200 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f7490 msgr2=0x7f9c101088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:38.200 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 --2- 172.21.15.157:0/287809708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f7490 0x7f9c101088d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c00001cb0 tx=0x7f9c00004c50 comp rx=0 tx=0).stop 2021-10-08T19:23:38.201 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 shutdown_connections 2021-10-08T19:23:38.201 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 --2- 172.21.15.157:0/287809708 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9bfc063460 0x7f9bfc065910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:38.201 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 --2- 172.21.15.157:0/287809708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c100f90c0 0x7f9c1010fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:38.201 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 --2- 172.21.15.157:0/287809708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c100f7490 0x7f9c101088d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:38.201 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 --2- 172.21.15.157:0/287809708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c100f8730 0x7f9c10108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:38.202 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 >> 172.21.15.157:0/287809708 conn(0x7f9c100f2c80 msgr2=0x7f9c100f4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:38.202 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 shutdown_connections 2021-10-08T19:23:38.202 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:23:38.198+0000 7f9c148ed700 1 -- 172.21.15.157:0/287809708 wait complete. 2021-10-08T19:23:38.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:38.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:38.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:38.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:38.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:38.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:38.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:38.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:38.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:38.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:38.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:38.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:38.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:38.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:38.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:38.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:38.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:38.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:38.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:38.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:38.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:39.333 DEBUG:teuthology.orchestra.run.smithi157:osd.3> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.3.service 2021-10-08T19:23:39.336 INFO:tasks.cephadm:Deploying osd.4 on smithi196 with /dev/vg_nvme/lv_4... 2021-10-08T19:23:39.336 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-10-08T19:23:39.365 INFO:journalctl@ceph.osd.3.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:23:39.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:39 smithi157 ceph-mon[32847]: poll took 3598.340 ms: 1 events 2021-10-08T19:23:39.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:39 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi157 to 3781M 2021-10-08T19:23:39.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:39 smithi157 ceph-mon[32847]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:39.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:39 smithi157 ceph-mon[42114]: poll took 3598.340 ms: 1 events 2021-10-08T19:23:39.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:39 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi157 to 3781M 2021-10-08T19:23:39.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:39 smithi157 ceph-mon[42114]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:39.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:39 smithi196 ceph-mon[34258]: poll took 3598.340 ms: 1 events 2021-10-08T19:23:39.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:39 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi157 to 3781M 2021-10-08T19:23:39.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:39 smithi196 ceph-mon[34258]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:40.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:40 smithi196 ceph-mon[34258]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:40.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:40 smithi157 ceph-mon[32847]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:40.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:40 smithi157 ceph-mon[42114]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:41.535 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-10-08T19:23:41.535 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-10-08T19:23:41.535 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2021-10-08T19:23:41.535 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2021-10-08T19:23:41.536 INFO:teuthology.orchestra.run.smithi196.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108441 s, 967 MB/s 2021-10-08T19:23:41.536 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2021-10-08T19:23:41.797 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:41 smithi157 ceph-mon[32847]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:23:41.798 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:41 smithi157 ceph-mon[42114]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:23:41.798 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:23:41 smithi157 conmon[59794]: 2021-10-08T19:23:41.390+0000 7f3cb0d410c0 -1 osd.3 0 log_to_monitors {default=true} 2021-10-08T19:23:41.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:41 smithi196 ceph-mon[34258]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:23:42.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:23:41 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:23:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:42.262 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi196:vg_nvme/lv_4 2021-10-08T19:23:42.526 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:42 smithi196 ceph-mon[34258]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-10-08T19:23:42.527 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:42 smithi196 ceph-mon[34258]: osdmap e23: 4 total, 3 up, 4 in 2021-10-08T19:23:42.527 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:42 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:42.527 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:42 smithi196 ceph-mon[34258]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:23:42.528 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:42 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:42.528 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:42 smithi196 ceph-mon[34258]: Detected new or changed devices on smithi157 2021-10-08T19:23:42.528 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:42 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:23:42.528 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:42 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:23:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:42.529 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:42 smithi196 ceph-mon[34258]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:42.828 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:23:42 smithi157 conmon[59794]: 2021-10-08T19:23:42.454+0000 7f3ca74e9700 -1 osd.3 0 waiting for initial osdmap 2021-10-08T19:23:42.829 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:23:42 smithi157 conmon[59794]: 2021-10-08T19:23:42.458+0000 7f3ca1e80700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:23:42.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[42114]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-10-08T19:23:42.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[42114]: osdmap e23: 4 total, 3 up, 4 in 2021-10-08T19:23:42.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:42.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[42114]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:23:42.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:42.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[42114]: Detected new or changed devices on smithi157 2021-10-08T19:23:42.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:23:42.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:23:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:42.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[42114]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:42.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[32847]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-10-08T19:23:42.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[32847]: osdmap e23: 4 total, 3 up, 4 in 2021-10-08T19:23:42.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:42.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[32847]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2021-10-08T19:23:42.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:42.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[32847]: Detected new or changed devices on smithi157 2021-10-08T19:23:42.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:23:42.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:23:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:42.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:42 smithi157 ceph-mon[32847]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:43.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:43 smithi157 ceph-mon[32847]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:23:43.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:43 smithi157 ceph-mon[32847]: osdmap e24: 4 total, 3 up, 4 in 2021-10-08T19:23:43.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:43 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:43.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:43 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:43.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:43 smithi157 ceph-mon[42114]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:23:43.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:43 smithi157 ceph-mon[42114]: osdmap e24: 4 total, 3 up, 4 in 2021-10-08T19:23:43.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:43 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:43.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:43 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:43.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:43 smithi196 ceph-mon[34258]: from='osd.3 v2:172.21.15.157:6813/2430876343' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2021-10-08T19:23:43.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:43 smithi196 ceph-mon[34258]: osdmap e24: 4 total, 3 up, 4 in 2021-10-08T19:23:43.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:43 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:43.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:43 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.767+0000 7fd127b09700 1 -- 172.21.15.196:0/141519493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 msgr2=0x7fd1201006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.767+0000 7fd127b09700 1 --2- 172.21.15.196:0/141519493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 0x7fd1201006a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd118009a60 tx=0x7fd118004d10 comp rx=0 tx=0).stop 2021-10-08T19:23:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.767+0000 7fd127b09700 1 -- 172.21.15.196:0/141519493 shutdown_connections 2021-10-08T19:23:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.767+0000 7fd127b09700 1 --2- 172.21.15.196:0/141519493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 0x7fd1201006a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.767+0000 7fd127b09700 1 --2- 172.21.15.196:0/141519493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1200626a0 0x7fd1200fb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.767+0000 7fd127b09700 1 --2- 172.21.15.196:0/141519493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1200fb7a0 0x7fd1200fdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:44.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.767+0000 7fd127b09700 1 -- 172.21.15.196:0/141519493 >> 172.21.15.196:0/141519493 conn(0x7fd1200f2c90 msgr2=0x7fd1200f50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:44.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.767+0000 7fd127b09700 1 -- 172.21.15.196:0/141519493 shutdown_connections 2021-10-08T19:23:44.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.767+0000 7fd127b09700 1 -- 172.21.15.196:0/141519493 wait complete. 2021-10-08T19:23:44.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd127b09700 1 Processor -- start 2021-10-08T19:23:44.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd127b09700 1 -- start start 2021-10-08T19:23:44.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd127b09700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1200626a0 0x7fd1200f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:44.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd127b09700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1200fb7a0 0x7fd1200f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:44.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd127b09700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 0x7fd1200f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:44.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd127b09700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200f7db0 con 0x7fd1200fb7a0 2021-10-08T19:23:44.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd127b09700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200f7f20 con 0x7fd1200fe240 2021-10-08T19:23:44.774 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd127b09700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd120112720 con 0x7fd1200626a0 2021-10-08T19:23:44.774 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1260a6700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 0x7fd1200f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:44.774 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1260a6700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 0x7fd1200f76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:48884/0 (socket says 172.21.15.196:48884) 2021-10-08T19:23:44.774 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1260a6700 1 -- 172.21.15.196:0/2753661509 learned_addr learned my addr 172.21.15.196:0/2753661509 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:23:44.775 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1258a5700 1 --2- 172.21.15.196:0/2753661509 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1200626a0 0x7fd1200f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:44.775 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1250a4700 1 --2- 172.21.15.196:0/2753661509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1200fb7a0 0x7fd1200f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:44.775 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1260a6700 1 -- 172.21.15.196:0/2753661509 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1200626a0 msgr2=0x7fd1200f8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:44.775 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1260a6700 1 --2- 172.21.15.196:0/2753661509 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1200626a0 0x7fd1200f8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:44.775 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1260a6700 1 -- 172.21.15.196:0/2753661509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1200fb7a0 msgr2=0x7fd1200f7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:44.776 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1260a6700 1 --2- 172.21.15.196:0/2753661509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1200fb7a0 0x7fd1200f7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:44.776 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.768+0000 7fd1260a6700 1 -- 172.21.15.196:0/2753661509 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd118009640 con 0x7fd1200fe240 2021-10-08T19:23:44.776 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.769+0000 7fd1260a6700 1 --2- 172.21.15.196:0/2753661509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 0x7fd1200f76a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd118009040 tx=0x7fd118004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:44.776 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.769+0000 7fd1167fc700 1 -- 172.21.15.196:0/2753661509 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800e070 con 0x7fd1200fe240 2021-10-08T19:23:44.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.769+0000 7fd1167fc700 1 -- 172.21.15.196:0/2753661509 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fd118009450 con 0x7fd1200fe240 2021-10-08T19:23:44.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.769+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1201128c0 con 0x7fd1200fe240 2021-10-08T19:23:44.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.769+0000 7fd1167fc700 1 -- 172.21.15.196:0/2753661509 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118012410 con 0x7fd1200fe240 2021-10-08T19:23:44.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.769+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd120112d20 con 0x7fd1200fe240 2021-10-08T19:23:44.778 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.770+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1200289c0 con 0x7fd1200fe240 2021-10-08T19:23:44.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.771+0000 7fd1167fc700 1 -- 172.21.15.196:0/2753661509 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7fd11801c440 con 0x7fd1200fe240 2021-10-08T19:23:44.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.771+0000 7fd1167fc700 1 --2- 172.21.15.196:0/2753661509 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd10c0634c0 0x7fd10c065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:44.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.771+0000 7fd1167fc700 1 -- 172.21.15.196:0/2753661509 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 2783+0+0 (secure 0 0 0) 0x7fd118080d10 con 0x7fd1200fe240 2021-10-08T19:23:44.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.771+0000 7fd1258a5700 1 --2- 172.21.15.196:0/2753661509 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd10c0634c0 0x7fd10c065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:44.780 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.772+0000 7fd1258a5700 1 --2- 172.21.15.196:0/2753661509 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd10c0634c0 0x7fd10c065970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd120062470 tx=0x7fd11c009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:44.780 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.775+0000 7fd1167fc700 1 -- 172.21.15.196:0/2753661509 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fd118054600 con 0x7fd1200fe240 2021-10-08T19:23:44.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[42114]: purged_snaps scrub starts 2021-10-08T19:23:44.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[42114]: purged_snaps scrub ok 2021-10-08T19:23:44.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[42114]: osd.3 v2:172.21.15.157:6813/2430876343 boot 2021-10-08T19:23:44.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[42114]: osdmap e25: 4 total, 4 up, 4 in 2021-10-08T19:23:44.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:44.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[42114]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[32847]: purged_snaps scrub starts 2021-10-08T19:23:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[32847]: purged_snaps scrub ok 2021-10-08T19:23:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[32847]: osd.3 v2:172.21.15.157:6813/2430876343 boot 2021-10-08T19:23:44.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[32847]: osdmap e25: 4 total, 4 up, 4 in 2021-10-08T19:23:44.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:44.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:44 smithi157 ceph-mon[32847]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:44 smithi196 ceph-mon[34258]: purged_snaps scrub starts 2021-10-08T19:23:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:44 smithi196 ceph-mon[34258]: purged_snaps scrub ok 2021-10-08T19:23:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:44 smithi196 ceph-mon[34258]: osd.3 v2:172.21.15.157:6813/2430876343 boot 2021-10-08T19:23:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:44 smithi196 ceph-mon[34258]: osdmap e25: 4 total, 4 up, 4 in 2021-10-08T19:23:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:44 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:23:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:44 smithi196 ceph-mon[34258]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:23:44.971 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:44.970+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd120059800 con 0x7fd10c0634c0 2021-10-08T19:23:45.739 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:45 smithi196 ceph-mon[34258]: osdmap e26: 4 total, 4 up, 4 in 2021-10-08T19:23:45.740 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:45 smithi196 ceph-mon[34258]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:45.740 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:45 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:45.740 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:45 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:45.740 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:45 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:45.741 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:45 smithi196 ceph-mon[34258]: poll took 6791.153 ms: 1 events 2021-10-08T19:23:45.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:23:45 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:23:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:45.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[32847]: osdmap e26: 4 total, 4 up, 4 in 2021-10-08T19:23:45.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[32847]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:45.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:45.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:45.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:45.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[32847]: poll took 6791.153 ms: 1 events 2021-10-08T19:23:45.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[42114]: osdmap e26: 4 total, 4 up, 4 in 2021-10-08T19:23:45.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[42114]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:45.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:45.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:45.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:45.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:45 smithi157 ceph-mon[42114]: poll took 6791.153 ms: 1 events 2021-10-08T19:23:46.931 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:46 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:46.932 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:46 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:23:46.932 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:46 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:23:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:46.932 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:46 smithi196 ceph-mon[34258]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:46 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:46 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:23:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:46 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:23:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:46 smithi157 ceph-mon[32847]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:46 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:46 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:23:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:46 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:23:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:46 smithi157 ceph-mon[42114]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:48.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/84891109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f55088-575c-4785-9c03-b24432151873"}]: dispatch 2021-10-08T19:23:48.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f55088-575c-4785-9c03-b24432151873"}]: dispatch 2021-10-08T19:23:48.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88f55088-575c-4785-9c03-b24432151873"}]': finished 2021-10-08T19:23:48.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[32847]: osdmap e27: 5 total, 4 up, 5 in 2021-10-08T19:23:48.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:23:48.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/84891109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f55088-575c-4785-9c03-b24432151873"}]: dispatch 2021-10-08T19:23:48.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f55088-575c-4785-9c03-b24432151873"}]: dispatch 2021-10-08T19:23:48.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88f55088-575c-4785-9c03-b24432151873"}]': finished 2021-10-08T19:23:48.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[42114]: osdmap e27: 5 total, 4 up, 5 in 2021-10-08T19:23:48.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:47 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:23:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/84891109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f55088-575c-4785-9c03-b24432151873"}]: dispatch 2021-10-08T19:23:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f55088-575c-4785-9c03-b24432151873"}]: dispatch 2021-10-08T19:23:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88f55088-575c-4785-9c03-b24432151873"}]': finished 2021-10-08T19:23:48.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:47 smithi196 ceph-mon[34258]: osdmap e27: 5 total, 4 up, 5 in 2021-10-08T19:23:48.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:47 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:23:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/1534605147' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:48 smithi157 ceph-mon[32847]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:49.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/1534605147' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:49.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:48 smithi157 ceph-mon[42114]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:49.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/1534605147' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:48 smithi196 ceph-mon[34258]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:50.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:50.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:50.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:49 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:50.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:49 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:50.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:49 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:50.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:49 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:51.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:50 smithi157 ceph-mon[32847]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:51.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:50 smithi157 ceph-mon[42114]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:51.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:50 smithi196 ceph-mon[34258]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:51.993 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:51 smithi196 ceph-mon[34258]: poll took 5601.102 ms: 1 events 2021-10-08T19:23:52.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:51 smithi157 ceph-mon[32847]: poll took 5601.102 ms: 1 events 2021-10-08T19:23:52.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:51 smithi157 ceph-mon[42114]: poll took 5601.102 ms: 1 events 2021-10-08T19:23:53.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:52 smithi157 ceph-mon[32847]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:53.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:52 smithi157 ceph-mon[42114]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:53.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:52 smithi196 ceph-mon[34258]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:54.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:54 smithi196 ceph-mon[34258]: poll took 2292.341 ms: 1 events 2021-10-08T19:23:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:54 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-10-08T19:23:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:54 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:54 smithi196 ceph-mon[34258]: Deploying daemon osd.4 on smithi196 2021-10-08T19:23:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:54 smithi196 ceph-mon[34258]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[32847]: poll took 2292.341 ms: 1 events 2021-10-08T19:23:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-10-08T19:23:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[32847]: Deploying daemon osd.4 on smithi196 2021-10-08T19:23:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[32847]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:55.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[42114]: poll took 2292.341 ms: 1 events 2021-10-08T19:23:55.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-10-08T19:23:55.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:55.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[42114]: Deploying daemon osd.4 on smithi196 2021-10-08T19:23:55.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:54 smithi157 ceph-mon[42114]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:56.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:56 smithi196 ceph-mon[34258]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:56.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:56 smithi157 ceph-mon[32847]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:56.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:56 smithi157 ceph-mon[42114]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:57.407 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 4 on host 'smithi196' 2021-10-08T19:23:57.408 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.405+0000 7fd1167fc700 1 -- 172.21.15.196:0/2753661509 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd120059800 con 0x7fd10c0634c0 2021-10-08T19:23:57.408 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd10c0634c0 msgr2=0x7fd10c065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:57.409 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 --2- 172.21.15.196:0/2753661509 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd10c0634c0 0x7fd10c065970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd120062470 tx=0x7fd11c009040 comp rx=0 tx=0).stop 2021-10-08T19:23:57.409 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 msgr2=0x7fd1200f76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:57.409 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 --2- 172.21.15.196:0/2753661509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 0x7fd1200f76a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd118009040 tx=0x7fd118004d10 comp rx=0 tx=0).stop 2021-10-08T19:23:57.409 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 shutdown_connections 2021-10-08T19:23:57.409 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 --2- 172.21.15.196:0/2753661509 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd10c0634c0 0x7fd10c065970 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 --2- 172.21.15.196:0/2753661509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1200fe240 0x7fd1200f76a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 --2- 172.21.15.196:0/2753661509 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1200626a0 0x7fd1200f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 --2- 172.21.15.196:0/2753661509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1200fb7a0 0x7fd1200f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.407+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 >> 172.21.15.196:0/2753661509 conn(0x7fd1200f2c90 msgr2=0x7fd1200f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:57.411 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.408+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 shutdown_connections 2021-10-08T19:23:57.411 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:23:57.408+0000 7fd127b09700 1 -- 172.21.15.196:0/2753661509 wait complete. 2021-10-08T19:23:57.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:57.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:57.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:57.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:57.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:57.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:57.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:57.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:57 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:57.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:57.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:57.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:57.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:57.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:57.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:57.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:57.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:57.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:57.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:57.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:57.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:57.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:57.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:57 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:23:58.008 DEBUG:teuthology.orchestra.run.smithi196:osd.4> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.4.service 2021-10-08T19:23:58.011 INFO:tasks.cephadm:Deploying osd.5 on smithi196 with /dev/vg_nvme/lv_3... 2021-10-08T19:23:58.012 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-10-08T19:23:58.038 INFO:journalctl@ceph.osd.4.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:23:58.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:58 smithi157 ceph-mon[32847]: poll took 3310.661 ms: 1 events 2021-10-08T19:23:58.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:58 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi196 to 16148M 2021-10-08T19:23:58.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:23:58 smithi157 ceph-mon[32847]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:58.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:58 smithi157 ceph-mon[42114]: poll took 3310.661 ms: 1 events 2021-10-08T19:23:58.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:58 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi196 to 16148M 2021-10-08T19:23:58.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:23:58 smithi157 ceph-mon[42114]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:23:58.838 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:58 smithi196 ceph-mon[34258]: poll took 3310.661 ms: 1 events 2021-10-08T19:23:58.838 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:58 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi196 to 16148M 2021-10-08T19:23:58.839 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:23:58 smithi196 ceph-mon[34258]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:00.073 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-10-08T19:24:00.073 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-10-08T19:24:00.074 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2021-10-08T19:24:00.074 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2021-10-08T19:24:00.074 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0121107 s, 866 MB/s 2021-10-08T19:24:00.074 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2021-10-08T19:24:00.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:00 smithi196 ceph-mon[34258]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:00.619 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:24:00 smithi196 conmon[41793]: 2021-10-08T19:24:00.597+0000 7fed5fbb10c0 -1 osd.4 0 log_to_monitors {default=true} 2021-10-08T19:24:00.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi196:vg_nvme/lv_3 2021-10-08T19:24:00.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:00 smithi157 ceph-mon[32847]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:00.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:00 smithi157 ceph-mon[42114]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:01.481 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:01 smithi196 ceph-mon[34258]: from='osd.4 v2:172.21.15.196:6800/2530339252' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:01.481 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:01 smithi196 ceph-mon[34258]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:01.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:01 smithi157 ceph-mon[32847]: from='osd.4 v2:172.21.15.196:6800/2530339252' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:01 smithi157 ceph-mon[32847]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:01.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:01 smithi157 ceph-mon[42114]: from='osd.4 v2:172.21.15.196:6800/2530339252' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:01.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:01 smithi157 ceph-mon[42114]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:02.522 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.519+0000 7fa03741d700 1 -- 172.21.15.196:0/3233634571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f89a0 msgr2=0x7fa0300f8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.519+0000 7fa03741d700 1 --2- 172.21.15.196:0/3233634571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f89a0 0x7fa0300f8db0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0046e0 tx=0x7fa02c009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.519+0000 7fa03741d700 1 -- 172.21.15.196:0/3233634571 shutdown_connections 2021-10-08T19:24:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.519+0000 7fa03741d700 1 --2- 172.21.15.196:0/3233634571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300f8050 0x7fa0300ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.519+0000 7fa03741d700 1 --2- 172.21.15.196:0/3233634571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f89a0 0x7fa0300f8db0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.519+0000 7fa03741d700 1 --2- 172.21.15.196:0/3233634571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300f76a0 0x7fa0300f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.519+0000 7fa03741d700 1 -- 172.21.15.196:0/3233634571 >> 172.21.15.196:0/3233634571 conn(0x7fa0300f22a0 msgr2=0x7fa0300f46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.519+0000 7fa03741d700 1 -- 172.21.15.196:0/3233634571 shutdown_connections 2021-10-08T19:24:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03741d700 1 -- 172.21.15.196:0/3233634571 wait complete. 2021-10-08T19:24:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03741d700 1 Processor -- start 2021-10-08T19:24:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03741d700 1 -- start start 2021-10-08T19:24:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03741d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f76a0 0x7fa03010b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03741d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300f8050 0x7fa03010dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03741d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300f89a0 0x7fa0301101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03741d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301106f0 con 0x7fa0300f8050 2021-10-08T19:24:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03741d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030110830 con 0x7fa0300f76a0 2021-10-08T19:24:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03741d700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301109a0 con 0x7fa0300f89a0 2021-10-08T19:24:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03641b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f76a0 0x7fa03010b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa035c1a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300f8050 0x7fa03010dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03641b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f76a0 0x7fa03010b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:48938/0 (socket says 172.21.15.196:48938) 2021-10-08T19:24:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa03641b700 1 -- 172.21.15.196:0/1748457958 learned_addr learned my addr 172.21.15.196:0/1748457958 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:24:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.520+0000 7fa036c1c700 1 --2- 172.21.15.196:0/1748457958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300f89a0 0x7fa0301101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa03641b700 1 -- 172.21.15.196:0/1748457958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300f89a0 msgr2=0x7fa0301101b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa03641b700 1 --2- 172.21.15.196:0/1748457958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300f89a0 0x7fa0301101b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:02.528 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa03641b700 1 -- 172.21.15.196:0/1748457958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300f8050 msgr2=0x7fa03010dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:02.528 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa03641b700 1 --2- 172.21.15.196:0/1748457958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300f8050 0x7fa03010dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:02.528 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa03641b700 1 -- 172.21.15.196:0/1748457958 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c005040 con 0x7fa0300f76a0 2021-10-08T19:24:02.528 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa03641b700 1 --2- 172.21.15.196:0/1748457958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f76a0 0x7fa03010b710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009da0 tx=0x7fa02c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:02.529 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa026ffd700 1 -- 172.21.15.196:0/1748457958 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c00e040 con 0x7fa0300f76a0 2021-10-08T19:24:02.529 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa026ffd700 1 -- 172.21.15.196:0/1748457958 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fa02c007da0 con 0x7fa0300f76a0 2021-10-08T19:24:02.529 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa030110c20 con 0x7fa0300f76a0 2021-10-08T19:24:02.529 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa026ffd700 1 -- 172.21.15.196:0/1748457958 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c01ca70 con 0x7fa0300f76a0 2021-10-08T19:24:02.529 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.521+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa030111020 con 0x7fa0300f76a0 2021-10-08T19:24:02.530 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.522+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0300472f0 con 0x7fa0300f76a0 2021-10-08T19:24:02.531 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.523+0000 7fa026ffd700 1 -- 172.21.15.196:0/1748457958 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7fa02c007920 con 0x7fa0300f76a0 2021-10-08T19:24:02.531 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.523+0000 7fa026ffd700 1 --2- 172.21.15.196:0/1748457958 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa01c063400 0x7fa01c0658b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:02.531 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.523+0000 7fa026ffd700 1 -- 172.21.15.196:0/1748457958 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3045+0+0 (secure 0 0 0) 0x7fa02c0807c0 con 0x7fa0300f76a0 2021-10-08T19:24:02.531 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.523+0000 7fa035c1a700 1 --2- 172.21.15.196:0/1748457958 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa01c063400 0x7fa01c0658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:02.532 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.524+0000 7fa035c1a700 1 --2- 172.21.15.196:0/1748457958 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa01c063400 0x7fa01c0658b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa0300f8770 tx=0x7fa02000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:02.532 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.527+0000 7fa026ffd700 1 -- 172.21.15.196:0/1748457958 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fa02c054130 con 0x7fa0300f76a0 2021-10-08T19:24:02.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[32847]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-10-08T19:24:02.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[32847]: osdmap e28: 5 total, 4 up, 5 in 2021-10-08T19:24:02.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[32847]: from='osd.4 v2:172.21.15.196:6800/2530339252' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:02.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[32847]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:02.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:02.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[32847]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[42114]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-10-08T19:24:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[42114]: osdmap e28: 5 total, 4 up, 5 in 2021-10-08T19:24:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[42114]: from='osd.4 v2:172.21.15.196:6800/2530339252' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:02.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[42114]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:02.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:02.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:02 smithi157 ceph-mon[42114]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:02.618 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:24:02 smithi196 conmon[41793]: 2021-10-08T19:24:02.378+0000 7fed56359700 -1 osd.4 0 waiting for initial osdmap 2021-10-08T19:24:02.618 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:24:02 smithi196 conmon[41793]: 2021-10-08T19:24:02.382+0000 7fed4ecec700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:24:02.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:02 smithi196 ceph-mon[34258]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-10-08T19:24:02.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:02 smithi196 ceph-mon[34258]: osdmap e28: 5 total, 4 up, 5 in 2021-10-08T19:24:02.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:02 smithi196 ceph-mon[34258]: from='osd.4 v2:172.21.15.196:6800/2530339252' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:02.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:02 smithi196 ceph-mon[34258]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:02.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:02 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:02.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:02 smithi196 ceph-mon[34258]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:02.692 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:02.692+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa030059800 con 0x7fa01c063400 2021-10-08T19:24:03.577 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:03.577 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: osdmap e29: 5 total, 4 up, 5 in 2021-10-08T19:24:03.577 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:03.578 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:03.578 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:03.578 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:03.578 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:03.579 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:03.579 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: poll took 5303.577 ms: 1 events 2021-10-08T19:24:03.579 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: osd.4 v2:172.21.15.196:6800/2530339252 boot 2021-10-08T19:24:03.579 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:03 smithi196 ceph-mon[34258]: osdmap e30: 5 total, 5 up, 5 in 2021-10-08T19:24:03.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:03.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: osdmap e29: 5 total, 4 up, 5 in 2021-10-08T19:24:03.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:03.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:03.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:03.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:03.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:03.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:03.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: poll took 5303.577 ms: 1 events 2021-10-08T19:24:03.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: osd.4 v2:172.21.15.196:6800/2530339252 boot 2021-10-08T19:24:03.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[32847]: osdmap e30: 5 total, 5 up, 5 in 2021-10-08T19:24:03.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:03.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: osdmap e29: 5 total, 4 up, 5 in 2021-10-08T19:24:03.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:03.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:03.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:03.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:03.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:03.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:03.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: poll took 5303.577 ms: 1 events 2021-10-08T19:24:03.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: osd.4 v2:172.21.15.196:6800/2530339252 boot 2021-10-08T19:24:03.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:03 smithi157 ceph-mon[42114]: osdmap e30: 5 total, 5 up, 5 in 2021-10-08T19:24:04.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[32847]: purged_snaps scrub starts 2021-10-08T19:24:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[32847]: purged_snaps scrub ok 2021-10-08T19:24:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[32847]: osdmap e31: 5 total, 5 up, 5 in 2021-10-08T19:24:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[32847]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:04.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[42114]: purged_snaps scrub starts 2021-10-08T19:24:04.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[42114]: purged_snaps scrub ok 2021-10-08T19:24:04.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:04.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[42114]: osdmap e31: 5 total, 5 up, 5 in 2021-10-08T19:24:04.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:04 smithi157 ceph-mon[42114]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:04.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:04 smithi196 ceph-mon[34258]: purged_snaps scrub starts 2021-10-08T19:24:04.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:04 smithi196 ceph-mon[34258]: purged_snaps scrub ok 2021-10-08T19:24:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:04 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:04 smithi196 ceph-mon[34258]: osdmap e31: 5 total, 5 up, 5 in 2021-10-08T19:24:04.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:04 smithi196 ceph-mon[34258]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:05 smithi196 ceph-mon[34258]: osdmap e32: 5 total, 5 up, 5 in 2021-10-08T19:24:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/3593945953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6"}]: dispatch 2021-10-08T19:24:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6"}]: dispatch 2021-10-08T19:24:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6"}]': finished 2021-10-08T19:24:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:05 smithi196 ceph-mon[34258]: osdmap e33: 6 total, 5 up, 6 in 2021-10-08T19:24:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:05 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:06.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:24:05 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:24:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:06.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[42114]: osdmap e32: 5 total, 5 up, 5 in 2021-10-08T19:24:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/3593945953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6"}]: dispatch 2021-10-08T19:24:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6"}]: dispatch 2021-10-08T19:24:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6"}]': finished 2021-10-08T19:24:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[42114]: osdmap e33: 6 total, 5 up, 6 in 2021-10-08T19:24:06.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[32847]: osdmap e32: 5 total, 5 up, 5 in 2021-10-08T19:24:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/3593945953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6"}]: dispatch 2021-10-08T19:24:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6"}]: dispatch 2021-10-08T19:24:06.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6"}]': finished 2021-10-08T19:24:06.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[32847]: osdmap e33: 6 total, 5 up, 6 in 2021-10-08T19:24:06.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:05 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:06.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/1529523035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:06 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:06 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:24:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:06 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:24:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:06 smithi196 ceph-mon[34258]: osdmap e34: 6 total, 5 up, 6 in 2021-10-08T19:24:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:06 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:06 smithi196 ceph-mon[34258]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/1529523035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:24:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:24:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[32847]: osdmap e34: 6 total, 5 up, 6 in 2021-10-08T19:24:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[32847]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:07.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/1529523035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:07.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:07.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:24:07.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:24:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:07.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[42114]: osdmap e34: 6 total, 5 up, 6 in 2021-10-08T19:24:07.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:07.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:06 smithi157 ceph-mon[42114]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:08.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:08 smithi196 ceph-mon[34258]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:08.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:08 smithi157 ceph-mon[32847]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:08.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:08 smithi157 ceph-mon[42114]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:09.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:09 smithi196 ceph-mon[34258]: poll took 5462.466 ms: 1 events 2021-10-08T19:24:10.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:09 smithi157 ceph-mon[32847]: poll took 5462.466 ms: 1 events 2021-10-08T19:24:10.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:09 smithi157 ceph-mon[42114]: poll took 5462.466 ms: 1 events 2021-10-08T19:24:10.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:10 smithi196 ceph-mon[34258]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2021-10-08T19:24:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:10 smithi157 ceph-mon[32847]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2021-10-08T19:24:11.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:10 smithi157 ceph-mon[42114]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2021-10-08T19:24:12.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:12 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-10-08T19:24:12.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:12 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:12.579 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:24:12 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:24:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:12.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:12 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-10-08T19:24:12.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:12 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:12.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:12 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-10-08T19:24:12.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:12 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:13.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:13 smithi157 ceph-mon[32847]: poll took 3308.080 ms: 1 events 2021-10-08T19:24:13.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:13 smithi157 ceph-mon[32847]: Deploying daemon osd.5 on smithi196 2021-10-08T19:24:13.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:13 smithi157 ceph-mon[32847]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 75 KiB/s, 0 objects/s recovering 2021-10-08T19:24:13.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:13 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:13.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:13 smithi157 ceph-mon[42114]: poll took 3308.080 ms: 1 events 2021-10-08T19:24:13.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:13 smithi157 ceph-mon[42114]: Deploying daemon osd.5 on smithi196 2021-10-08T19:24:13.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:13 smithi157 ceph-mon[42114]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 75 KiB/s, 0 objects/s recovering 2021-10-08T19:24:13.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:13 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:13.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:13 smithi196 ceph-mon[34258]: poll took 3308.080 ms: 1 events 2021-10-08T19:24:13.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:13 smithi196 ceph-mon[34258]: Deploying daemon osd.5 on smithi196 2021-10-08T19:24:13.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:13 smithi196 ceph-mon[34258]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 75 KiB/s, 0 objects/s recovering 2021-10-08T19:24:13.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:13 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:14.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:14 smithi157 ceph-mon[32847]: Detected new or changed devices on smithi196 2021-10-08T19:24:14.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:14 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:24:14.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:14 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:24:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:14.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:14 smithi157 ceph-mon[42114]: Detected new or changed devices on smithi196 2021-10-08T19:24:14.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:14 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:24:14.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:14 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:24:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:14.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:14 smithi196 ceph-mon[34258]: Detected new or changed devices on smithi196 2021-10-08T19:24:14.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:14 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:24:14.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:14 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:24:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:15.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:15 smithi157 ceph-mon[32847]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 63 KiB/s, 0 objects/s recovering 2021-10-08T19:24:15.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:15 smithi157 ceph-mon[42114]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 63 KiB/s, 0 objects/s recovering 2021-10-08T19:24:15.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:15 smithi196 ceph-mon[34258]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 63 KiB/s, 0 objects/s recovering 2021-10-08T19:24:16.128 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 5 on host 'smithi196' 2021-10-08T19:24:16.129 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.127+0000 7fa026ffd700 1 -- 172.21.15.196:0/1748457958 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa030059800 con 0x7fa01c063400 2021-10-08T19:24:16.130 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.129+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa01c063400 msgr2=0x7fa01c0658b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:16.130 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.129+0000 7fa03741d700 1 --2- 172.21.15.196:0/1748457958 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa01c063400 0x7fa01c0658b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa0300f8770 tx=0x7fa02000b040 comp rx=0 tx=0).stop 2021-10-08T19:24:16.130 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f76a0 msgr2=0x7fa03010b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:16.130 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 --2- 172.21.15.196:0/1748457958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f76a0 0x7fa03010b710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009da0 tx=0x7fa02c009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:16.131 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 shutdown_connections 2021-10-08T19:24:16.131 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 --2- 172.21.15.196:0/1748457958 >> v2:172.21.15.157:6800/3606206634 conn(0x7fa01c063400 0x7fa01c0658b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:16.131 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 --2- 172.21.15.196:0/1748457958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300f89a0 0x7fa0301101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:16.131 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 --2- 172.21.15.196:0/1748457958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0300f76a0 0x7fa03010b710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 --2- 172.21.15.196:0/1748457958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300f8050 0x7fa03010dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 >> 172.21.15.196:0/1748457958 conn(0x7fa0300f22a0 msgr2=0x7fa0300f46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 shutdown_connections 2021-10-08T19:24:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:16.130+0000 7fa03741d700 1 -- 172.21.15.196:0/1748457958 wait complete. 2021-10-08T19:24:16.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:16 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:16 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:16.746 DEBUG:teuthology.orchestra.run.smithi196:osd.5> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.5.service 2021-10-08T19:24:16.750 INFO:tasks.cephadm:Deploying osd.6 on smithi196 with /dev/vg_nvme/lv_2... 2021-10-08T19:24:16.750 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-10-08T19:24:16.776 INFO:journalctl@ceph.osd.5.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:24:17.562 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:17 smithi196 ceph-mon[34258]: poll took 3509.200 ms: 1 events 2021-10-08T19:24:17.562 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:17 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi196 to 8074M 2021-10-08T19:24:17.562 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:17 smithi196 ceph-mon[34258]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 56 KiB/s, 0 objects/s recovering 2021-10-08T19:24:17.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:17 smithi157 ceph-mon[32847]: poll took 3509.200 ms: 1 events 2021-10-08T19:24:17.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:17 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi196 to 8074M 2021-10-08T19:24:17.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:17 smithi157 ceph-mon[32847]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 56 KiB/s, 0 objects/s recovering 2021-10-08T19:24:17.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:17 smithi157 ceph-mon[42114]: poll took 3509.200 ms: 1 events 2021-10-08T19:24:17.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:17 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi196 to 8074M 2021-10-08T19:24:17.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:17 smithi157 ceph-mon[42114]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 56 KiB/s, 0 objects/s recovering 2021-10-08T19:24:18.835 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-10-08T19:24:18.836 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-10-08T19:24:18.836 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2021-10-08T19:24:18.836 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2021-10-08T19:24:18.837 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119729 s, 876 MB/s 2021-10-08T19:24:18.837 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2021-10-08T19:24:19.430 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi196:vg_nvme/lv_2 2021-10-08T19:24:19.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:19 smithi157 ceph-mon[32847]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:24:19.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:19 smithi157 ceph-mon[42114]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:24:19.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:19 smithi196 ceph-mon[34258]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:24:19.617 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:24:19 smithi196 conmon[46000]: 2021-10-08T19:24:19.315+0000 7f352aaeb0c0 -1 osd.5 0 log_to_monitors {default=true} 2021-10-08T19:24:20.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:20 smithi157 ceph-mon[32847]: from='osd.5 v2:172.21.15.196:6804/3344395065' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:24:20.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:20 smithi157 ceph-mon[32847]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:24:20.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:20 smithi157 ceph-mon[42114]: from='osd.5 v2:172.21.15.196:6804/3344395065' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:24:20.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:20 smithi157 ceph-mon[42114]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:24:20.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:20 smithi196 ceph-mon[34258]: from='osd.5 v2:172.21.15.196:6804/3344395065' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:24:20.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:20 smithi196 ceph-mon[34258]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:24:21.261 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.257+0000 7f4385bca700 1 -- 172.21.15.196:0/27392835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 msgr2=0x7f43800f89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:21.262 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.257+0000 7f4385bca700 1 --2- 172.21.15.196:0/27392835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 0x7f43800f89a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f43700046e0 tx=0x7f4370009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:21.262 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.257+0000 7f4385bca700 1 -- 172.21.15.196:0/27392835 shutdown_connections 2021-10-08T19:24:21.262 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.257+0000 7f4385bca700 1 --2- 172.21.15.196:0/27392835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43800fa1c0 0x7f4380100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.262 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.257+0000 7f4385bca700 1 --2- 172.21.15.196:0/27392835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 0x7f43800f89a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.263 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.257+0000 7f4385bca700 1 --2- 172.21.15.196:0/27392835 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43800f9830 0x7f43800f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.263 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.257+0000 7f4385bca700 1 -- 172.21.15.196:0/27392835 >> 172.21.15.196:0/27392835 conn(0x7f43800f3d80 msgr2=0x7f43800f61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:21.263 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.257+0000 7f4385bca700 1 -- 172.21.15.196:0/27392835 shutdown_connections 2021-10-08T19:24:21.263 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.257+0000 7f4385bca700 1 -- 172.21.15.196:0/27392835 wait complete. 2021-10-08T19:24:21.264 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f4385bca700 1 Processor -- start 2021-10-08T19:24:21.264 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f4385bca700 1 -- start start 2021-10-08T19:24:21.264 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f4385bca700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 0x7f438006d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:21.264 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f4385bca700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43800f9830 0x7f438006b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:21.265 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f4385bca700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43800fa1c0 0x7f438006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:21.266 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f4385bca700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438006c430 con 0x7f43800fa1c0 2021-10-08T19:24:21.266 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f4385bca700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438006c5a0 con 0x7f43800f8590 2021-10-08T19:24:21.266 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f4385bca700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4380112b70 con 0x7f43800f9830 2021-10-08T19:24:21.266 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437f7fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 0x7f438006d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:21.267 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437f7fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 0x7f438006d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49022/0 (socket says 172.21.15.196:49022) 2021-10-08T19:24:21.267 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437f7fe700 1 -- 172.21.15.196:0/296317900 learned_addr learned my addr 172.21.15.196:0/296317900 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:24:21.267 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437ffff700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43800fa1c0 0x7f438006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:21.267 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437f7fe700 1 -- 172.21.15.196:0/296317900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43800f9830 msgr2=0x7f438006b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:21.268 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437effd700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43800f9830 0x7f438006b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:21.268 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437f7fe700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43800f9830 0x7f438006b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.268 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437f7fe700 1 -- 172.21.15.196:0/296317900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43800fa1c0 msgr2=0x7f438006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:21.268 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437f7fe700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43800fa1c0 0x7f438006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.268 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437f7fe700 1 -- 172.21.15.196:0/296317900 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4370005040 con 0x7f43800f8590 2021-10-08T19:24:21.269 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437ffff700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43800fa1c0 0x7f438006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:24:21.269 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.258+0000 7f437f7fe700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 0x7f438006d0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4370009da0 tx=0x7f4370009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:21.269 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.259+0000 7f4367fff700 1 -- 172.21.15.196:0/296317900 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437000e040 con 0x7f43800f8590 2021-10-08T19:24:21.269 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.259+0000 7f4367fff700 1 -- 172.21.15.196:0/296317900 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f4370007da0 con 0x7f43800f8590 2021-10-08T19:24:21.269 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.259+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4380112df0 con 0x7f43800f8590 2021-10-08T19:24:21.270 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.259+0000 7f4367fff700 1 -- 172.21.15.196:0/296317900 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437001cd00 con 0x7f43800f8590 2021-10-08T19:24:21.270 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.259+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43801131f0 con 0x7f43800f8590 2021-10-08T19:24:21.270 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.260+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4380047b50 con 0x7f43800f8590 2021-10-08T19:24:21.271 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.260+0000 7f4367fff700 1 -- 172.21.15.196:0/296317900 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7f437001c3f0 con 0x7f43800f8590 2021-10-08T19:24:21.271 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.260+0000 7f4367fff700 1 --2- 172.21.15.196:0/296317900 >> v2:172.21.15.157:6800/3606206634 conn(0x7f43680634c0 0x7f4368065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:21.271 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.260+0000 7f4367fff700 1 -- 172.21.15.196:0/296317900 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3321+0+0 (secure 0 0 0) 0x7f4370080290 con 0x7f43800f8590 2021-10-08T19:24:21.271 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.260+0000 7f437effd700 1 --2- 172.21.15.196:0/296317900 >> v2:172.21.15.157:6800/3606206634 conn(0x7f43680634c0 0x7f4368065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:21.272 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.261+0000 7f437effd700 1 --2- 172.21.15.196:0/296317900 >> v2:172.21.15.157:6800/3606206634 conn(0x7f43680634c0 0x7f4368065970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f437400a6f0 tx=0x7f4374008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:21.272 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.264+0000 7f4367fff700 1 -- 172.21.15.196:0/296317900 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f4370053a50 con 0x7f43800f8590 2021-10-08T19:24:21.439 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:21.437+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4380059800 con 0x7f43680634c0 2021-10-08T19:24:21.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[32847]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:24:21.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[32847]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-10-08T19:24:21.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[32847]: osdmap e35: 6 total, 5 up, 6 in 2021-10-08T19:24:21.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:21.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[32847]: from='osd.5 v2:172.21.15.196:6804/3344395065' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:21.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[32847]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:21.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[42114]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:24:21.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[42114]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-10-08T19:24:21.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[42114]: osdmap e35: 6 total, 5 up, 6 in 2021-10-08T19:24:21.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:21.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[42114]: from='osd.5 v2:172.21.15.196:6804/3344395065' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:21.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:21 smithi157 ceph-mon[42114]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:21.616 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:24:21 smithi196 conmon[46000]: 2021-10-08T19:24:21.325+0000 7f3521293700 -1 osd.5 0 waiting for initial osdmap 2021-10-08T19:24:21.617 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:24:21 smithi196 conmon[46000]: 2021-10-08T19:24:21.329+0000 7f351a427700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:24:21.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:21 smithi196 ceph-mon[34258]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:24:21.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:21 smithi196 ceph-mon[34258]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-10-08T19:24:21.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:21 smithi196 ceph-mon[34258]: osdmap e35: 6 total, 5 up, 6 in 2021-10-08T19:24:21.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:21 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:21.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:21 smithi196 ceph-mon[34258]: from='osd.5 v2:172.21.15.196:6804/3344395065' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:21.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:21 smithi196 ceph-mon[34258]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:22.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: purged_snaps scrub starts 2021-10-08T19:24:22.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: purged_snaps scrub ok 2021-10-08T19:24:22.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:22.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: osdmap e36: 6 total, 5 up, 6 in 2021-10-08T19:24:22.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:22.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:22.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:22.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:22.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:22.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:22.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: poll took 5328.317 ms: 1 events 2021-10-08T19:24:22.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[32847]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:22.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: purged_snaps scrub starts 2021-10-08T19:24:22.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: purged_snaps scrub ok 2021-10-08T19:24:22.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:22.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: osdmap e36: 6 total, 5 up, 6 in 2021-10-08T19:24:22.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:22.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:22.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:22.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:22.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:22.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:22.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: poll took 5328.317 ms: 1 events 2021-10-08T19:24:22.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:22 smithi157 ceph-mon[42114]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:22.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: purged_snaps scrub starts 2021-10-08T19:24:22.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: purged_snaps scrub ok 2021-10-08T19:24:22.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:22.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: osdmap e36: 6 total, 5 up, 6 in 2021-10-08T19:24:22.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:22.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:22.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:22.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:22.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:22.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:22.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: poll took 5328.317 ms: 1 events 2021-10-08T19:24:22.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:22 smithi196 ceph-mon[34258]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:24:23.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:23 smithi196 ceph-mon[34258]: osd.5 v2:172.21.15.196:6804/3344395065 boot 2021-10-08T19:24:23.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:23 smithi196 ceph-mon[34258]: osdmap e37: 6 total, 6 up, 6 in 2021-10-08T19:24:23.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:23 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:23.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:23 smithi196 ceph-mon[34258]: osdmap e38: 6 total, 6 up, 6 in 2021-10-08T19:24:23.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:23 smithi157 ceph-mon[32847]: osd.5 v2:172.21.15.196:6804/3344395065 boot 2021-10-08T19:24:23.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:23 smithi157 ceph-mon[32847]: osdmap e37: 6 total, 6 up, 6 in 2021-10-08T19:24:23.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:23 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:23.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:23 smithi157 ceph-mon[32847]: osdmap e38: 6 total, 6 up, 6 in 2021-10-08T19:24:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:23 smithi157 ceph-mon[42114]: osd.5 v2:172.21.15.196:6804/3344395065 boot 2021-10-08T19:24:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:23 smithi157 ceph-mon[42114]: osdmap e37: 6 total, 6 up, 6 in 2021-10-08T19:24:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:23 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:24:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:23 smithi157 ceph-mon[42114]: osdmap e38: 6 total, 6 up, 6 in 2021-10-08T19:24:24.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/2405172882' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cb7be3-7318-43cf-a34b-b86d2ef15bf5"}]: dispatch 2021-10-08T19:24:24.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cb7be3-7318-43cf-a34b-b86d2ef15bf5"}]: dispatch 2021-10-08T19:24:24.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76cb7be3-7318-43cf-a34b-b86d2ef15bf5"}]': finished 2021-10-08T19:24:24.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:24 smithi196 ceph-mon[34258]: osdmap e39: 7 total, 6 up, 7 in 2021-10-08T19:24:24.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:24.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:24 smithi196 ceph-mon[34258]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:24.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/1666163768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:25.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/2405172882' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cb7be3-7318-43cf-a34b-b86d2ef15bf5"}]: dispatch 2021-10-08T19:24:25.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cb7be3-7318-43cf-a34b-b86d2ef15bf5"}]: dispatch 2021-10-08T19:24:25.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76cb7be3-7318-43cf-a34b-b86d2ef15bf5"}]': finished 2021-10-08T19:24:25.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[32847]: osdmap e39: 7 total, 6 up, 7 in 2021-10-08T19:24:25.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:25.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[32847]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:25.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/1666163768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:25.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/2405172882' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cb7be3-7318-43cf-a34b-b86d2ef15bf5"}]: dispatch 2021-10-08T19:24:25.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cb7be3-7318-43cf-a34b-b86d2ef15bf5"}]: dispatch 2021-10-08T19:24:25.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76cb7be3-7318-43cf-a34b-b86d2ef15bf5"}]': finished 2021-10-08T19:24:25.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[42114]: osdmap e39: 7 total, 6 up, 7 in 2021-10-08T19:24:25.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:25.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[42114]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:25.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/1666163768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:26.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:25 smithi157 ceph-mon[32847]: osdmap e40: 7 total, 6 up, 7 in 2021-10-08T19:24:26.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:25 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:26.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:25 smithi157 ceph-mon[42114]: osdmap e40: 7 total, 6 up, 7 in 2021-10-08T19:24:26.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:25 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:26.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:25 smithi196 ceph-mon[34258]: osdmap e40: 7 total, 6 up, 7 in 2021-10-08T19:24:26.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:25 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:27.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:26 smithi196 ceph-mon[34258]: osdmap e41: 7 total, 6 up, 7 in 2021-10-08T19:24:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:26 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:26 smithi196 ceph-mon[34258]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:27.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:26 smithi157 ceph-mon[32847]: osdmap e41: 7 total, 6 up, 7 in 2021-10-08T19:24:27.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:26 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:27.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:26 smithi157 ceph-mon[32847]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:27.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:26 smithi157 ceph-mon[42114]: osdmap e41: 7 total, 6 up, 7 in 2021-10-08T19:24:27.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:26 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:27.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:26 smithi157 ceph-mon[42114]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:28 smithi196 ceph-mon[34258]: poll took 5700.907 ms: 1 events 2021-10-08T19:24:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:28 smithi196 ceph-mon[34258]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:28.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:28 smithi157 ceph-mon[32847]: poll took 5700.907 ms: 1 events 2021-10-08T19:24:28.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:28 smithi157 ceph-mon[32847]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:28.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:28 smithi157 ceph-mon[42114]: poll took 5700.907 ms: 1 events 2021-10-08T19:24:28.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:28 smithi157 ceph-mon[42114]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:30.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:24:29 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:24:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:31.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:31.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:24:31.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:24:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:31.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[32847]: poll took 2298.206 ms: 1 events 2021-10-08T19:24:31.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-10-08T19:24:31.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:31.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[32847]: Deploying daemon osd.6 on smithi196 2021-10-08T19:24:31.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[32847]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:31.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:31.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:24:31.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:24:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:31.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[42114]: poll took 2298.206 ms: 1 events 2021-10-08T19:24:31.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-10-08T19:24:31.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:31.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[42114]: Deploying daemon osd.6 on smithi196 2021-10-08T19:24:31.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:30 smithi157 ceph-mon[42114]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:31.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:31.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:30 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:24:31.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:30 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:24:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:31.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:30 smithi196 ceph-mon[34258]: poll took 2298.206 ms: 1 events 2021-10-08T19:24:31.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-10-08T19:24:31.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:30 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:31.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:30 smithi196 ceph-mon[34258]: Deploying daemon osd.6 on smithi196 2021-10-08T19:24:31.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:30 smithi196 ceph-mon[34258]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:32.557 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:32 smithi196 ceph-mon[34258]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:32.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:32 smithi157 ceph-mon[32847]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:32.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:32 smithi157 ceph-mon[42114]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:34.442 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 6 on host 'smithi196' 2021-10-08T19:24:34.443 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.440+0000 7f4367fff700 1 -- 172.21.15.196:0/296317900 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4380059800 con 0x7f43680634c0 2021-10-08T19:24:34.444 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 >> v2:172.21.15.157:6800/3606206634 conn(0x7f43680634c0 msgr2=0x7f4368065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:34.444 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 --2- 172.21.15.196:0/296317900 >> v2:172.21.15.157:6800/3606206634 conn(0x7f43680634c0 0x7f4368065970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f437400a6f0 tx=0x7f4374008040 comp rx=0 tx=0).stop 2021-10-08T19:24:34.444 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 msgr2=0x7f438006d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:34.445 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 0x7f438006d0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4370009da0 tx=0x7f4370009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:34.445 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 shutdown_connections 2021-10-08T19:24:34.445 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 --2- 172.21.15.196:0/296317900 >> v2:172.21.15.157:6800/3606206634 conn(0x7f43680634c0 0x7f4368065970 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:34.445 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43800fa1c0 0x7f438006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:34.446 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43800f8590 0x7f438006d0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:34.446 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 --2- 172.21.15.196:0/296317900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43800f9830 0x7f438006b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:34.446 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 >> 172.21.15.196:0/296317900 conn(0x7f43800f3d80 msgr2=0x7f43800f60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:34.446 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 shutdown_connections 2021-10-08T19:24:34.447 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:34.443+0000 7f4385bca700 1 -- 172.21.15.196:0/296317900 wait complete. 2021-10-08T19:24:34.862 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:34.863 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:34.863 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:34.863 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:34.863 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:34.864 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:34.864 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:34.864 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:34.864 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:34.864 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:34.865 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:34.865 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:34.865 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:34.865 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:34.865 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:34 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:35.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:34 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:35.294 DEBUG:teuthology.orchestra.run.smithi196:osd.6> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.6.service 2021-10-08T19:24:35.296 INFO:tasks.cephadm:Deploying osd.7 on smithi196 with /dev/vg_nvme/lv_1... 2021-10-08T19:24:35.297 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-10-08T19:24:35.324 INFO:journalctl@ceph.osd.6.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:24:35.864 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:35 smithi196 ceph-mon[34258]: poll took 4009.616 ms: 1 events 2021-10-08T19:24:35.864 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:35 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi196 to 5382M 2021-10-08T19:24:36.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:35 smithi157 ceph-mon[32847]: poll took 4009.616 ms: 1 events 2021-10-08T19:24:36.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:35 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi196 to 5382M 2021-10-08T19:24:36.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:35 smithi157 ceph-mon[42114]: poll took 4009.616 ms: 1 events 2021-10-08T19:24:36.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:35 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi196 to 5382M 2021-10-08T19:24:36.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:36 smithi196 ceph-mon[34258]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:36 smithi157 ceph-mon[32847]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:37.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:36 smithi157 ceph-mon[42114]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:37.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:37 smithi196 ceph-mon[34258]: from='osd.6 v2:172.21.15.196:6808/892194681' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:24:37.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:37 smithi196 ceph-mon[34258]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:24:37.869 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:24:37 smithi196 conmon[49684]: 2021-10-08T19:24:37.590+0000 7f74c8c2c0c0 -1 osd.6 0 log_to_monitors {default=true} 2021-10-08T19:24:37.933 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-10-08T19:24:37.933 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-10-08T19:24:37.933 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2021-10-08T19:24:37.934 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2021-10-08T19:24:37.934 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132162 s, 793 MB/s 2021-10-08T19:24:37.934 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2021-10-08T19:24:38.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:37 smithi157 ceph-mon[32847]: from='osd.6 v2:172.21.15.196:6808/892194681' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:24:38.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:37 smithi157 ceph-mon[32847]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:24:38.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:37 smithi157 ceph-mon[42114]: from='osd.6 v2:172.21.15.196:6808/892194681' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:24:38.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:37 smithi157 ceph-mon[42114]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:24:38.830 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi196:vg_nvme/lv_1 2021-10-08T19:24:39.072 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[42114]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-10-08T19:24:39.073 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[42114]: osdmap e42: 7 total, 6 up, 7 in 2021-10-08T19:24:39.073 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:39.073 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[42114]: from='osd.6 v2:172.21.15.196:6808/892194681' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:39.073 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[42114]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:39.074 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[42114]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:39.074 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[32847]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-10-08T19:24:39.074 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[32847]: osdmap e42: 7 total, 6 up, 7 in 2021-10-08T19:24:39.074 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:39.075 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[32847]: from='osd.6 v2:172.21.15.196:6808/892194681' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:39.075 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[32847]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:39.075 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:38 smithi157 ceph-mon[32847]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:39.116 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:24:38 smithi196 conmon[49684]: 2021-10-08T19:24:38.622+0000 7f74bf3d4700 -1 osd.6 0 waiting for initial osdmap 2021-10-08T19:24:39.117 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:24:38 smithi196 conmon[49684]: 2021-10-08T19:24:38.628+0000 7f74b7d67700 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:24:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:38 smithi196 ceph-mon[34258]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-10-08T19:24:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:38 smithi196 ceph-mon[34258]: osdmap e42: 7 total, 6 up, 7 in 2021-10-08T19:24:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:38 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:38 smithi196 ceph-mon[34258]: from='osd.6 v2:172.21.15.196:6808/892194681' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:38 smithi196 ceph-mon[34258]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:38 smithi196 ceph-mon[34258]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:24:39.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:24:39 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:40.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[32847]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:40.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[32847]: osdmap e43: 7 total, 6 up, 7 in 2021-10-08T19:24:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[32847]: Detected new or changed devices on smithi196 2021-10-08T19:24:40.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:24:40.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:40.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[42114]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:40.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[42114]: osdmap e43: 7 total, 6 up, 7 in 2021-10-08T19:24:40.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:40.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:40.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:40.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[42114]: Detected new or changed devices on smithi196 2021-10-08T19:24:40.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:24:40.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:39 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:39 smithi196 ceph-mon[34258]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:39 smithi196 ceph-mon[34258]: osdmap e43: 7 total, 6 up, 7 in 2021-10-08T19:24:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:39 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:39 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:40.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:39 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:40.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:39 smithi196 ceph-mon[34258]: Detected new or changed devices on smithi196 2021-10-08T19:24:40.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:39 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:24:40.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:39 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:40.575 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.571+0000 7f581f59e700 1 -- 172.21.15.196:0/832047341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200f9740 msgr2=0x7f58200f9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:40.575 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.571+0000 7f581f59e700 1 --2- 172.21.15.196:0/832047341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200f9740 0x7f58200f9b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f58140046e0 tx=0x7f5814009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:40.575 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.571+0000 7f581f59e700 1 -- 172.21.15.196:0/832047341 shutdown_connections 2021-10-08T19:24:40.576 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.571+0000 7f581f59e700 1 --2- 172.21.15.196:0/832047341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58200fa0d0 0x7f5820100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:40.576 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.571+0000 7f581f59e700 1 --2- 172.21.15.196:0/832047341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58200f84a0 0x7f58200f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:40.576 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.571+0000 7f581f59e700 1 --2- 172.21.15.196:0/832047341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200f9740 0x7f58200f9b90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:40.576 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.571+0000 7f581f59e700 1 -- 172.21.15.196:0/832047341 >> 172.21.15.196:0/832047341 conn(0x7f58200f3bf0 msgr2=0x7f58200f6020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:40.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.571+0000 7f581f59e700 1 -- 172.21.15.196:0/832047341 shutdown_connections 2021-10-08T19:24:40.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.572+0000 7f581f59e700 1 -- 172.21.15.196:0/832047341 wait complete. 2021-10-08T19:24:40.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.572+0000 7f581f59e700 1 Processor -- start 2021-10-08T19:24:40.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.572+0000 7f581f59e700 1 -- start start 2021-10-08T19:24:40.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.572+0000 7f581f59e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58200f84a0 0x7f5820108820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:40.578 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.572+0000 7f581f59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58200f9740 0x7f5820108d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:40.578 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.572+0000 7f581f59e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200fa0d0 0x7f5820109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:40.578 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581f59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582010a220 con 0x7f58200f9740 2021-10-08T19:24:40.578 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581f59e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582010a390 con 0x7f58200fa0d0 2021-10-08T19:24:40.579 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581f59e700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582010a550 con 0x7f58200f84a0 2021-10-08T19:24:40.579 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581ed9d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200fa0d0 0x7f5820109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:40.579 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581ed9d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200fa0d0 0x7f5820109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49170/0 (socket says 172.21.15.196:49170) 2021-10-08T19:24:40.579 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581ed9d700 1 -- 172.21.15.196:0/3710731241 learned_addr learned my addr 172.21.15.196:0/3710731241 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:24:40.579 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581e59c700 1 --2- 172.21.15.196:0/3710731241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58200f84a0 0x7f5820108820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:40.580 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581dd9b700 1 --2- 172.21.15.196:0/3710731241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58200f9740 0x7f5820108d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:40.580 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581ed9d700 1 -- 172.21.15.196:0/3710731241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58200f84a0 msgr2=0x7f5820108820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:40.580 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581ed9d700 1 --2- 172.21.15.196:0/3710731241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58200f84a0 0x7f5820108820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:40.580 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581ed9d700 1 -- 172.21.15.196:0/3710731241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58200f9740 msgr2=0x7f5820108d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:40.581 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581ed9d700 1 --2- 172.21.15.196:0/3710731241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58200f9740 0x7f5820108d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:40.581 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581ed9d700 1 -- 172.21.15.196:0/3710731241 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5814005040 con 0x7f58200fa0d0 2021-10-08T19:24:40.581 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581ed9d700 1 --2- 172.21.15.196:0/3710731241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200fa0d0 0x7f5820109c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f581800c810 tx=0x7f5818004d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:40.581 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f580effd700 1 -- 172.21.15.196:0/3710731241 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818010510 con 0x7f58200fa0d0 2021-10-08T19:24:40.581 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f580effd700 1 -- 172.21.15.196:0/3710731241 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f5818010af0 con 0x7f58200fa0d0 2021-10-08T19:24:40.582 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582010a830 con 0x7f58200fa0d0 2021-10-08T19:24:40.582 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f580effd700 1 -- 172.21.15.196:0/3710731241 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818012aa0 con 0x7f58200fa0d0 2021-10-08T19:24:40.582 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.573+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5820111010 con 0x7f58200fa0d0 2021-10-08T19:24:40.582 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.574+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58200472f0 con 0x7f58200fa0d0 2021-10-08T19:24:40.583 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.574+0000 7f580effd700 1 -- 172.21.15.196:0/3710731241 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7f5818010070 con 0x7f58200fa0d0 2021-10-08T19:24:40.584 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.575+0000 7f580effd700 1 --2- 172.21.15.196:0/3710731241 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5808063400 0x7f58080658b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:40.584 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.575+0000 7f580effd700 1 -- 172.21.15.196:0/3710731241 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 3802+0+0 (secure 0 0 0) 0x7f581807f040 con 0x7f58200fa0d0 2021-10-08T19:24:40.584 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.575+0000 7f581e59c700 1 --2- 172.21.15.196:0/3710731241 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5808063400 0x7f58080658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:40.584 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.575+0000 7f581e59c700 1 --2- 172.21.15.196:0/3710731241 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5808063400 0x7f58080658b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58200f95a0 tx=0x7f5810009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:40.584 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.579+0000 7f580effd700 1 -- 172.21.15.196:0/3710731241 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f58180525a0 con 0x7f58200fa0d0 2021-10-08T19:24:40.749 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:40.746+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5820059800 con 0x7f5808063400 2021-10-08T19:24:40.779 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:40 smithi196 ceph-mon[34258]: purged_snaps scrub starts 2021-10-08T19:24:40.779 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:40 smithi196 ceph-mon[34258]: purged_snaps scrub ok 2021-10-08T19:24:40.779 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:40 smithi196 ceph-mon[34258]: osd.6 v2:172.21.15.196:6808/892194681 boot 2021-10-08T19:24:40.780 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:40 smithi196 ceph-mon[34258]: osdmap e44: 7 total, 7 up, 7 in 2021-10-08T19:24:40.780 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:40 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:40.780 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:40 smithi196 ceph-mon[34258]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:40.780 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:40 smithi196 ceph-mon[34258]: osdmap e45: 7 total, 7 up, 7 in 2021-10-08T19:24:41.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[32847]: purged_snaps scrub starts 2021-10-08T19:24:41.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[32847]: purged_snaps scrub ok 2021-10-08T19:24:41.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[32847]: osd.6 v2:172.21.15.196:6808/892194681 boot 2021-10-08T19:24:41.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[32847]: osdmap e44: 7 total, 7 up, 7 in 2021-10-08T19:24:41.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:41.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[32847]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:41.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[32847]: osdmap e45: 7 total, 7 up, 7 in 2021-10-08T19:24:41.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[42114]: purged_snaps scrub starts 2021-10-08T19:24:41.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[42114]: purged_snaps scrub ok 2021-10-08T19:24:41.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[42114]: osd.6 v2:172.21.15.196:6808/892194681 boot 2021-10-08T19:24:41.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[42114]: osdmap e44: 7 total, 7 up, 7 in 2021-10-08T19:24:41.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:24:41.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[42114]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:41.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:40 smithi157 ceph-mon[42114]: osdmap e45: 7 total, 7 up, 7 in 2021-10-08T19:24:41.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:41 smithi196 ceph-mon[34258]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:41.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:41 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:41.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:41 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:41.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:41 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:41.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:41 smithi196 ceph-mon[34258]: poll took 6324.512 ms: 1 events 2021-10-08T19:24:41.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:41 smithi196 ceph-mon[34258]: osdmap e46: 7 total, 7 up, 7 in 2021-10-08T19:24:42.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[32847]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:42.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:42.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:42.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:42.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[32847]: poll took 6324.512 ms: 1 events 2021-10-08T19:24:42.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[32847]: osdmap e46: 7 total, 7 up, 7 in 2021-10-08T19:24:42.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[42114]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:42.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:42.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:42.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:42.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[42114]: poll took 6324.512 ms: 1 events 2021-10-08T19:24:42.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:41 smithi157 ceph-mon[42114]: osdmap e46: 7 total, 7 up, 7 in 2021-10-08T19:24:42.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:42 smithi196 ceph-mon[34258]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:42 smithi157 ceph-mon[32847]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:43.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:42 smithi157 ceph-mon[42114]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:44.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[32847]: osdmap e47: 7 total, 7 up, 7 in 2021-10-08T19:24:44.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/3842081755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66c7dc80-3bf0-47fe-8ec0-1352aae1a017"}]: dispatch 2021-10-08T19:24:44.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66c7dc80-3bf0-47fe-8ec0-1352aae1a017"}]: dispatch 2021-10-08T19:24:44.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66c7dc80-3bf0-47fe-8ec0-1352aae1a017"}]': finished 2021-10-08T19:24:44.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[32847]: osdmap e48: 8 total, 7 up, 8 in 2021-10-08T19:24:44.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:44.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/2430073795' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:44.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[42114]: osdmap e47: 7 total, 7 up, 7 in 2021-10-08T19:24:44.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/3842081755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66c7dc80-3bf0-47fe-8ec0-1352aae1a017"}]: dispatch 2021-10-08T19:24:44.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66c7dc80-3bf0-47fe-8ec0-1352aae1a017"}]: dispatch 2021-10-08T19:24:44.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66c7dc80-3bf0-47fe-8ec0-1352aae1a017"}]': finished 2021-10-08T19:24:44.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[42114]: osdmap e48: 8 total, 7 up, 8 in 2021-10-08T19:24:44.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:44.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/2430073795' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:44.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:43 smithi196 ceph-mon[34258]: osdmap e47: 7 total, 7 up, 7 in 2021-10-08T19:24:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/3842081755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66c7dc80-3bf0-47fe-8ec0-1352aae1a017"}]: dispatch 2021-10-08T19:24:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66c7dc80-3bf0-47fe-8ec0-1352aae1a017"}]: dispatch 2021-10-08T19:24:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66c7dc80-3bf0-47fe-8ec0-1352aae1a017"}]': finished 2021-10-08T19:24:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:43 smithi196 ceph-mon[34258]: osdmap e48: 8 total, 7 up, 8 in 2021-10-08T19:24:44.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:43 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:44.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/2430073795' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:45.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:44 smithi157 ceph-mon[32847]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:45.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:44 smithi157 ceph-mon[42114]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:45.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:44 smithi196 ceph-mon[34258]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:46.629 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:46 smithi196 ceph-mon[34258]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2021-10-08T19:24:46.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:46 smithi157 ceph-mon[32847]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2021-10-08T19:24:46.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:46 smithi157 ceph-mon[42114]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2021-10-08T19:24:47.456 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:47 smithi196 ceph-mon[34258]: poll took 5511.052 ms: 1 events 2021-10-08T19:24:47.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:47 smithi157 ceph-mon[32847]: poll took 5511.052 ms: 1 events 2021-10-08T19:24:47.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:47 smithi157 ceph-mon[42114]: poll took 5511.052 ms: 1 events 2021-10-08T19:24:48.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:48 smithi196 ceph-mon[34258]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2021-10-08T19:24:48.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:48 smithi157 ceph-mon[32847]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2021-10-08T19:24:48.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:48 smithi157 ceph-mon[42114]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2021-10-08T19:24:49.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:49 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-10-08T19:24:49.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:49 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:50.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-10-08T19:24:50.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:49 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:50.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:49 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-10-08T19:24:50.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:49 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:50.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[32847]: poll took 2577.352 ms: 1 events 2021-10-08T19:24:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[32847]: Deploying daemon osd.7 on smithi196 2021-10-08T19:24:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:24:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:24:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[32847]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2021-10-08T19:24:50.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[42114]: poll took 2577.352 ms: 1 events 2021-10-08T19:24:50.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[42114]: Deploying daemon osd.7 on smithi196 2021-10-08T19:24:50.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:24:50.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:24:50.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:50 smithi157 ceph-mon[42114]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2021-10-08T19:24:50.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:50 smithi196 ceph-mon[34258]: poll took 2577.352 ms: 1 events 2021-10-08T19:24:50.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:50 smithi196 ceph-mon[34258]: Deploying daemon osd.7 on smithi196 2021-10-08T19:24:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:50 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:24:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:50 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:24:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:50 smithi196 ceph-mon[34258]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2021-10-08T19:24:52.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:52 smithi157 ceph-mon[32847]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 60 KiB/s, 0 objects/s recovering 2021-10-08T19:24:52.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:52 smithi157 ceph-mon[42114]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 60 KiB/s, 0 objects/s recovering 2021-10-08T19:24:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:52 smithi196 ceph-mon[34258]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 60 KiB/s, 0 objects/s recovering 2021-10-08T19:24:53.446 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 7 on host 'smithi196' 2021-10-08T19:24:53.447 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.443+0000 7f580effd700 1 -- 172.21.15.196:0/3710731241 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5820059800 con 0x7f5808063400 2021-10-08T19:24:53.447 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5808063400 msgr2=0x7f58080658b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:53.448 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 --2- 172.21.15.196:0/3710731241 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5808063400 0x7f58080658b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58200f95a0 tx=0x7f5810009040 comp rx=0 tx=0).stop 2021-10-08T19:24:53.448 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200fa0d0 msgr2=0x7f5820109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:53.448 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 --2- 172.21.15.196:0/3710731241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200fa0d0 0x7f5820109c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f581800c810 tx=0x7f5818004d60 comp rx=0 tx=0).stop 2021-10-08T19:24:53.448 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 shutdown_connections 2021-10-08T19:24:53.449 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 --2- 172.21.15.196:0/3710731241 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5808063400 0x7f58080658b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:53.449 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 --2- 172.21.15.196:0/3710731241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58200fa0d0 0x7f5820109c00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:53.449 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 --2- 172.21.15.196:0/3710731241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58200f84a0 0x7f5820108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:53.449 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 --2- 172.21.15.196:0/3710731241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58200f9740 0x7f5820108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:53.449 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 >> 172.21.15.196:0/3710731241 conn(0x7f58200f3bf0 msgr2=0x7f58200f5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:53.450 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 shutdown_connections 2021-10-08T19:24:53.450 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:24:53.446+0000 7f581f59e700 1 -- 172.21.15.196:0/3710731241 wait complete. 2021-10-08T19:24:53.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:53.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:53.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:53.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:53.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:53.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:53.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:53 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:53.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:53.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:53.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:53.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:53.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:53.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:53.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:53.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:53.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:53.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:53.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:53 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:54.091 DEBUG:teuthology.orchestra.run.smithi196:osd.7> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.7.service 2021-10-08T19:24:54.094 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2021-10-08T19:24:54.095 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd stat -f json 2021-10-08T19:24:54.122 INFO:journalctl@ceph.osd.7.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:24:54.123 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:24:53 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:24:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:55.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:54 smithi196 ceph-mon[34258]: poll took 3610.552 ms: 1 events 2021-10-08T19:24:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:54 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi196 to 4037M 2021-10-08T19:24:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:54 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:54 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:24:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:54 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:24:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:55.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:54 smithi196 ceph-mon[34258]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2021-10-08T19:24:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[32847]: poll took 3610.552 ms: 1 events 2021-10-08T19:24:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi196 to 4037M 2021-10-08T19:24:55.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:55.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:24:55.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:24:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:55.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[32847]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2021-10-08T19:24:55.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[42114]: poll took 3610.552 ms: 1 events 2021-10-08T19:24:55.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi196 to 4037M 2021-10-08T19:24:55.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:24:55.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:24:55.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:24:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:55.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:54 smithi157 ceph-mon[42114]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2021-10-08T19:24:55.883 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.880+0000 7fe5153e6700 1 -- 172.21.15.157:0/1562456453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f8760 msgr2=0x7fe5100ff020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:55.883 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.880+0000 7fe5153e6700 1 --2- 172.21.15.157:0/1562456453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f8760 0x7fe5100ff020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe50800ab70 tx=0x7fe508004d10 comp rx=0 tx=0).stop 2021-10-08T19:24:55.883 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.880+0000 7fe5153e6700 1 -- 172.21.15.157:0/1562456453 shutdown_connections 2021-10-08T19:24:55.884 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.880+0000 7fe5153e6700 1 --2- 172.21.15.157:0/1562456453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f8760 0x7fe5100ff020 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:55.884 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.880+0000 7fe5153e6700 1 --2- 172.21.15.157:0/1562456453 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5100f6b30 0x7fe5100f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:55.884 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.880+0000 7fe5153e6700 1 --2- 172.21.15.157:0/1562456453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5100f7dd0 0x7fe5100f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:55.884 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.880+0000 7fe5153e6700 1 -- 172.21.15.157:0/1562456453 >> 172.21.15.157:0/1562456453 conn(0x7fe5100f2280 msgr2=0x7fe5100f46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:55.885 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.880+0000 7fe5153e6700 1 -- 172.21.15.157:0/1562456453 shutdown_connections 2021-10-08T19:24:55.885 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.880+0000 7fe5153e6700 1 -- 172.21.15.157:0/1562456453 wait complete. 2021-10-08T19:24:55.885 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe5153e6700 1 Processor -- start 2021-10-08T19:24:55.885 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe5153e6700 1 -- start start 2021-10-08T19:24:55.885 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe5153e6700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5100f6b30 0x7fe5101087c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:55.886 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe5153e6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f7dd0 0x7fe510108d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:55.886 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe5153e6700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5100f8760 0x7fe510109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:55.886 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe5153e6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51010a1c0 con 0x7fe5100f7dd0 2021-10-08T19:24:55.886 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe5153e6700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51010a330 con 0x7fe5100f6b30 2021-10-08T19:24:55.886 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe5153e6700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51010a4f0 con 0x7fe5100f8760 2021-10-08T19:24:55.887 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe50f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f7dd0 0x7fe510108d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:55.887 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe50f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f7dd0 0x7fe510108d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40106/0 (socket says 172.21.15.157:40106) 2021-10-08T19:24:55.887 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe50f7fe700 1 -- 172.21.15.157:0/634659887 learned_addr learned my addr 172.21.15.157:0/634659887 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:24:55.887 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe514be5700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5100f8760 0x7fe510109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:55.887 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe50ffff700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5100f6b30 0x7fe5101087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:55.888 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe50f7fe700 1 -- 172.21.15.157:0/634659887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5100f8760 msgr2=0x7fe510109ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:55.888 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe50f7fe700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5100f8760 0x7fe510109ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:55.888 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe50f7fe700 1 -- 172.21.15.157:0/634659887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5100f6b30 msgr2=0x7fe5101087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:55.888 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe50f7fe700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5100f6b30 0x7fe5101087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:55.888 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe50f7fe700 1 -- 172.21.15.157:0/634659887 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe500005040 con 0x7fe5100f7dd0 2021-10-08T19:24:55.889 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.881+0000 7fe514be5700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5100f8760 0x7fe510109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:24:55.889 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.882+0000 7fe50f7fe700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f7dd0 0x7fe510108d00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe504004a60 tx=0x7fe504007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:55.889 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.882+0000 7fe50cff9700 1 -- 172.21.15.157:0/634659887 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50400a7a0 con 0x7fe5100f7dd0 2021-10-08T19:24:55.889 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.882+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50800a750 con 0x7fe5100f7dd0 2021-10-08T19:24:55.890 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.882+0000 7fe50cff9700 1 -- 172.21.15.157:0/634659887 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fe50400ad80 con 0x7fe5100f7dd0 2021-10-08T19:24:55.890 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.882+0000 7fe50cff9700 1 -- 172.21.15.157:0/634659887 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504018ce0 con 0x7fe5100f7dd0 2021-10-08T19:24:55.890 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.882+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe510106150 con 0x7fe5100f7dd0 2021-10-08T19:24:55.890 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.883+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5100f5f20 con 0x7fe5100f7dd0 2021-10-08T19:24:55.891 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.883+0000 7fe50cff9700 1 -- 172.21.15.157:0/634659887 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7fe50401e020 con 0x7fe5100f7dd0 2021-10-08T19:24:55.892 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.884+0000 7fe50cff9700 1 --2- 172.21.15.157:0/634659887 >> v2:172.21.15.157:6800/3606206634 conn(0x7fe4f8063400 0x7fe4f80658b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:55.892 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.884+0000 7fe50cff9700 1 -- 172.21.15.157:0/634659887 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 3884+0+0 (secure 0 0 0) 0x7fe504082aa0 con 0x7fe5100f7dd0 2021-10-08T19:24:55.892 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.884+0000 7fe50ffff700 1 --2- 172.21.15.157:0/634659887 >> v2:172.21.15.157:6800/3606206634 conn(0x7fe4f8063400 0x7fe4f80658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:55.892 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.884+0000 7fe50ffff700 1 --2- 172.21.15.157:0/634659887 >> v2:172.21.15.157:6800/3606206634 conn(0x7fe4f8063400 0x7fe4f80658b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5100f7c30 tx=0x7fe50000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:55.892 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:55.888+0000 7fe50cff9700 1 -- 172.21.15.157:0/634659887 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fe504055ec0 con 0x7fe5100f7dd0 2021-10-08T19:24:56.046 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.045+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe5100472f0 con 0x7fe5100f7dd0 2021-10-08T19:24:56.046 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.046+0000 7fe50cff9700 1 -- 172.21.15.157:0/634659887 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v48) v1 ==== 74+0+130 (secure 0 0 0) 0x7fe504055ab0 con 0x7fe5100f7dd0 2021-10-08T19:24:56.047 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:24:56.048 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 >> v2:172.21.15.157:6800/3606206634 conn(0x7fe4f8063400 msgr2=0x7fe4f80658b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:56.049 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 --2- 172.21.15.157:0/634659887 >> v2:172.21.15.157:6800/3606206634 conn(0x7fe4f8063400 0x7fe4f80658b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5100f7c30 tx=0x7fe50000b040 comp rx=0 tx=0).stop 2021-10-08T19:24:56.049 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f7dd0 msgr2=0x7fe510108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:56.049 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f7dd0 0x7fe510108d00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe504004a60 tx=0x7fe504007e20 comp rx=0 tx=0).stop 2021-10-08T19:24:56.049 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 shutdown_connections 2021-10-08T19:24:56.049 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 --2- 172.21.15.157:0/634659887 >> v2:172.21.15.157:6800/3606206634 conn(0x7fe4f8063400 0x7fe4f80658b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:56.050 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5100f8760 0x7fe510109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:56.050 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5100f6b30 0x7fe5101087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:56.050 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 --2- 172.21.15.157:0/634659887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5100f7dd0 0x7fe510108d00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:56.050 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 >> 172.21.15.157:0/634659887 conn(0x7fe5100f2280 msgr2=0x7fe5100f4470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:56.051 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 shutdown_connections 2021-10-08T19:24:56.051 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:56.048+0000 7fe5153e6700 1 -- 172.21.15.157:0/634659887 wait complete. 2021-10-08T19:24:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/634659887' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:24:56.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/634659887' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:24:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/634659887' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:24:56.612 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":48,"num_osds":8,"num_up_osds":7,"osd_up_since":1633721079,"num_in_osds":8,"osd_in_since":1633721083,"num_remapped_pgs":0} 2021-10-08T19:24:56.866 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:24:56 smithi196 conmon[53867]: 2021-10-08T19:24:56.588+0000 7f6510ed30c0 -1 osd.7 0 log_to_monitors {default=true} 2021-10-08T19:24:57.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:57 smithi196 ceph-mon[34258]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:24:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:57 smithi196 ceph-mon[34258]: from='osd.7 v2:172.21.15.196:6812/1866932410' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:24:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:57 smithi196 ceph-mon[34258]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:24:57.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:57 smithi157 ceph-mon[32847]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:24:57.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:57 smithi157 ceph-mon[32847]: from='osd.7 v2:172.21.15.196:6812/1866932410' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:24:57.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:57 smithi157 ceph-mon[32847]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:24:57.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:57 smithi157 ceph-mon[42114]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:24:57.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:57 smithi157 ceph-mon[42114]: from='osd.7 v2:172.21.15.196:6812/1866932410' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:24:57.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:57 smithi157 ceph-mon[42114]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:24:57.614 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd stat -f json 2021-10-08T19:24:58.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[42114]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-10-08T19:24:58.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[42114]: osdmap e49: 8 total, 7 up, 8 in 2021-10-08T19:24:58.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:58.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[42114]: from='osd.7 v2:172.21.15.196:6812/1866932410' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:58.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[42114]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[32847]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-10-08T19:24:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[32847]: osdmap e49: 8 total, 7 up, 8 in 2021-10-08T19:24:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[32847]: from='osd.7 v2:172.21.15.196:6812/1866932410' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:58 smithi157 ceph-mon[32847]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:58.366 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:24:58 smithi196 conmon[53867]: 2021-10-08T19:24:58.113+0000 7f650767b700 -1 osd.7 0 waiting for initial osdmap 2021-10-08T19:24:58.367 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:24:58 smithi196 conmon[53867]: 2021-10-08T19:24:58.122+0000 7f650000e700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:24:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:58 smithi196 ceph-mon[34258]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-10-08T19:24:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:58 smithi196 ceph-mon[34258]: osdmap e49: 8 total, 7 up, 8 in 2021-10-08T19:24:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:58 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:58 smithi196 ceph-mon[34258]: from='osd.7 v2:172.21.15.196:6812/1866932410' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:58 smithi196 ceph-mon[34258]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2021-10-08T19:24:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 -- 172.21.15.157:0/1242797283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f8780 msgr2=0x7f1c940f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/1242797283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f8780 0x7f1c940f8bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1c880046e0 tx=0x7f1c88009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 -- 172.21.15.157:0/1242797283 shutdown_connections 2021-10-08T19:24:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/1242797283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c940f9110 0x7f1c940ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/1242797283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c940f74e0 0x7f1c940f78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/1242797283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f8780 0x7f1c940f8bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 -- 172.21.15.157:0/1242797283 >> 172.21.15.157:0/1242797283 conn(0x7f1c940f2cd0 msgr2=0x7f1c940f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:59.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 -- 172.21.15.157:0/1242797283 shutdown_connections 2021-10-08T19:24:59.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 -- 172.21.15.157:0/1242797283 wait complete. 2021-10-08T19:24:59.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 Processor -- start 2021-10-08T19:24:59.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.338+0000 7f1c9a72a700 1 -- start start 2021-10-08T19:24:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c9a72a700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f74e0 0x7f1c941088d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c9a72a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c940f8780 0x7f1c94108e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c9a72a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c940f9110 0x7f1c9410fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c9a72a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c941103e0 con 0x7f1c940f8780 2021-10-08T19:24:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c9a72a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c94110550 con 0x7f1c940f9110 2021-10-08T19:24:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c9a72a700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c94110710 con 0x7f1c940f74e0 2021-10-08T19:24:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c93fff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f74e0 0x7f1c941088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c937fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c940f8780 0x7f1c94108e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c93fff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f74e0 0x7f1c941088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49382/0 (socket says 172.21.15.157:49382) 2021-10-08T19:24:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c937fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c940f8780 0x7f1c94108e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40136/0 (socket says 172.21.15.157:40136) 2021-10-08T19:24:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c93fff700 1 -- 172.21.15.157:0/2003851891 learned_addr learned my addr 172.21.15.157:0/2003851891 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:24:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c98cc7700 1 --2- 172.21.15.157:0/2003851891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c940f9110 0x7f1c9410fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c93fff700 1 -- 172.21.15.157:0/2003851891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c940f9110 msgr2=0x7f1c9410fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c93fff700 1 --2- 172.21.15.157:0/2003851891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c940f9110 0x7f1c9410fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c93fff700 1 -- 172.21.15.157:0/2003851891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c940f8780 msgr2=0x7f1c94108e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c93fff700 1 --2- 172.21.15.157:0/2003851891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c940f8780 0x7f1c94108e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c93fff700 1 -- 172.21.15.157:0/2003851891 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c88005040 con 0x7f1c940f74e0 2021-10-08T19:24:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c93fff700 1 --2- 172.21.15.157:0/2003851891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f74e0 0x7f1c941088d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e840 tx=0x7f1c8400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c90ff9700 1 -- 172.21.15.157:0/2003851891 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840092e0 con 0x7f1c940f74e0 2021-10-08T19:24:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c90ff9700 1 -- 172.21.15.157:0/2003851891 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f1c8400f040 con 0x7f1c940f74e0 2021-10-08T19:24:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c94110990 con 0x7f1c940f74e0 2021-10-08T19:24:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c90ff9700 1 -- 172.21.15.157:0/2003851891 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840146f0 con 0x7f1c940f74e0 2021-10-08T19:24:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.339+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c94110f00 con 0x7f1c940f74e0 2021-10-08T19:24:59.349 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.340+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c94103560 con 0x7f1c940f74e0 2021-10-08T19:24:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.341+0000 7f1c90ff9700 1 -- 172.21.15.157:0/2003851891 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7f1c8401b030 con 0x7f1c940f74e0 2021-10-08T19:24:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.341+0000 7f1c90ff9700 1 --2- 172.21.15.157:0/2003851891 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1c7c0634c0 0x7f1c7c065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.341+0000 7f1c937fe700 1 --2- 172.21.15.157:0/2003851891 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1c7c0634c0 0x7f1c7c065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.341+0000 7f1c90ff9700 1 -- 172.21.15.157:0/2003851891 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f1c8407ec50 con 0x7f1c940f74e0 2021-10-08T19:24:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.342+0000 7f1c937fe700 1 --2- 172.21.15.157:0/2003851891 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1c7c0634c0 0x7f1c7c065970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1c880046b0 tx=0x7f1c88009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.345+0000 7f1c90ff9700 1 -- 172.21.15.157:0/2003851891 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1c84052050 con 0x7f1c940f74e0 2021-10-08T19:24:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:59 smithi196 ceph-mon[34258]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:59 smithi196 ceph-mon[34258]: osdmap e50: 8 total, 7 up, 8 in 2021-10-08T19:24:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:59 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:59 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:59.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:59 smithi196 ceph-mon[34258]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:59.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:59 smithi196 ceph-mon[34258]: osd.7 v2:172.21.15.196:6812/1866932410 boot 2021-10-08T19:24:59.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:59 smithi196 ceph-mon[34258]: osdmap e51: 8 total, 8 up, 8 in 2021-10-08T19:24:59.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:24:59 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.506+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f1c940289c0 con 0x7f1c940f74e0 2021-10-08T19:24:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.506+0000 7f1c90ff9700 1 -- 172.21.15.157:0/2003851891 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v51) v1 ==== 74+0+130 (secure 0 0 0) 0x7f1c84019020 con 0x7f1c940f74e0 2021-10-08T19:24:59.507 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:24:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.508+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1c7c0634c0 msgr2=0x7f1c7c065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.508+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/2003851891 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1c7c0634c0 0x7f1c7c065970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1c880046b0 tx=0x7f1c88009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.508+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f74e0 msgr2=0x7f1c941088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.508+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/2003851891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f74e0 0x7f1c941088d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e840 tx=0x7f1c8400b040 comp rx=0 tx=0).stop 2021-10-08T19:24:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.509+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 shutdown_connections 2021-10-08T19:24:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.509+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/2003851891 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1c7c0634c0 0x7f1c7c065970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.509+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/2003851891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c940f9110 0x7f1c9410fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.509+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/2003851891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c940f74e0 0x7f1c941088d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.509+0000 7f1c9a72a700 1 --2- 172.21.15.157:0/2003851891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c940f8780 0x7f1c94108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.509+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 >> 172.21.15.157:0/2003851891 conn(0x7f1c940f2cd0 msgr2=0x7f1c940f4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.509+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 shutdown_connections 2021-10-08T19:24:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:24:59.509+0000 7f1c9a72a700 1 -- 172.21.15.157:0/2003851891 wait complete. 2021-10-08T19:24:59.538 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[42114]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:59.538 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[42114]: osdmap e50: 8 total, 7 up, 8 in 2021-10-08T19:24:59.538 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:59.539 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:59.539 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[42114]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:59.539 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[42114]: osd.7 v2:172.21.15.196:6812/1866932410 boot 2021-10-08T19:24:59.539 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[42114]: osdmap e51: 8 total, 8 up, 8 in 2021-10-08T19:24:59.539 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:59.540 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[32847]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2021-10-08T19:24:59.540 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[32847]: osdmap e50: 8 total, 7 up, 8 in 2021-10-08T19:24:59.540 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:59.540 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:24:59.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[32847]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:24:59.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[32847]: osd.7 v2:172.21.15.196:6812/1866932410 boot 2021-10-08T19:24:59.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[32847]: osdmap e51: 8 total, 8 up, 8 in 2021-10-08T19:24:59.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:24:59 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:00.078 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1633721098,"num_in_osds":8,"osd_in_since":1633721083,"num_remapped_pgs":1} 2021-10-08T19:25:00.079 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi157 2021-10-08T19:25:00.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch apply rgw foo.a --placement '1;smithi157=foo.a' 2021-10-08T19:25:00.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:00 smithi157 ceph-mon[42114]: purged_snaps scrub starts 2021-10-08T19:25:00.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:00 smithi157 ceph-mon[42114]: purged_snaps scrub ok 2021-10-08T19:25:00.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2003851891' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:25:00.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:00 smithi157 ceph-mon[42114]: osdmap e52: 8 total, 8 up, 8 in 2021-10-08T19:25:00.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:00 smithi157 ceph-mon[32847]: purged_snaps scrub starts 2021-10-08T19:25:00.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:00 smithi157 ceph-mon[32847]: purged_snaps scrub ok 2021-10-08T19:25:00.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2003851891' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:25:00.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:00 smithi157 ceph-mon[32847]: osdmap e52: 8 total, 8 up, 8 in 2021-10-08T19:25:00.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:00 smithi196 ceph-mon[34258]: purged_snaps scrub starts 2021-10-08T19:25:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:00 smithi196 ceph-mon[34258]: purged_snaps scrub ok 2021-10-08T19:25:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2003851891' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:25:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:00 smithi196 ceph-mon[34258]: osdmap e52: 8 total, 8 up, 8 in 2021-10-08T19:25:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:01 smithi196 ceph-mon[34258]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:01 smithi196 ceph-mon[34258]: osdmap e53: 8 total, 8 up, 8 in 2021-10-08T19:25:01.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:01 smithi157 ceph-mon[32847]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:01.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:01 smithi157 ceph-mon[32847]: osdmap e53: 8 total, 8 up, 8 in 2021-10-08T19:25:01.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:01 smithi157 ceph-mon[42114]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:01.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:01 smithi157 ceph-mon[42114]: osdmap e53: 8 total, 8 up, 8 in 2021-10-08T19:25:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.766+0000 7fcdb1319700 1 -- 172.21.15.196:0/681152906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f74b0 msgr2=0x7fcdac0f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.766+0000 7fcdb1319700 1 --2- 172.21.15.196:0/681152906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f74b0 0x7fcdac0f78c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0046e0 tx=0x7fcd9c009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.766+0000 7fcdb1319700 1 -- 172.21.15.196:0/681152906 shutdown_connections 2021-10-08T19:25:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.766+0000 7fcdb1319700 1 --2- 172.21.15.196:0/681152906 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdac0f90e0 0x7fcdac0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.766+0000 7fcdb1319700 1 --2- 172.21.15.196:0/681152906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f74b0 0x7fcdac0f78c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.766+0000 7fcdb1319700 1 --2- 172.21.15.196:0/681152906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac0f8750 0x7fcdac0f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.766+0000 7fcdb1319700 1 -- 172.21.15.196:0/681152906 >> 172.21.15.196:0/681152906 conn(0x7fcdac0f2ca0 msgr2=0x7fcdac0f50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.766+0000 7fcdb1319700 1 -- 172.21.15.196:0/681152906 shutdown_connections 2021-10-08T19:25:02.770 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.766+0000 7fcdb1319700 1 -- 172.21.15.196:0/681152906 wait complete. 2021-10-08T19:25:02.770 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdb1319700 1 Processor -- start 2021-10-08T19:25:02.770 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdb1319700 1 -- start start 2021-10-08T19:25:02.770 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdb1319700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdac0f74b0 0x7fcdac108970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:02.770 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdb1319700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f8750 0x7fcdac108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:02.771 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdb1319700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac0f90e0 0x7fcdac10ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:02.771 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdb1319700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac110510 con 0x7fcdac0f90e0 2021-10-08T19:25:02.771 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdb1319700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac110680 con 0x7fcdac0f8750 2021-10-08T19:25:02.771 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdb1319700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac110840 con 0x7fcdac0f74b0 2021-10-08T19:25:02.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaa7fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f8750 0x7fcdac108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:02.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaa7fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f8750 0x7fcdac108eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49280/0 (socket says 172.21.15.196:49280) 2021-10-08T19:25:02.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaa7fc700 1 -- 172.21.15.196:0/3787912582 learned_addr learned my addr 172.21.15.196:0/3787912582 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:25:02.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaaffd700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdac0f74b0 0x7fcdac108970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:02.772 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdab7fe700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac0f90e0 0x7fcdac10ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:02.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaa7fc700 1 -- 172.21.15.196:0/3787912582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdac0f74b0 msgr2=0x7fcdac108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:02.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaa7fc700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdac0f74b0 0x7fcdac108970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaa7fc700 1 -- 172.21.15.196:0/3787912582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac0f90e0 msgr2=0x7fcdac10ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:02.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaa7fc700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac0f90e0 0x7fcdac10ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.773 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaa7fc700 1 -- 172.21.15.196:0/3787912582 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c005040 con 0x7fcdac0f8750 2021-10-08T19:25:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdab7fe700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac0f90e0 0x7fcdac10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:25:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.767+0000 7fcdaa7fc700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f8750 0x7fcdac108eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcda000b490 tx=0x7fcda0006ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.768+0000 7fcd937fe700 1 -- 172.21.15.196:0/3787912582 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000f510 con 0x7fcdac0f8750 2021-10-08T19:25:02.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.768+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac110b20 con 0x7fcdac0f8750 2021-10-08T19:25:02.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.768+0000 7fcd937fe700 1 -- 172.21.15.196:0/3787912582 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fcda000faf0 con 0x7fcdac0f8750 2021-10-08T19:25:02.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.768+0000 7fcd937fe700 1 -- 172.21.15.196:0/3787912582 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011ae0 con 0x7fcdac0f8750 2021-10-08T19:25:02.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.768+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac111060 con 0x7fcdac0f8750 2021-10-08T19:25:02.778 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.769+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0289c0 con 0x7fcdac0f8750 2021-10-08T19:25:02.778 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.769+0000 7fcd937fe700 1 -- 172.21.15.196:0/3787912582 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7fcda0017020 con 0x7fcdac0f8750 2021-10-08T19:25:02.778 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.769+0000 7fcd937fe700 1 --2- 172.21.15.196:0/3787912582 >> v2:172.21.15.157:6800/3606206634 conn(0x7fcd940634c0 0x7fcd94065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:02.778 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.769+0000 7fcd937fe700 1 -- 172.21.15.196:0/3787912582 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4061+0+0 (secure 0 0 0) 0x7fcda007e7c0 con 0x7fcdac0f8750 2021-10-08T19:25:02.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.770+0000 7fcdaaffd700 1 --2- 172.21.15.196:0/3787912582 >> v2:172.21.15.157:6800/3606206634 conn(0x7fcd940634c0 0x7fcd94065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:02.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.770+0000 7fcdaaffd700 1 --2- 172.21.15.196:0/3787912582 >> v2:172.21.15.157:6800/3606206634 conn(0x7fcd940634c0 0x7fcd94065970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0046b0 tx=0x7fcd9c009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:02.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.774+0000 7fcd937fe700 1 -- 172.21.15.196:0/3787912582 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fcda0045b00 con 0x7fcdac0f8750 2021-10-08T19:25:02.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:02 smithi196 ceph-mon[34258]: osdmap e54: 8 total, 8 up, 8 in 2021-10-08T19:25:02.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:02 smithi196 ceph-mon[34258]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.968+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi157=foo.a", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdac059800 con 0x7fcd940634c0 2021-10-08T19:25:02.975 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.976+0000 7fcd937fe700 1 -- 172.21.15.196:0/3787912582 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (secure 0 0 0) 0x7fcdac059800 con 0x7fcd940634c0 2021-10-08T19:25:02.976 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled rgw.foo.a update... 2021-10-08T19:25:02.977 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 >> v2:172.21.15.157:6800/3606206634 conn(0x7fcd940634c0 msgr2=0x7fcd94065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:02.978 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 --2- 172.21.15.196:0/3787912582 >> v2:172.21.15.157:6800/3606206634 conn(0x7fcd940634c0 0x7fcd94065970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0046b0 tx=0x7fcd9c009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:02.978 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f8750 msgr2=0x7fcdac108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:02.978 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f8750 0x7fcdac108eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcda000b490 tx=0x7fcda0006ef0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.978 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 shutdown_connections 2021-10-08T19:25:02.979 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 --2- 172.21.15.196:0/3787912582 >> v2:172.21.15.157:6800/3606206634 conn(0x7fcd940634c0 0x7fcd94065970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.979 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac0f90e0 0x7fcdac10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.979 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdac0f74b0 0x7fcdac108970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.979 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 --2- 172.21.15.196:0/3787912582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac0f8750 0x7fcdac108eb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:02.980 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 >> 172.21.15.196:0/3787912582 conn(0x7fcdac0f2ca0 msgr2=0x7fcdac0f4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:02.980 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 shutdown_connections 2021-10-08T19:25:02.980 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:02.978+0000 7fcdb1319700 1 -- 172.21.15.196:0/3787912582 wait complete. 2021-10-08T19:25:03.027 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:02 smithi157 ceph-mon[32847]: osdmap e54: 8 total, 8 up, 8 in 2021-10-08T19:25:03.027 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:02 smithi157 ceph-mon[32847]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:03.027 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:02 smithi157 ceph-mon[42114]: osdmap e54: 8 total, 8 up, 8 in 2021-10-08T19:25:03.028 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:02 smithi157 ceph-mon[42114]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:03.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: osdmap e55: 8 total, 8 up, 8 in 2021-10-08T19:25:03.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi157=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:03.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: Saving service rgw.foo.a spec with placement smithi157=foo.a;count:1 2021-10-08T19:25:03.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:03.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:03.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:03.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: Saving service rgw.foo.a spec with placement smithi157=foo.a;count:1 2021-10-08T19:25:03.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-10-08T19:25:03.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-10-08T19:25:03.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:03.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: Deploying daemon rgw.foo.a on smithi157 2021-10-08T19:25:03.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[32847]: poll took 9567.239 ms: 1 events 2021-10-08T19:25:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: osdmap e55: 8 total, 8 up, 8 in 2021-10-08T19:25:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi157=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: Saving service rgw.foo.a spec with placement smithi157=foo.a;count:1 2021-10-08T19:25:03.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:03.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:03.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:03.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: Saving service rgw.foo.a spec with placement smithi157=foo.a;count:1 2021-10-08T19:25:03.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-10-08T19:25:03.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-10-08T19:25:03.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:03.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: Deploying daemon rgw.foo.a on smithi157 2021-10-08T19:25:03.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:03 smithi157 ceph-mon[42114]: poll took 9567.239 ms: 1 events 2021-10-08T19:25:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: osdmap e55: 8 total, 8 up, 8 in 2021-10-08T19:25:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi157=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:03.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: Saving service rgw.foo.a spec with placement smithi157=foo.a;count:1 2021-10-08T19:25:03.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:03.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:03.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:03.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: Saving service rgw.foo.a spec with placement smithi157=foo.a;count:1 2021-10-08T19:25:03.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-10-08T19:25:03.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-10-08T19:25:03.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:03.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:03.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: Deploying daemon rgw.foo.a on smithi157 2021-10-08T19:25:03.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:03 smithi196 ceph-mon[34258]: poll took 9567.239 ms: 1 events 2021-10-08T19:25:04.242 DEBUG:teuthology.orchestra.run.smithi157:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@rgw.foo.a.service 2021-10-08T19:25:04.245 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi196 2021-10-08T19:25:04.245 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd pool create iscsi 3 3 replicated 2021-10-08T19:25:04.270 INFO:journalctl@ceph.rgw.foo.a.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:25:04.526 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:04 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:25:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:04.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:04 smithi157 ceph-mon[32847]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 123 KiB/s, 0 objects/s recovering 2021-10-08T19:25:04.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:04 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:04.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:04 smithi157 ceph-mon[42114]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 123 KiB/s, 0 objects/s recovering 2021-10-08T19:25:04.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:04 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:04.829 INFO:journalctl@ceph.rgw.foo.a.smithi157.stdout:Oct 08 19:25:04 smithi157 systemd[1]: Starting Ceph rgw.foo.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:25:04.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:04 smithi196 ceph-mon[34258]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 123 KiB/s, 0 objects/s recovering 2021-10-08T19:25:04.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:04 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:05.728 INFO:journalctl@ceph.rgw.foo.a.smithi157.stdout:Oct 08 19:25:05 smithi157 bash[64589]: bb67a9e37d1bfeab53d41b97b18565827eab7a70b1551c31d631dcea61e375a4 2021-10-08T19:25:05.728 INFO:journalctl@ceph.rgw.foo.a.smithi157.stdout:Oct 08 19:25:05 smithi157 systemd[1]: Started Ceph rgw.foo.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:25:06.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:05 smithi157 ceph-mon[32847]: Detected new or changed devices on smithi196 2021-10-08T19:25:06.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:05 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:25:06.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:05 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:25:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:06.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:05 smithi157 ceph-mon[32847]: poll took 1152.257 ms: 1 events 2021-10-08T19:25:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:05 smithi157 ceph-mon[42114]: Detected new or changed devices on smithi196 2021-10-08T19:25:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:05 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:25:06.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:05 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:25:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:06.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:05 smithi157 ceph-mon[42114]: poll took 1152.257 ms: 1 events 2021-10-08T19:25:06.095 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.094+0000 7fd9e359e700 1 -- 172.21.15.196:0/3605903472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 msgr2=0x7fd9e40f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:06.096 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.094+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3605903472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 0x7fd9e40f6bb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40046e0 tx=0x7fd9d4009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:06.096 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.094+0000 7fd9e359e700 1 -- 172.21.15.196:0/3605903472 shutdown_connections 2021-10-08T19:25:06.096 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.094+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3605903472 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40f9f30 0x7fd9e4100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:06.097 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.094+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3605903472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 0x7fd9e40f6bb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:06.097 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.094+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3605903472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e40f7180 0x7fd9e40f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:06.097 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.094+0000 7fd9e359e700 1 -- 172.21.15.196:0/3605903472 >> 172.21.15.196:0/3605903472 conn(0x7fd9e40f22b0 msgr2=0x7fd9e40f46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:06.097 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.094+0000 7fd9e359e700 1 -- 172.21.15.196:0/3605903472 shutdown_connections 2021-10-08T19:25:06.098 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.094+0000 7fd9e359e700 1 -- 172.21.15.196:0/3605903472 wait complete. 2021-10-08T19:25:06.098 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e359e700 1 Processor -- start 2021-10-08T19:25:06.098 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e359e700 1 -- start start 2021-10-08T19:25:06.098 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e359e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 0x7fd9e4108a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:06.098 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e359e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40f7180 0x7fd9e4108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:06.099 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e40f9f30 0x7fd9e4109e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:06.099 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e410a420 con 0x7fd9e40f9f30 2021-10-08T19:25:06.099 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e359e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e410a590 con 0x7fd9e40f67a0 2021-10-08T19:25:06.099 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e359e700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e410a750 con 0x7fd9e40f7180 2021-10-08T19:25:06.100 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e259c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 0x7fd9e4108a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:06.100 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e259c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 0x7fd9e4108a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49292/0 (socket says 172.21.15.196:49292) 2021-10-08T19:25:06.100 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e259c700 1 -- 172.21.15.196:0/3741620225 learned_addr learned my addr 172.21.15.196:0/3741620225 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:25:06.100 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e2d9d700 1 --2- 172.21.15.196:0/3741620225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e40f9f30 0x7fd9e4109e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:06.100 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e1d9b700 1 --2- 172.21.15.196:0/3741620225 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40f7180 0x7fd9e4108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:06.101 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e259c700 1 -- 172.21.15.196:0/3741620225 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40f7180 msgr2=0x7fd9e4108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:06.101 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e259c700 1 --2- 172.21.15.196:0/3741620225 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40f7180 0x7fd9e4108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:06.101 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e259c700 1 -- 172.21.15.196:0/3741620225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e40f9f30 msgr2=0x7fd9e4109e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:06.101 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e259c700 1 --2- 172.21.15.196:0/3741620225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e40f9f30 0x7fd9e4109e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:06.101 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e259c700 1 -- 172.21.15.196:0/3741620225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d4005040 con 0x7fd9e40f67a0 2021-10-08T19:25:06.102 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.095+0000 7fd9e259c700 1 --2- 172.21.15.196:0/3741620225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 0x7fd9e4108a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4004d50 tx=0x7fd9d4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:06.102 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.096+0000 7fd9d2ffd700 1 -- 172.21.15.196:0/3741620225 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d401a070 con 0x7fd9e40f67a0 2021-10-08T19:25:06.102 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.096+0000 7fd9d2ffd700 1 -- 172.21.15.196:0/3741620225 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fd9d4007920 con 0x7fd9e40f67a0 2021-10-08T19:25:06.102 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.096+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e410a9d0 con 0x7fd9e40f67a0 2021-10-08T19:25:06.103 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.096+0000 7fd9d2ffd700 1 -- 172.21.15.196:0/3741620225 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d401e7a0 con 0x7fd9e40f67a0 2021-10-08T19:25:06.103 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.096+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e4111210 con 0x7fd9e40f67a0 2021-10-08T19:25:06.104 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.097+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e40472f0 con 0x7fd9e40f67a0 2021-10-08T19:25:06.104 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.097+0000 7fd9d2ffd700 1 -- 172.21.15.196:0/3741620225 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7fd9d401ebd0 con 0x7fd9e40f67a0 2021-10-08T19:25:06.104 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.097+0000 7fd9d2ffd700 1 --2- 172.21.15.196:0/3741620225 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd9cc063400 0x7fd9cc0658b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:06.105 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.097+0000 7fd9d2ffd700 1 -- 172.21.15.196:0/3741620225 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4409+0+0 (secure 0 0 0) 0x7fd9d407fa10 con 0x7fd9e40f67a0 2021-10-08T19:25:06.105 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.098+0000 7fd9e1d9b700 1 --2- 172.21.15.196:0/3741620225 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd9cc063400 0x7fd9cc0658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:06.105 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.098+0000 7fd9e1d9b700 1 --2- 172.21.15.196:0/3741620225 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd9cc063400 0x7fd9cc0658b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009fd0 tx=0x7fd9d800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:06.105 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.101+0000 7fd9d2ffd700 1 -- 172.21.15.196:0/3741620225 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fd9d4052e40 con 0x7fd9e40f67a0 2021-10-08T19:25:06.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:05 smithi196 ceph-mon[34258]: Detected new or changed devices on smithi196 2021-10-08T19:25:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:05 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:25:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:05 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:25:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:05 smithi196 ceph-mon[34258]: poll took 1152.257 ms: 1 events 2021-10-08T19:25:06.258 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.258+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7fd9e40289c0 con 0x7fd9e40f67a0 2021-10-08T19:25:06.785 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.785+0000 7fd9d2ffd700 1 -- 172.21.15.196:0/3741620225 <== mon.2 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'iscsi' created v57) v1 ==== 154+0+0 (secure 0 0 0) 0x7fd9d4023070 con 0x7fd9e40f67a0 2021-10-08T19:25:06.795 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.796+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd9cc063400 msgr2=0x7fd9cc0658b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.796+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3741620225 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd9cc063400 0x7fd9cc0658b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009fd0 tx=0x7fd9d800b040 comp rx=0 tx=0).stop 2021-10-08T19:25:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.796+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 msgr2=0x7fd9e4108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.796+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3741620225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 0x7fd9e4108a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4004d50 tx=0x7fd9d4009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:06.797 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.797+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 shutdown_connections 2021-10-08T19:25:06.797 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.797+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3741620225 >> v2:172.21.15.157:6800/3606206634 conn(0x7fd9cc063400 0x7fd9cc0658b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:06.797 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.797+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3741620225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e40f9f30 0x7fd9e4109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:06.798 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.797+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3741620225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9e40f67a0 0x7fd9e4108a20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:06.798 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.797+0000 7fd9e359e700 1 --2- 172.21.15.196:0/3741620225 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40f7180 0x7fd9e4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:06.798 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.797+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 >> 172.21.15.196:0/3741620225 conn(0x7fd9e40f22b0 msgr2=0x7fd9e40fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:06.801 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.802+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 shutdown_connections 2021-10-08T19:25:06.801 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:06.802+0000 7fd9e359e700 1 -- 172.21.15.196:0/3741620225 wait complete. 2021-10-08T19:25:06.802 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'iscsi' created 2021-10-08T19:25:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: poll took 1001.937 ms: 1 events 2021-10-08T19:25:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:07.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: Sending message to agent on host smithi157 2021-10-08T19:25:07.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:07.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:07.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:07.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: Checking dashboard <-> RGW credentials 2021-10-08T19:25:07.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: osdmap e56: 8 total, 8 up, 8 in 2021-10-08T19:25:07.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3080745965' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:25:07.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:25:07.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/3741620225' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:25:07.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:25:07.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi157 2021-10-08T19:25:07.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[32847]: pgmap v174: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2021-10-08T19:25:07.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: poll took 1001.937 ms: 1 events 2021-10-08T19:25:07.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:07.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: Sending message to agent on host smithi157 2021-10-08T19:25:07.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:07.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:07.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:07.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: Checking dashboard <-> RGW credentials 2021-10-08T19:25:07.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: osdmap e56: 8 total, 8 up, 8 in 2021-10-08T19:25:07.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3080745965' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:25:07.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:25:07.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/3741620225' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:25:07.090 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:25:07.090 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi157 2021-10-08T19:25:07.091 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:06 smithi157 ceph-mon[42114]: pgmap v174: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2021-10-08T19:25:07.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: poll took 1001.937 ms: 1 events 2021-10-08T19:25:07.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:07.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: Sending message to agent on host smithi157 2021-10-08T19:25:07.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:07.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:07.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:07.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: Checking dashboard <-> RGW credentials 2021-10-08T19:25:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: osdmap e56: 8 total, 8 up, 8 in 2021-10-08T19:25:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3080745965' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:25:07.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:25:07.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/3741620225' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:25:07.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:25:07.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi157 2021-10-08T19:25:07.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:06 smithi196 ceph-mon[34258]: pgmap v174: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2021-10-08T19:25:07.524 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd pool application enable iscsi rbd 2021-10-08T19:25:08.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:25:08.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-10-08T19:25:08.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:07 smithi157 ceph-mon[32847]: osdmap e57: 8 total, 8 up, 8 in 2021-10-08T19:25:08.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:25:08.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-10-08T19:25:08.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:07 smithi157 ceph-mon[42114]: osdmap e57: 8 total, 8 up, 8 in 2021-10-08T19:25:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:25:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-10-08T19:25:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:07 smithi196 ceph-mon[34258]: osdmap e57: 8 total, 8 up, 8 in 2021-10-08T19:25:09.065 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:08 smithi196 ceph-mon[34258]: osdmap e58: 8 total, 8 up, 8 in 2021-10-08T19:25:09.066 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3484193302' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.066 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3080745965' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.066 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:08 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.067 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.067 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:08 smithi196 ceph-mon[34258]: pgmap v177: 68 pgs: 58 unknown, 10 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 719 B/s rd, 179 B/s wr, 0 op/s; 101 KiB/s, 0 objects/s recovering 2021-10-08T19:25:09.067 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:08 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:25:09.067 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:25:09.067 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:08 smithi196 ceph-mon[34258]: osdmap e59: 8 total, 8 up, 8 in 2021-10-08T19:25:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[32847]: osdmap e58: 8 total, 8 up, 8 in 2021-10-08T19:25:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3484193302' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3080745965' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[32847]: pgmap v177: 68 pgs: 58 unknown, 10 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 719 B/s rd, 179 B/s wr, 0 op/s; 101 KiB/s, 0 objects/s recovering 2021-10-08T19:25:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:25:09.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:25:09.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[32847]: osdmap e59: 8 total, 8 up, 8 in 2021-10-08T19:25:09.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[42114]: osdmap e58: 8 total, 8 up, 8 in 2021-10-08T19:25:09.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3484193302' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3080745965' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:25:09.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[42114]: pgmap v177: 68 pgs: 58 unknown, 10 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 719 B/s rd, 179 B/s wr, 0 op/s; 101 KiB/s, 0 objects/s recovering 2021-10-08T19:25:09.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:25:09.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:25:09.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:08 smithi157 ceph-mon[42114]: osdmap e59: 8 total, 8 up, 8 in 2021-10-08T19:25:09.278 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 -- 172.21.15.196:0/3430686414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 msgr2=0x7f12340f89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:09.282 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 --2- 172.21.15.196:0/3430686414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 0x7f12340f89c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1224009a60 tx=0x7f1224004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:09.282 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 -- 172.21.15.196:0/3430686414 shutdown_connections 2021-10-08T19:25:09.283 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 --2- 172.21.15.196:0/3430686414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12340fa1e0 0x7f1234100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:09.283 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 --2- 172.21.15.196:0/3430686414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 0x7f12340f89c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:09.284 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 --2- 172.21.15.196:0/3430686414 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12340f9850 0x7f12340f9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:09.284 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 -- 172.21.15.196:0/3430686414 >> 172.21.15.196:0/3430686414 conn(0x7f12340f3d80 msgr2=0x7f12340f61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:09.285 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 -- 172.21.15.196:0/3430686414 shutdown_connections 2021-10-08T19:25:09.286 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 -- 172.21.15.196:0/3430686414 wait complete. 2021-10-08T19:25:09.287 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 Processor -- start 2021-10-08T19:25:09.287 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.275+0000 7f12397d0700 1 -- start start 2021-10-08T19:25:09.287 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f12397d0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 0x7f1234108900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:09.288 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f12397d0700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12340f9850 0x7f1234108e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:09.289 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f12397d0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12340fa1e0 0x7f123410fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:09.289 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f12397d0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1234110410 con 0x7f12340fa1e0 2021-10-08T19:25:09.290 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f12397d0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1234110580 con 0x7f12340f85b0 2021-10-08T19:25:09.291 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f12397d0700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1234110740 con 0x7f12340f9850 2021-10-08T19:25:09.291 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f1232ffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 0x7f1234108900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:09.292 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f1232ffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 0x7f1234108900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49306/0 (socket says 172.21.15.196:49306) 2021-10-08T19:25:09.292 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f1232ffd700 1 -- 172.21.15.196:0/4192110485 learned_addr learned my addr 172.21.15.196:0/4192110485 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:25:09.293 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f12327fc700 1 --2- 172.21.15.196:0/4192110485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12340f9850 0x7f1234108e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:09.293 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f12337fe700 1 --2- 172.21.15.196:0/4192110485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12340fa1e0 0x7f123410fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:09.293 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f1232ffd700 1 -- 172.21.15.196:0/4192110485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12340f9850 msgr2=0x7f1234108e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:09.293 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f1232ffd700 1 --2- 172.21.15.196:0/4192110485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12340f9850 0x7f1234108e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:09.294 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f1232ffd700 1 -- 172.21.15.196:0/4192110485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12340fa1e0 msgr2=0x7f123410fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:09.294 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f1232ffd700 1 --2- 172.21.15.196:0/4192110485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12340fa1e0 0x7f123410fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:09.294 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f1232ffd700 1 -- 172.21.15.196:0/4192110485 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009640 con 0x7f12340f85b0 2021-10-08T19:25:09.294 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f1232ffd700 1 --2- 172.21.15.196:0/4192110485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 0x7f1234108900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1224015040 tx=0x7f1224004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:09.295 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f122b7fe700 1 -- 172.21.15.196:0/4192110485 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400e030 con 0x7f12340f85b0 2021-10-08T19:25:09.296 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f122b7fe700 1 -- 172.21.15.196:0/4192110485 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f12240049b0 con 0x7f12340f85b0 2021-10-08T19:25:09.296 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12341109c0 con 0x7f12340f85b0 2021-10-08T19:25:09.296 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.276+0000 7f122b7fe700 1 -- 172.21.15.196:0/4192110485 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122401cca0 con 0x7f12340f85b0 2021-10-08T19:25:09.297 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.277+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1234110f00 con 0x7f12340f85b0 2021-10-08T19:25:09.297 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.277+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12340289c0 con 0x7f12340f85b0 2021-10-08T19:25:09.297 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.278+0000 7f122b7fe700 1 -- 172.21.15.196:0/4192110485 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7f122402c070 con 0x7f12340f85b0 2021-10-08T19:25:09.297 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.278+0000 7f122b7fe700 1 --2- 172.21.15.196:0/4192110485 >> v2:172.21.15.157:6800/3606206634 conn(0x7f12200634c0 0x7f1220065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:09.297 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.278+0000 7f122b7fe700 1 -- 172.21.15.196:0/4192110485 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5129+0+0 (secure 0 0 0) 0x7f12240813c0 con 0x7f12340f85b0 2021-10-08T19:25:09.298 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.278+0000 7f12327fc700 1 --2- 172.21.15.196:0/4192110485 >> v2:172.21.15.157:6800/3606206634 conn(0x7f12200634c0 0x7f1220065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:09.299 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.279+0000 7f12327fc700 1 --2- 172.21.15.196:0/4192110485 >> v2:172.21.15.157:6800/3606206634 conn(0x7f12200634c0 0x7f1220065970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f121c004ce0 tx=0x7f121c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:09.299 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.282+0000 7f122b7fe700 1 -- 172.21.15.196:0/4192110485 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1224054300 con 0x7f12340f85b0 2021-10-08T19:25:09.445 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.445+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"} v 0) v1 -- 0x7f12340ff9b0 con 0x7f12340f85b0 2021-10-08T19:25:09.791 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.790+0000 7f122b7fe700 1 -- 172.21.15.196:0/4192110485 <== mon.2 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]=0 enabled application 'rbd' on pool 'iscsi' v60) v1 ==== 147+0+0 (secure 0 0 0) 0x7f1224053ef0 con 0x7f12340f85b0 2021-10-08T19:25:09.794 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.793+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 >> v2:172.21.15.157:6800/3606206634 conn(0x7f12200634c0 msgr2=0x7f1220065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:09.794 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.793+0000 7f12397d0700 1 --2- 172.21.15.196:0/4192110485 >> v2:172.21.15.157:6800/3606206634 conn(0x7f12200634c0 0x7f1220065970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f121c004ce0 tx=0x7f121c00b040 comp rx=0 tx=0).stop 2021-10-08T19:25:09.795 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.793+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 msgr2=0x7f1234108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:09.795 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.793+0000 7f12397d0700 1 --2- 172.21.15.196:0/4192110485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 0x7f1234108900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1224015040 tx=0x7f1224004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:09.795 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.793+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 shutdown_connections 2021-10-08T19:25:09.795 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.793+0000 7f12397d0700 1 --2- 172.21.15.196:0/4192110485 >> v2:172.21.15.157:6800/3606206634 conn(0x7f12200634c0 0x7f1220065970 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f121c004ce0 tx=0x7f121c00b040 comp rx=0 tx=0).stop 2021-10-08T19:25:09.796 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.793+0000 7f12397d0700 1 --2- 172.21.15.196:0/4192110485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12340fa1e0 0x7f123410fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:09.796 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.794+0000 7f12397d0700 1 --2- 172.21.15.196:0/4192110485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12340f85b0 0x7f1234108900 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1224015040 tx=0x7f1224004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:09.796 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.794+0000 7f12397d0700 1 --2- 172.21.15.196:0/4192110485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12340f9850 0x7f1234108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:09.796 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.794+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 >> 172.21.15.196:0/4192110485 conn(0x7f12340f3d80 msgr2=0x7f12340fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:09.797 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.795+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 shutdown_connections 2021-10-08T19:25:09.797 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:09.795+0000 7f12397d0700 1 -- 172.21.15.196:0/4192110485 wait complete. 2021-10-08T19:25:09.798 INFO:teuthology.orchestra.run.smithi196.stderr:enabled application 'rbd' on pool 'iscsi' 2021-10-08T19:25:10.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/4192110485' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:25:10.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:25:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-10-08T19:25:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[32847]: osdmap e60: 8 total, 8 up, 8 in 2021-10-08T19:25:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3080745965' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3484193302' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/4192110485' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:25:10.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:25:10.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:10.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-10-08T19:25:10.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[42114]: osdmap e60: 8 total, 8 up, 8 in 2021-10-08T19:25:10.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3080745965' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3484193302' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:09 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/4192110485' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:25:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:25:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:09 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-10-08T19:25:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:09 smithi196 ceph-mon[34258]: osdmap e60: 8 total, 8 up, 8 in 2021-10-08T19:25:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3080745965' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3484193302' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:09 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:25:10.563 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch apply iscsi iscsi user password --placement '1;smithi196=iscsi.a' 2021-10-08T19:25:10.811 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:10 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:25:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:10.813 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:10 smithi196 ceph-mon[34258]: pgmap v180: 100 pgs: 9 creating+peering, 48 active+clean, 43 unknown; 578 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2021-10-08T19:25:10.814 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:10 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:10.814 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:25:10.815 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:10 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:25:10.815 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:10 smithi196 ceph-mon[34258]: osdmap e61: 8 total, 8 up, 8 in 2021-10-08T19:25:11.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[42114]: pgmap v180: 100 pgs: 9 creating+peering, 48 active+clean, 43 unknown; 578 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2021-10-08T19:25:11.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:11.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:25:11.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:25:11.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[42114]: osdmap e61: 8 total, 8 up, 8 in 2021-10-08T19:25:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[32847]: pgmap v180: 100 pgs: 9 creating+peering, 48 active+clean, 43 unknown; 578 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2021-10-08T19:25:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:25:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:25:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:10 smithi157 ceph-mon[32847]: osdmap e61: 8 total, 8 up, 8 in 2021-10-08T19:25:12.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[42114]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:25:12.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:25:12.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:25:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:12.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[42114]: osdmap e62: 8 total, 8 up, 8 in 2021-10-08T19:25:12.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:25:12.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3703701250' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:25:12.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:25:12.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:25:12.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:25:12.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:25:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:12.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[32847]: osdmap e62: 8 total, 8 up, 8 in 2021-10-08T19:25:12.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:25:12.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3703701250' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:25:12.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:11 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:25:12.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:11 smithi196 ceph-mon[34258]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:25:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:11 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:25:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:11 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:25:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:11 smithi196 ceph-mon[34258]: osdmap e62: 8 total, 8 up, 8 in 2021-10-08T19:25:12.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:25:12.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3703701250' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:25:12.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:11 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:25:12.469 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.466+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/1010577319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 msgr2=0x7f5e380f8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:12.470 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.466+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/1010577319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 0x7f5e380f8da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0046e0 tx=0x7f5e2c009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:12.470 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/1010577319 shutdown_connections 2021-10-08T19:25:12.470 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/1010577319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e380f92e0 0x7f5e380ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.470 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/1010577319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380f76b0 0x7f5e380f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.470 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/1010577319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 0x7f5e380f8da0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.471 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/1010577319 >> 172.21.15.196:0/1010577319 conn(0x7f5e380f2ea0 msgr2=0x7f5e380f52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:12.471 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/1010577319 shutdown_connections 2021-10-08T19:25:12.471 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/1010577319 wait complete. 2021-10-08T19:25:12.471 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 Processor -- start 2021-10-08T19:25:12.472 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 -- start start 2021-10-08T19:25:12.472 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380f76b0 0x7f5e38108c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:12.472 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 0x7f5e38109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:12.472 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e380f92e0 0x7f5e38110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:12.472 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38110710 con 0x7f5e380f76b0 2021-10-08T19:25:12.473 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38110880 con 0x7f5e380f8950 2021-10-08T19:25:12.473 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e3cdb4700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38110a40 con 0x7f5e380f92e0 2021-10-08T19:25:12.473 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e35d9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 0x7f5e38109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:12.473 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e35d9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 0x7f5e38109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49318/0 (socket says 172.21.15.196:49318) 2021-10-08T19:25:12.473 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e35d9b700 1 -- 172.21.15.196:0/889765466 learned_addr learned my addr 172.21.15.196:0/889765466 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:25:12.474 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.467+0000 7f5e36d9d700 1 --2- 172.21.15.196:0/889765466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e380f92e0 0x7f5e38110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:12.474 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e3659c700 1 --2- 172.21.15.196:0/889765466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380f76b0 0x7f5e38108c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:12.474 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e35d9b700 1 -- 172.21.15.196:0/889765466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e380f92e0 msgr2=0x7f5e38110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:12.474 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e35d9b700 1 --2- 172.21.15.196:0/889765466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e380f92e0 0x7f5e38110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.475 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e35d9b700 1 -- 172.21.15.196:0/889765466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380f76b0 msgr2=0x7f5e38108c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:12.475 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e35d9b700 1 --2- 172.21.15.196:0/889765466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380f76b0 0x7f5e38108c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.475 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e35d9b700 1 -- 172.21.15.196:0/889765466 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c005040 con 0x7f5e380f8950 2021-10-08T19:25:12.475 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e35d9b700 1 --2- 172.21.15.196:0/889765466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 0x7f5e38109140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0045a0 tx=0x7f5e2c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:12.476 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e26ffd700 1 -- 172.21.15.196:0/889765466 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00e040 con 0x7f5e380f8950 2021-10-08T19:25:12.476 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e38110cc0 con 0x7f5e380f8950 2021-10-08T19:25:12.476 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e26ffd700 1 -- 172.21.15.196:0/889765466 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f5e2c007da0 con 0x7f5e380f8950 2021-10-08T19:25:12.476 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e26ffd700 1 -- 172.21.15.196:0/889765466 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c01ca30 con 0x7f5e380f8950 2021-10-08T19:25:12.476 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.468+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e38111120 con 0x7f5e380f8950 2021-10-08T19:25:12.478 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.469+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e380600e0 con 0x7f5e380f8950 2021-10-08T19:25:12.478 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.469+0000 7f5e26ffd700 1 -- 172.21.15.196:0/889765466 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7f5e2c007920 con 0x7f5e380f8950 2021-10-08T19:25:12.478 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.470+0000 7f5e26ffd700 1 --2- 172.21.15.196:0/889765466 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5e200634c0 0x7f5e20065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:12.478 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.470+0000 7f5e26ffd700 1 -- 172.21.15.196:0/889765466 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5864+0+0 (secure 0 0 0) 0x7f5e2c080b00 con 0x7f5e380f8950 2021-10-08T19:25:12.479 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.470+0000 7f5e3659c700 1 --2- 172.21.15.196:0/889765466 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5e200634c0 0x7f5e20065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:12.479 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.470+0000 7f5e3659c700 1 --2- 172.21.15.196:0/889765466 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5e200634c0 0x7f5e20065970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e3810a0f0 tx=0x7f5e2800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:12.479 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.474+0000 7f5e26ffd700 1 -- 172.21.15.196:0/889765466 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f5e2c0538d0 con 0x7f5e380f8950 2021-10-08T19:25:12.643 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.641+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi196=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e380008d0 con 0x7f5e200634c0 2021-10-08T19:25:12.648 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.648+0000 7f5e26ffd700 1 -- 172.21.15.196:0/889765466 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f5e380008d0 con 0x7f5e200634c0 2021-10-08T19:25:12.649 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled iscsi.iscsi update... 2021-10-08T19:25:12.651 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5e200634c0 msgr2=0x7f5e20065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:12.651 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/889765466 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5e200634c0 0x7f5e20065970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e3810a0f0 tx=0x7f5e2800b040 comp rx=0 tx=0).stop 2021-10-08T19:25:12.652 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 msgr2=0x7f5e38109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:12.652 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/889765466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 0x7f5e38109140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0045a0 tx=0x7f5e2c009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:12.653 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 shutdown_connections 2021-10-08T19:25:12.653 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/889765466 >> v2:172.21.15.157:6800/3606206634 conn(0x7f5e200634c0 0x7f5e20065970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.654 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/889765466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e380f92e0 0x7f5e38110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.654 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/889765466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380f76b0 0x7f5e38108c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.655 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 --2- 172.21.15.196:0/889765466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e380f8950 0x7f5e38109140 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.655 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 >> 172.21.15.196:0/889765466 conn(0x7f5e380f2ea0 msgr2=0x7f5e380f51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:12.655 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 shutdown_connections 2021-10-08T19:25:12.656 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:12.650+0000 7f5e3cdb4700 1 -- 172.21.15.196:0/889765466 wait complete. 2021-10-08T19:25:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[32847]: pgmap v183: 132 pgs: 14 creating+peering, 62 active+clean, 56 unknown; 578 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 767 B/s wr, 4 op/s 2021-10-08T19:25:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:25:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:25:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[32847]: osdmap e63: 8 total, 8 up, 8 in 2021-10-08T19:25:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:25:13.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3703701250' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:25:13.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:25:13.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[42114]: pgmap v183: 132 pgs: 14 creating+peering, 62 active+clean, 56 unknown; 578 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 767 B/s wr, 4 op/s 2021-10-08T19:25:13.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:13.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:25:13.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:25:13.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[42114]: osdmap e63: 8 total, 8 up, 8 in 2021-10-08T19:25:13.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:25:13.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3703701250' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:25:13.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:12 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:25:13.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:12 smithi196 ceph-mon[34258]: pgmap v183: 132 pgs: 14 creating+peering, 62 active+clean, 56 unknown; 578 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 767 B/s wr, 4 op/s 2021-10-08T19:25:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:12 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:25:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:12 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:25:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:12 smithi196 ceph-mon[34258]: osdmap e63: 8 total, 8 up, 8 in 2021-10-08T19:25:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:25:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3703701250' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:25:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:12 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:25:13.353 DEBUG:teuthology.orchestra.run.smithi196:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@iscsi.iscsi.a.service 2021-10-08T19:25:13.357 INFO:tasks.cephadm:Adding prometheus.a on smithi196 2021-10-08T19:25:13.357 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch apply prometheus '1;smithi196=a' 2021-10-08T19:25:13.382 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:25:13.862 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:13 smithi196 ceph-mon[34258]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi196=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:13.862 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:13 smithi196 ceph-mon[34258]: Saving service iscsi.iscsi spec with placement smithi196=iscsi.a;count:1 2021-10-08T19:25:13.863 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:25:13.863 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:13 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:25:13.863 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:13 smithi196 ceph-mon[34258]: osdmap e64: 8 total, 8 up, 8 in 2021-10-08T19:25:13.863 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:25:13.864 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3703701250' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:25:13.864 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:13 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:25:14.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[32847]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi196=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:14.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[32847]: Saving service iscsi.iscsi spec with placement smithi196=iscsi.a;count:1 2021-10-08T19:25:14.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:25:14.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:25:14.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[32847]: osdmap e64: 8 total, 8 up, 8 in 2021-10-08T19:25:14.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:25:14.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3703701250' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:25:14.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:25:14.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[42114]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi196=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:14.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[42114]: Saving service iscsi.iscsi spec with placement smithi196=iscsi.a;count:1 2021-10-08T19:25:14.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:25:14.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:25:14.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[42114]: osdmap e64: 8 total, 8 up, 8 in 2021-10-08T19:25:14.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:25:14.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3703701250' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:25:14.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:13 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:25:15.076 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:14 smithi196 ceph-mon[34258]: pgmap v186: 132 pgs: 9 creating+peering, 104 active+clean, 19 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:25:15.077 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:25:15.077 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:14 smithi196 ceph-mon[34258]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:25:15.077 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:14 smithi196 ceph-mon[34258]: osdmap e65: 8 total, 8 up, 8 in 2021-10-08T19:25:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:14 smithi157 ceph-mon[32847]: pgmap v186: 132 pgs: 9 creating+peering, 104 active+clean, 19 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:25:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:25:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:14 smithi157 ceph-mon[32847]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:25:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:14 smithi157 ceph-mon[32847]: osdmap e65: 8 total, 8 up, 8 in 2021-10-08T19:25:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:14 smithi157 ceph-mon[42114]: pgmap v186: 132 pgs: 9 creating+peering, 104 active+clean, 19 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:25:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3211690032' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:25:15.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:14 smithi157 ceph-mon[42114]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:25:15.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:14 smithi157 ceph-mon[42114]: osdmap e65: 8 total, 8 up, 8 in 2021-10-08T19:25:15.241 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 -- 172.21.15.196:0/3350906250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2280fa400 msgr2=0x7fb228100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:15.242 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 --2- 172.21.15.196:0/3350906250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2280fa400 0x7fb228100cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb220009a60 tx=0x7fb220004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:15.242 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 -- 172.21.15.196:0/3350906250 shutdown_connections 2021-10-08T19:25:15.242 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 --2- 172.21.15.196:0/3350906250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2280fa400 0x7fb228100cc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:15.243 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 --2- 172.21.15.196:0/3350906250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2280f87d0 0x7fb2280f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:15.243 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 --2- 172.21.15.196:0/3350906250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2280f9a70 0x7fb2280f9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:15.243 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 -- 172.21.15.196:0/3350906250 >> 172.21.15.196:0/3350906250 conn(0x7fb2280f4000 msgr2=0x7fb2280f6410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:15.243 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 -- 172.21.15.196:0/3350906250 shutdown_connections 2021-10-08T19:25:15.244 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 -- 172.21.15.196:0/3350906250 wait complete. 2021-10-08T19:25:15.246 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.241+0000 7fb22e910700 1 Processor -- start 2021-10-08T19:25:15.246 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22e910700 1 -- start start 2021-10-08T19:25:15.246 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22e910700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2280f87d0 0x7fb228108850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:15.247 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22e910700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2280f9a70 0x7fb228108d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:15.247 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22e910700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2280fa400 0x7fb22810fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:15.247 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22e910700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228110360 con 0x7fb2280f87d0 2021-10-08T19:25:15.247 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22e910700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281104d0 con 0x7fb2280fa400 2021-10-08T19:25:15.248 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22e910700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb228110690 con 0x7fb2280f9a70 2021-10-08T19:25:15.248 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22cead700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2280fa400 0x7fb22810fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:15.248 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22cead700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2280fa400 0x7fb22810fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49334/0 (socket says 172.21.15.196:49334) 2021-10-08T19:25:15.248 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22cead700 1 -- 172.21.15.196:0/2406357098 learned_addr learned my addr 172.21.15.196:0/2406357098 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:25:15.248 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb227fff700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2280f87d0 0x7fb228108850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:15.249 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb2277fe700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2280f9a70 0x7fb228108d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:15.249 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22cead700 1 -- 172.21.15.196:0/2406357098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2280f9a70 msgr2=0x7fb228108d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:15.249 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22cead700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2280f9a70 0x7fb228108d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:15.249 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22cead700 1 -- 172.21.15.196:0/2406357098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2280f87d0 msgr2=0x7fb228108850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:15.250 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22cead700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2280f87d0 0x7fb228108850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:15.250 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22cead700 1 -- 172.21.15.196:0/2406357098 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb218005040 con 0x7fb2280fa400 2021-10-08T19:25:15.250 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb227fff700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2280f87d0 0x7fb228108850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:25:15.250 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.242+0000 7fb22cead700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2280fa400 0x7fb22810fe20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb220009040 tx=0x7fb220004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:15.251 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.243+0000 7fb224ff9700 1 -- 172.21.15.196:0/2406357098 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220020070 con 0x7fb2280fa400 2021-10-08T19:25:15.251 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.243+0000 7fb224ff9700 1 -- 172.21.15.196:0/2406357098 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fb220009450 con 0x7fb2280fa400 2021-10-08T19:25:15.251 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.243+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c005040 con 0x7fb2280fa400 2021-10-08T19:25:15.251 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.243+0000 7fb224ff9700 1 -- 172.21.15.196:0/2406357098 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22000e070 con 0x7fb2280fa400 2021-10-08T19:25:15.251 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.243+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb220009640 con 0x7fb2280fa400 2021-10-08T19:25:15.252 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.244+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb228047b50 con 0x7fb2280fa400 2021-10-08T19:25:15.252 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.244+0000 7fb224ff9700 1 -- 172.21.15.196:0/2406357098 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) v1 ==== 80770+0+0 (secure 0 0 0) 0x7fb22001c440 con 0x7fb2280fa400 2021-10-08T19:25:15.252 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.245+0000 7fb224ff9700 1 --2- 172.21.15.196:0/2406357098 >> v2:172.21.15.157:6800/3606206634 conn(0x7fb2100634c0 0x7fb210065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:15.252 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.245+0000 7fb224ff9700 1 -- 172.21.15.196:0/2406357098 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5907+0+0 (secure 0 0 0) 0x7fb220081460 con 0x7fb2280fa400 2021-10-08T19:25:15.252 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.245+0000 7fb227fff700 1 --2- 172.21.15.196:0/2406357098 >> v2:172.21.15.157:6800/3606206634 conn(0x7fb2100634c0 0x7fb210065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:15.253 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.245+0000 7fb227fff700 1 --2- 172.21.15.196:0/2406357098 >> v2:172.21.15.157:6800/3606206634 conn(0x7fb2100634c0 0x7fb210065970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb218007fd0 tx=0x7fb21800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:15.253 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.249+0000 7fb224ff9700 1 -- 172.21.15.196:0/2406357098 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fb220054090 con 0x7fb2280fa400 2021-10-08T19:25:15.438 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.437+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi196=a", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2280008d0 con 0x7fb2100634c0 2021-10-08T19:25:15.443 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.443+0000 7fb224ff9700 1 -- 172.21.15.196:0/2406357098 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fb2280008d0 con 0x7fb2100634c0 2021-10-08T19:25:15.443 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled prometheus update... 2021-10-08T19:25:15.446 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 >> v2:172.21.15.157:6800/3606206634 conn(0x7fb2100634c0 msgr2=0x7fb210065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:15.446 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 --2- 172.21.15.196:0/2406357098 >> v2:172.21.15.157:6800/3606206634 conn(0x7fb2100634c0 0x7fb210065970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb218007fd0 tx=0x7fb21800b040 comp rx=0 tx=0).stop 2021-10-08T19:25:15.446 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2280fa400 msgr2=0x7fb22810fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:15.447 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2280fa400 0x7fb22810fe20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb220009040 tx=0x7fb220004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:15.447 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 shutdown_connections 2021-10-08T19:25:15.447 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 --2- 172.21.15.196:0/2406357098 >> v2:172.21.15.157:6800/3606206634 conn(0x7fb2100634c0 0x7fb210065970 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:15.447 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2280fa400 0x7fb22810fe20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:15.447 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2280f87d0 0x7fb228108850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:15.448 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 --2- 172.21.15.196:0/2406357098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2280f9a70 0x7fb228108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:15.448 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.444+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 >> 172.21.15.196:0/2406357098 conn(0x7fb2280f4000 msgr2=0x7fb2280fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:15.448 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.445+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 shutdown_connections 2021-10-08T19:25:15.448 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:15.445+0000 7fb22e910700 1 -- 172.21.15.196:0/2406357098 wait complete. 2021-10-08T19:25:16.305 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.305 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.305 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.306 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: Checking pool "iscsi" exists for service iscsi.iscsi 2021-10-08T19:25:16.306 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2021-10-08T19:25:16.306 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2021-10-08T19:25:16.306 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:16.307 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: Deploying daemon iscsi.iscsi.a on smithi196 2021-10-08T19:25:16.307 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: poll took 9480.764 ms: 1 events 2021-10-08T19:25:16.307 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:15 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: Checking pool "iscsi" exists for service iscsi.iscsi 2021-10-08T19:25:16.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2021-10-08T19:25:16.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2021-10-08T19:25:16.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:16.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: Deploying daemon iscsi.iscsi.a on smithi196 2021-10-08T19:25:16.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: poll took 9480.764 ms: 1 events 2021-10-08T19:25:16.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: Checking pool "iscsi" exists for service iscsi.iscsi 2021-10-08T19:25:16.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2021-10-08T19:25:16.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2021-10-08T19:25:16.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:16.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: Deploying daemon iscsi.iscsi.a on smithi196 2021-10-08T19:25:16.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: poll took 9480.764 ms: 1 events 2021-10-08T19:25:16.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:15 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:16.402 DEBUG:teuthology.orchestra.run.smithi196:prometheus.a> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@prometheus.a.service 2021-10-08T19:25:16.405 INFO:tasks.cephadm:Adding node-exporter.a on smithi157 2021-10-08T19:25:16.406 INFO:tasks.cephadm:Adding node-exporter.b on smithi196 2021-10-08T19:25:16.406 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch apply node-exporter '2;smithi157=a;smithi196=b' 2021-10-08T19:25:16.430 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:25:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:16 smithi157 ceph-mon[32847]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi196=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:16 smithi157 ceph-mon[32847]: Saving service prometheus spec with placement smithi196=a;count:1 2021-10-08T19:25:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:16 smithi157 ceph-mon[32847]: pgmap v188: 132 pgs: 6 creating+peering, 126 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 1.8 KiB/s wr, 40 op/s 2021-10-08T19:25:17.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:16 smithi157 ceph-mon[32847]: mgrmap e16: y(active, since 4m), standbys: x 2021-10-08T19:25:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:16 smithi157 ceph-mon[42114]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi196=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:16 smithi157 ceph-mon[42114]: Saving service prometheus spec with placement smithi196=a;count:1 2021-10-08T19:25:17.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:16 smithi157 ceph-mon[42114]: pgmap v188: 132 pgs: 6 creating+peering, 126 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 1.8 KiB/s wr, 40 op/s 2021-10-08T19:25:17.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:16 smithi157 ceph-mon[42114]: mgrmap e16: y(active, since 4m), standbys: x 2021-10-08T19:25:17.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:16 smithi196 ceph-mon[34258]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi196=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:17.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:16 smithi196 ceph-mon[34258]: Saving service prometheus spec with placement smithi196=a;count:1 2021-10-08T19:25:17.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:16 smithi196 ceph-mon[34258]: pgmap v188: 132 pgs: 6 creating+peering, 126 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 1.8 KiB/s wr, 40 op/s 2021-10-08T19:25:17.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:16 smithi196 ceph-mon[34258]: mgrmap e16: y(active, since 4m), standbys: x 2021-10-08T19:25:17.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:17 smithi196 systemd[1]: Starting Ceph iscsi.iscsi.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:25:18.710 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:18 smithi196 ceph-mon[34258]: poll took 1983.889 ms: 1 events 2021-10-08T19:25:18.712 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:18 smithi196 ceph-mon[34258]: pgmap v189: 132 pgs: 132 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 1.8 KiB/s wr, 49 op/s 2021-10-08T19:25:18.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:18 smithi157 ceph-mon[32847]: poll took 1983.889 ms: 1 events 2021-10-08T19:25:18.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:18 smithi157 ceph-mon[32847]: pgmap v189: 132 pgs: 132 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 1.8 KiB/s wr, 49 op/s 2021-10-08T19:25:18.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:18 smithi157 ceph-mon[42114]: poll took 1983.889 ms: 1 events 2021-10-08T19:25:18.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:18 smithi157 ceph-mon[42114]: pgmap v189: 132 pgs: 132 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 1.8 KiB/s wr, 49 op/s 2021-10-08T19:25:19.066 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:18 smithi196 bash[57317]: log file path now is '/var/log/tcmu-runner.log' 2021-10-08T19:25:19.256 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 -- 172.21.15.196:0/471223545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f8750 msgr2=0x7f1eb00f8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:19.256 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 --2- 172.21.15.196:0/471223545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f8750 0x7f1eb00f8ba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40046e0 tx=0x7f1ea4009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:19.256 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 -- 172.21.15.196:0/471223545 shutdown_connections 2021-10-08T19:25:19.257 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 --2- 172.21.15.196:0/471223545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eb00f90e0 0x7f1eb00ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:19.257 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 --2- 172.21.15.196:0/471223545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb00f74b0 0x7f1eb00f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:19.257 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 --2- 172.21.15.196:0/471223545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f8750 0x7f1eb00f8ba0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:19.257 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 -- 172.21.15.196:0/471223545 >> 172.21.15.196:0/471223545 conn(0x7f1eb00f2ca0 msgr2=0x7f1eb00f50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:19.258 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 -- 172.21.15.196:0/471223545 shutdown_connections 2021-10-08T19:25:19.258 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 -- 172.21.15.196:0/471223545 wait complete. 2021-10-08T19:25:19.258 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.253+0000 7f1eb696b700 1 Processor -- start 2021-10-08T19:25:19.258 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eb696b700 1 -- start start 2021-10-08T19:25:19.258 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eb696b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f74b0 0x7f1eb0107880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:19.259 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eb696b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eb00f8750 0x7f1eb0107dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:19.259 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eb696b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb00f90e0 0x7f1eb010ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:19.259 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eb696b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb010f390 con 0x7f1eb00f90e0 2021-10-08T19:25:19.259 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eb696b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb010f500 con 0x7f1eb00f74b0 2021-10-08T19:25:19.259 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eb696b700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb010f6c0 con 0x7f1eb00f8750 2021-10-08T19:25:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaffff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f74b0 0x7f1eb0107880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaffff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f74b0 0x7f1eb0107880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49342/0 (socket says 172.21.15.196:49342) 2021-10-08T19:25:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaffff700 1 -- 172.21.15.196:0/3747708673 learned_addr learned my addr 172.21.15.196:0/3747708673 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:25:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaf7fe700 1 --2- 172.21.15.196:0/3747708673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eb00f8750 0x7f1eb0107dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eb4f08700 1 --2- 172.21.15.196:0/3747708673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb00f90e0 0x7f1eb010ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaffff700 1 -- 172.21.15.196:0/3747708673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eb00f8750 msgr2=0x7f1eb0107dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaffff700 1 --2- 172.21.15.196:0/3747708673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eb00f8750 0x7f1eb0107dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaffff700 1 -- 172.21.15.196:0/3747708673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb00f90e0 msgr2=0x7f1eb010ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaffff700 1 --2- 172.21.15.196:0/3747708673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb00f90e0 0x7f1eb010ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaffff700 1 -- 172.21.15.196:0/3747708673 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea4005040 con 0x7f1eb00f74b0 2021-10-08T19:25:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eaffff700 1 --2- 172.21.15.196:0/3747708673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f74b0 0x7f1eb0107880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0002780 tx=0x7f1ea0009d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eacff9700 1 -- 172.21.15.196:0/3747708673 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00092e0 con 0x7f1eb00f74b0 2021-10-08T19:25:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eacff9700 1 -- 172.21.15.196:0/3747708673 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f1ea000f040 con 0x7f1eb00f74b0 2021-10-08T19:25:19.263 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb010f9a0 con 0x7f1eb00f74b0 2021-10-08T19:25:19.264 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.254+0000 7f1eacff9700 1 -- 172.21.15.196:0/3747708673 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00136e0 con 0x7f1eb00f74b0 2021-10-08T19:25:19.264 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.255+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb010fe90 con 0x7f1eb00f74b0 2021-10-08T19:25:19.264 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.255+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb00289c0 con 0x7f1eb00f74b0 2021-10-08T19:25:19.265 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.256+0000 7f1eacff9700 1 -- 172.21.15.196:0/3747708673 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) v1 ==== 80810+0+0 (secure 0 0 0) 0x7f1ea001a030 con 0x7f1eb00f74b0 2021-10-08T19:25:19.265 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.256+0000 7f1eacff9700 1 --2- 172.21.15.196:0/3747708673 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1e98063460 0x7f1e98065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:19.266 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.256+0000 7f1eacff9700 1 -- 172.21.15.196:0/3747708673 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f1ea007eec0 con 0x7f1eb00f74b0 2021-10-08T19:25:19.266 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.256+0000 7f1eaf7fe700 1 --2- 172.21.15.196:0/3747708673 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1e98063460 0x7f1e98065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:19.266 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.257+0000 7f1eaf7fe700 1 --2- 172.21.15.196:0/3747708673 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1e98063460 0x7f1e98065910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4004eb0 tx=0x7f1ea4009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:19.266 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.260+0000 7f1eacff9700 1 -- 172.21.15.196:0/3747708673 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1ea0047b00 con 0x7f1eb00f74b0 2021-10-08T19:25:19.440 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.440+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi157=a;smithi196=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f1eb0059800 con 0x7f1e98063460 2021-10-08T19:25:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.446+0000 7f1eacff9700 1 -- 172.21.15.196:0/3747708673 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f1eb0059800 con 0x7f1e98063460 2021-10-08T19:25:19.447 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled node-exporter update... 2021-10-08T19:25:19.449 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1e98063460 msgr2=0x7f1e98065910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:19.449 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 --2- 172.21.15.196:0/3747708673 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1e98063460 0x7f1e98065910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4004eb0 tx=0x7f1ea4009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:19.449 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f74b0 msgr2=0x7f1eb0107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:19.450 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 --2- 172.21.15.196:0/3747708673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f74b0 0x7f1eb0107880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0002780 tx=0x7f1ea0009d80 comp rx=0 tx=0).stop 2021-10-08T19:25:19.450 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 shutdown_connections 2021-10-08T19:25:19.450 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 --2- 172.21.15.196:0/3747708673 >> v2:172.21.15.157:6800/3606206634 conn(0x7f1e98063460 0x7f1e98065910 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:19.450 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 --2- 172.21.15.196:0/3747708673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb00f90e0 0x7f1eb010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:19.450 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 --2- 172.21.15.196:0/3747708673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eb00f74b0 0x7f1eb0107880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:19.451 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 --2- 172.21.15.196:0/3747708673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eb00f8750 0x7f1eb0107dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:19.451 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 >> 172.21.15.196:0/3747708673 conn(0x7f1eb00f2ca0 msgr2=0x7f1eb00fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:19.451 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 shutdown_connections 2021-10-08T19:25:19.452 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:19.448+0000 7f1eb696b700 1 -- 172.21.15.196:0/3747708673 wait complete. 2021-10-08T19:25:19.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:19 smithi196 bash[57317]: eac99eb47dc35107dfc3e4904f32debfe5af65d747e33582ee25bc18bf81e109 2021-10-08T19:25:19.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:19 smithi196 systemd[1]: Started Ceph iscsi.iscsi.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:25:19.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:19 smithi196 conmon[57883]: debug Started the configuration object watcher 2021-10-08T19:25:19.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:19 smithi196 conmon[57883]: debug Checking for config object changes every 1s 2021-10-08T19:25:19.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:19 smithi196 conmon[57883]: debug Processing osd blocklist entries for this node 2021-10-08T19:25:20.258 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:19 smithi196 conmon[57883]: debug Reading the configuration object to update local LIO configuration 2021-10-08T19:25:20.258 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:19 smithi196 conmon[57883]: debug Configuration does not have an entry for this host(smithi196) - nothing to define to LIO 2021-10-08T19:25:20.258 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:19 smithi196 conmon[57883]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2021-10-08T19:25:20.260 DEBUG:teuthology.orchestra.run.smithi157:node-exporter.a> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@node-exporter.a.service 2021-10-08T19:25:20.263 DEBUG:teuthology.orchestra.run.smithi196:node-exporter.b> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@node-exporter.b.service 2021-10-08T19:25:20.266 INFO:tasks.cephadm:Adding alertmanager.a on smithi157 2021-10-08T19:25:20.266 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch apply alertmanager '1;smithi157=a' 2021-10-08T19:25:20.292 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:25:20.292 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:25:20.512 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi157=a;smithi196=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:20.512 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: Saving service node-exporter spec with placement smithi157=a;smithi196=b;count:2 2021-10-08T19:25:20.512 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.513 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: poll took 2180.144 ms: 1 events 2021-10-08T19:25:20.513 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.514 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: Sending message to agent on host smithi196 2021-10-08T19:25:20.514 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:20.515 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:20.515 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:20.515 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.515 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:20.516 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-10-08T19:25:20.516 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-10-08T19:25:20.516 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: Adding iSCSI gateway http://:@172.21.15.196:5000 to Dashboard 2021-10-08T19:25:20.516 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-10-08T19:25:20.517 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-10-08T19:25:20.517 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.517 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi196"}]: dispatch 2021-10-08T19:25:20.517 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi196"}]: dispatch 2021-10-08T19:25:20.518 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.518 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:20.518 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:20.518 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:20.519 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: Checking dashboard <-> RGW credentials 2021-10-08T19:25:20.519 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.519 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.519 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:20.520 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/3339733825' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-10-08T19:25:20.520 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi196 2021-10-08T19:25:20.520 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:20 smithi196 ceph-mon[34258]: pgmap v190: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 4.8 KiB/s wr, 150 op/s 2021-10-08T19:25:20.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi157=a;smithi196=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:20.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: Saving service node-exporter spec with placement smithi157=a;smithi196=b;count:2 2021-10-08T19:25:20.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: poll took 2180.144 ms: 1 events 2021-10-08T19:25:20.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: Sending message to agent on host smithi196 2021-10-08T19:25:20.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:20.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:20.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:20.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:20.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-10-08T19:25:20.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-10-08T19:25:20.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: Adding iSCSI gateway http://:@172.21.15.196:5000 to Dashboard 2021-10-08T19:25:20.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-10-08T19:25:20.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-10-08T19:25:20.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi196"}]: dispatch 2021-10-08T19:25:20.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi196"}]: dispatch 2021-10-08T19:25:20.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:20.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:20.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:20.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: Checking dashboard <-> RGW credentials 2021-10-08T19:25:20.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:20.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/3339733825' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-10-08T19:25:20.585 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi196 2021-10-08T19:25:20.585 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[32847]: pgmap v190: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 4.8 KiB/s wr, 150 op/s 2021-10-08T19:25:20.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi157=a;smithi196=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:20.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: Saving service node-exporter spec with placement smithi157=a;smithi196=b;count:2 2021-10-08T19:25:20.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: poll took 2180.144 ms: 1 events 2021-10-08T19:25:20.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: Sending message to agent on host smithi196 2021-10-08T19:25:20.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:20.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:20.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:20.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:20.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-10-08T19:25:20.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-10-08T19:25:20.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: Adding iSCSI gateway http://:@172.21.15.196:5000 to Dashboard 2021-10-08T19:25:20.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-10-08T19:25:20.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-10-08T19:25:20.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi196"}]: dispatch 2021-10-08T19:25:20.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi196"}]: dispatch 2021-10-08T19:25:20.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:20.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:20.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:20.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: Checking dashboard <-> RGW credentials 2021-10-08T19:25:20.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:20.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:20.592 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/3339733825' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-10-08T19:25:20.592 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi196 2021-10-08T19:25:20.592 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:20 smithi157 ceph-mon[42114]: pgmap v190: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 4.8 KiB/s wr, 150 op/s 2021-10-08T19:25:22.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:22 smithi157 ceph-mon[32847]: pgmap v191: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 4.2 KiB/s wr, 132 op/s 2021-10-08T19:25:22.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:22 smithi157 ceph-mon[42114]: pgmap v191: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 4.2 KiB/s wr, 132 op/s 2021-10-08T19:25:22.848 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:22 smithi196 ceph-mon[34258]: pgmap v191: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 4.2 KiB/s wr, 132 op/s 2021-10-08T19:25:23.050 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.047+0000 7f922bb8a700 1 -- 172.21.15.196:0/3378412949 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 msgr2=0x7f92240f89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:23.050 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.047+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3378412949 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 0x7f92240f89a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f92200046e0 tx=0x7f9220009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:23.050 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.047+0000 7f922bb8a700 1 -- 172.21.15.196:0/3378412949 shutdown_connections 2021-10-08T19:25:23.051 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.047+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3378412949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92240fa1c0 0x7f9224100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:23.051 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.047+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3378412949 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 0x7f92240f89a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:23.051 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.047+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3378412949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92240f9830 0x7f92240f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:23.051 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.047+0000 7f922bb8a700 1 -- 172.21.15.196:0/3378412949 >> 172.21.15.196:0/3378412949 conn(0x7f92240f3d80 msgr2=0x7f92240f61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:23.052 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.047+0000 7f922bb8a700 1 -- 172.21.15.196:0/3378412949 shutdown_connections 2021-10-08T19:25:23.052 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.047+0000 7f922bb8a700 1 -- 172.21.15.196:0/3378412949 wait complete. 2021-10-08T19:25:23.052 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922bb8a700 1 Processor -- start 2021-10-08T19:25:23.052 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922bb8a700 1 -- start start 2021-10-08T19:25:23.053 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922bb8a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 0x7f92241088d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:23.053 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922bb8a700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92240f9830 0x7f9224108e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:23.053 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922bb8a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92240fa1c0 0x7f922410fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:23.053 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922bb8a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92241103e0 con 0x7f92240fa1c0 2021-10-08T19:25:23.053 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922bb8a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9224110550 con 0x7f92240f8590 2021-10-08T19:25:23.054 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922bb8a700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9224110710 con 0x7f92240f9830 2021-10-08T19:25:23.054 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229926700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 0x7f92241088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:23.054 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229926700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 0x7f92241088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49416/0 (socket says 172.21.15.196:49416) 2021-10-08T19:25:23.054 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229926700 1 -- 172.21.15.196:0/3323832462 learned_addr learned my addr 172.21.15.196:0/3323832462 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:25:23.055 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229125700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92240f9830 0x7f9224108e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:23.055 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922a127700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92240fa1c0 0x7f922410fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:23.055 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229926700 1 -- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92240f9830 msgr2=0x7f9224108e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:23.055 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229926700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92240f9830 0x7f9224108e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:23.055 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229926700 1 -- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92240fa1c0 msgr2=0x7f922410fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:23.056 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229926700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92240fa1c0 0x7f922410fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:23.056 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229926700 1 -- 172.21.15.196:0/3323832462 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220005040 con 0x7f92240f8590 2021-10-08T19:25:23.056 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f922a127700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92240fa1c0 0x7f922410fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:25:23.056 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.048+0000 7f9229125700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92240f9830 0x7f9224108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:25:23.057 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.049+0000 7f9229926700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 0x7f92241088d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9220009da0 tx=0x7f9220009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:23.057 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.049+0000 7f921a7fc700 1 -- 172.21.15.196:0/3323832462 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922000e040 con 0x7f92240f8590 2021-10-08T19:25:23.057 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.049+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9224110990 con 0x7f92240f8590 2021-10-08T19:25:23.057 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.049+0000 7f921a7fc700 1 -- 172.21.15.196:0/3323832462 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f9220007da0 con 0x7f92240f8590 2021-10-08T19:25:23.057 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.049+0000 7f921a7fc700 1 -- 172.21.15.196:0/3323832462 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922001cd90 con 0x7f92240f8590 2021-10-08T19:25:23.058 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.049+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9224110ec0 con 0x7f92240f8590 2021-10-08T19:25:23.059 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.050+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9224047b50 con 0x7f92240f8590 2021-10-08T19:25:23.059 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.050+0000 7f921a7fc700 1 -- 172.21.15.196:0/3323832462 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) v1 ==== 80810+0+0 (secure 0 0 0) 0x7f922001c3f0 con 0x7f92240f8590 2021-10-08T19:25:23.059 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.050+0000 7f921a7fc700 1 --2- 172.21.15.196:0/3323832462 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9210063460 0x7f9210065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:23.060 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.050+0000 7f921a7fc700 1 -- 172.21.15.196:0/3323832462 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f9220080cc0 con 0x7f92240f8590 2021-10-08T19:25:23.060 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.051+0000 7f9229125700 1 --2- 172.21.15.196:0/3323832462 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9210063460 0x7f9210065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:23.060 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.051+0000 7f9229125700 1 --2- 172.21.15.196:0/3323832462 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9210063460 0x7f9210065910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9214004a90 tx=0x7f9214009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:23.060 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.055+0000 7f921a7fc700 1 -- 172.21.15.196:0/3323832462 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f9220053a20 con 0x7f92240f8590 2021-10-08T19:25:23.231 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.231+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi157=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f9224059800 con 0x7f9210063460 2021-10-08T19:25:23.238 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.237+0000 7f921a7fc700 1 -- 172.21.15.196:0/3323832462 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f9224059800 con 0x7f9210063460 2021-10-08T19:25:23.238 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled alertmanager update... 2021-10-08T19:25:23.240 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9210063460 msgr2=0x7f9210065910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:23.240 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3323832462 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9210063460 0x7f9210065910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9214004a90 tx=0x7f9214009040 comp rx=0 tx=0).stop 2021-10-08T19:25:23.240 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 msgr2=0x7f92241088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:23.241 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 0x7f92241088d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9220009da0 tx=0x7f9220009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:23.241 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 shutdown_connections 2021-10-08T19:25:23.241 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3323832462 >> v2:172.21.15.157:6800/3606206634 conn(0x7f9210063460 0x7f9210065910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:23.241 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92240fa1c0 0x7f922410fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:23.241 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92240f8590 0x7f92241088d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:23.242 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 --2- 172.21.15.196:0/3323832462 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92240f9830 0x7f9224108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:23.242 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 >> 172.21.15.196:0/3323832462 conn(0x7f92240f3d80 msgr2=0x7f92240f6040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:23.242 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 shutdown_connections 2021-10-08T19:25:23.242 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:23.239+0000 7f922bb8a700 1 -- 172.21.15.196:0/3323832462 wait complete. 2021-10-08T19:25:24.075 DEBUG:teuthology.orchestra.run.smithi157:alertmanager.a> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@alertmanager.a.service 2021-10-08T19:25:24.078 INFO:tasks.cephadm:Adding grafana.a on smithi196 2021-10-08T19:25:24.079 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph orch apply grafana '1;smithi196=a' 2021-10-08T19:25:24.106 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:-- Logs begin at Fri 2021-10-08 19:10:33 UTC. -- 2021-10-08T19:25:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:24 smithi196 ceph-mon[34258]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi157=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:24 smithi196 ceph-mon[34258]: Saving service alertmanager spec with placement smithi157=a;count:1 2021-10-08T19:25:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:24 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:24 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:24.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[32847]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi157=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:24.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[32847]: Saving service alertmanager spec with placement smithi157=a;count:1 2021-10-08T19:25:24.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:24.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:24.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:24.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:24.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:24.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:24.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[42114]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi157=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:24.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[42114]: Saving service alertmanager spec with placement smithi157=a;count:1 2021-10-08T19:25:24.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:24.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:24.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:24.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:24.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:24.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:24 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:25.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:25 smithi157 ceph-mon[32847]: pgmap v192: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 3.6 KiB/s wr, 115 op/s 2021-10-08T19:25:25.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:25 smithi157 ceph-mon[42114]: pgmap v192: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 3.6 KiB/s wr, 115 op/s 2021-10-08T19:25:25.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:25 smithi196 ceph-mon[34258]: pgmap v192: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 3.6 KiB/s wr, 115 op/s 2021-10-08T19:25:26.571 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.568+0000 7fc09a66a700 1 -- 172.21.15.196:0/3763314997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0940fe1f0 msgr2=0x7fc094100670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:26.571 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.568+0000 7fc09a66a700 1 --2- 172.21.15.196:0/3763314997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0940fe1f0 0x7fc094100670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009a60 tx=0x7fc08c004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:26.572 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.568+0000 7fc09a66a700 1 -- 172.21.15.196:0/3763314997 shutdown_connections 2021-10-08T19:25:26.572 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.568+0000 7fc09a66a700 1 --2- 172.21.15.196:0/3763314997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0940fe1f0 0x7fc094100670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:26.572 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.568+0000 7fc09a66a700 1 --2- 172.21.15.196:0/3763314997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc094062640 0x7fc0940fb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:26.572 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.568+0000 7fc09a66a700 1 --2- 172.21.15.196:0/3763314997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0940fb7f0 0x7fc0940fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:26.573 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.568+0000 7fc09a66a700 1 -- 172.21.15.196:0/3763314997 >> 172.21.15.196:0/3763314997 conn(0x7fc0940f2c60 msgr2=0x7fc0940f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:26.573 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.568+0000 7fc09a66a700 1 -- 172.21.15.196:0/3763314997 shutdown_connections 2021-10-08T19:25:26.573 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.568+0000 7fc09a66a700 1 -- 172.21.15.196:0/3763314997 wait complete. 2021-10-08T19:25:26.573 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc09a66a700 1 Processor -- start 2021-10-08T19:25:26.574 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc09a66a700 1 -- start start 2021-10-08T19:25:26.574 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc09a66a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc094062640 0x7fc0941064c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:26.574 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc09a66a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0940fb7f0 0x7fc094106a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:26.574 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc09a66a700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0940fe1f0 0x7fc09410da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:26.574 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc09a66a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09410dfd0 con 0x7fc0940fb7f0 2021-10-08T19:25:26.575 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc09a66a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09410e140 con 0x7fc094062640 2021-10-08T19:25:26.575 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc09a66a700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09410e300 con 0x7fc0940fe1f0 2021-10-08T19:25:26.575 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc093fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc094062640 0x7fc0941064c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:26.575 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc093fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc094062640 0x7fc0941064c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49430/0 (socket says 172.21.15.196:49430) 2021-10-08T19:25:26.575 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc093fff700 1 -- 172.21.15.196:0/2599731318 learned_addr learned my addr 172.21.15.196:0/2599731318 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:25:26.576 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc0937fe700 1 --2- 172.21.15.196:0/2599731318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0940fb7f0 0x7fc094106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:26.576 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc098c07700 1 --2- 172.21.15.196:0/2599731318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0940fe1f0 0x7fc09410da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:26.576 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc093fff700 1 -- 172.21.15.196:0/2599731318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0940fe1f0 msgr2=0x7fc09410da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:26.576 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc093fff700 1 --2- 172.21.15.196:0/2599731318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0940fe1f0 0x7fc09410da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:26.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc093fff700 1 -- 172.21.15.196:0/2599731318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0940fb7f0 msgr2=0x7fc094106a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:26.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc093fff700 1 --2- 172.21.15.196:0/2599731318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0940fb7f0 0x7fc094106a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:26.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.569+0000 7fc093fff700 1 -- 172.21.15.196:0/2599731318 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009640 con 0x7fc094062640 2021-10-08T19:25:26.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.570+0000 7fc093fff700 1 --2- 172.21.15.196:0/2599731318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc094062640 0x7fc0941064c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0840041d0 tx=0x7fc084009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:26.577 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.570+0000 7fc090ff9700 1 -- 172.21.15.196:0/2599731318 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084007860 con 0x7fc094062640 2021-10-08T19:25:26.578 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.570+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09410e5e0 con 0x7fc094062640 2021-10-08T19:25:26.578 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.570+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09410eba0 con 0x7fc094062640 2021-10-08T19:25:26.578 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.570+0000 7fc090ff9700 1 -- 172.21.15.196:0/2599731318 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fc084013070 con 0x7fc094062640 2021-10-08T19:25:26.578 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.570+0000 7fc090ff9700 1 -- 172.21.15.196:0/2599731318 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084015680 con 0x7fc094062640 2021-10-08T19:25:26.580 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.571+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc074004de0 con 0x7fc094062640 2021-10-08T19:25:26.580 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.571+0000 7fc090ff9700 1 -- 172.21.15.196:0/2599731318 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) v1 ==== 80810+0+0 (secure 0 0 0) 0x7fc08401f070 con 0x7fc094062640 2021-10-08T19:25:26.580 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.572+0000 7fc090ff9700 1 --2- 172.21.15.196:0/2599731318 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc07c063460 0x7fc07c065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:26.581 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.572+0000 7fc090ff9700 1 -- 172.21.15.196:0/2599731318 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5907+0+0 (secure 0 0 0) 0x7fc08407ee70 con 0x7fc094062640 2021-10-08T19:25:26.581 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.572+0000 7fc0937fe700 1 --2- 172.21.15.196:0/2599731318 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc07c063460 0x7fc07c065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:26.581 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.573+0000 7fc0937fe700 1 --2- 172.21.15.196:0/2599731318 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc07c063460 0x7fc07c065910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc088009fd0 tx=0x7fc08800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:26.581 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.577+0000 7fc090ff9700 1 -- 172.21.15.196:0/2599731318 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fc084051a60 con 0x7fc094062640 2021-10-08T19:25:26.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:26 smithi196 ceph-mon[34258]: pgmap v193: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 3.0 KiB/s wr, 99 op/s 2021-10-08T19:25:26.768 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.767+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 --> v2:172.21.15.157:6800/3606206634 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi196=a", "target": ["mon-mgr", ""]}) v1 -- 0x7fc074000bf0 con 0x7fc07c063460 2021-10-08T19:25:26.775 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.774+0000 7fc090ff9700 1 -- 172.21.15.196:0/2599731318 <== mgr.14150 v2:172.21.15.157:6800/3606206634 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fc074000bf0 con 0x7fc07c063460 2021-10-08T19:25:26.775 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled grafana update... 2021-10-08T19:25:26.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc07c063460 msgr2=0x7fc07c065910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:26.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 --2- 172.21.15.196:0/2599731318 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc07c063460 0x7fc07c065910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc088009fd0 tx=0x7fc08800b040 comp rx=0 tx=0).stop 2021-10-08T19:25:26.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc094062640 msgr2=0x7fc0941064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:26.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 --2- 172.21.15.196:0/2599731318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc094062640 0x7fc0941064c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0840041d0 tx=0x7fc084009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:26.777 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 shutdown_connections 2021-10-08T19:25:26.778 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 --2- 172.21.15.196:0/2599731318 >> v2:172.21.15.157:6800/3606206634 conn(0x7fc07c063460 0x7fc07c065910 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:26.778 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 --2- 172.21.15.196:0/2599731318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0940fe1f0 0x7fc09410da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:26.778 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 --2- 172.21.15.196:0/2599731318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc094062640 0x7fc0941064c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:26.778 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 --2- 172.21.15.196:0/2599731318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0940fb7f0 0x7fc094106a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:26.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 >> 172.21.15.196:0/2599731318 conn(0x7fc0940f2c60 msgr2=0x7fc0940fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:26.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 shutdown_connections 2021-10-08T19:25:26.779 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:26.776+0000 7fc09a66a700 1 -- 172.21.15.196:0/2599731318 wait complete. 2021-10-08T19:25:26.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:26 smithi157 ceph-mon[32847]: pgmap v193: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 3.0 KiB/s wr, 99 op/s 2021-10-08T19:25:26.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:26 smithi157 ceph-mon[42114]: pgmap v193: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 3.0 KiB/s wr, 99 op/s 2021-10-08T19:25:27.816 DEBUG:teuthology.orchestra.run.smithi196:grafana.a> sudo journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@grafana.a.service 2021-10-08T19:25:27.819 INFO:tasks.cephadm:Setting up client nodes... 2021-10-08T19:25:27.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-10-08T19:25:27.846 INFO:journalctl@ceph.grafana.a.smithi196.stdout:-- Logs begin at Fri 2021-10-08 19:10:18 UTC. -- 2021-10-08T19:25:28.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:27 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:25:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:28.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[42114]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi196=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:28.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[42114]: Saving service grafana spec with placement smithi196=a;count:1 2021-10-08T19:25:28.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:28.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:28.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:28.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:28.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[32847]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi196=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:28.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[32847]: Saving service grafana spec with placement smithi196=a;count:1 2021-10-08T19:25:28.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:28.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:28.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:28.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:27 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:28.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:27 smithi196 ceph-mon[34258]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi196=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:28.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:27 smithi196 ceph-mon[34258]: Saving service grafana spec with placement smithi196=a;count:1 2021-10-08T19:25:28.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:28.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:28.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:28.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:27 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:27 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:28.826 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.826 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:25:28.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:25:28.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:28.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:25:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:28.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:28.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:28.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-10-08T19:25:28.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[32847]: pgmap v194: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2.4 KiB/s wr, 81 op/s 2021-10-08T19:25:28.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:25:28.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:25:28.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:28.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:25:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:28.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:28.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:28.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:28.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-10-08T19:25:28.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mon[42114]: pgmap v194: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2.4 KiB/s wr, 81 op/s 2021-10-08T19:25:29.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:28 smithi157 conmon[33269]: ignoring --setuser ceph since I am not root 2021-10-08T19:25:29.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:28 smithi157 conmon[33269]: ignoring --setgroup ceph since I am not root 2021-10-08T19:25:29.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:28 smithi157 ceph-mgr[33292]: -- 172.21.15.157:0/2645675707 <== mon.0 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5642ccbd6340 con 0x5642ccbae800 2021-10-08T19:25:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:25:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:25:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:25:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:29.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:29.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:29.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' 2021-10-08T19:25:29.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-10-08T19:25:29.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mon[34258]: pgmap v194: 132 pgs: 132 active+clean; 582 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2.4 KiB/s wr, 81 op/s 2021-10-08T19:25:29.120 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:25:28 smithi196 conmon[36265]: ignoring --setuser ceph since I am not root 2021-10-08T19:25:29.120 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:25:28 smithi196 conmon[36265]: ignoring --setgroup ceph since I am not root 2021-10-08T19:25:29.121 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:25:28 smithi196 ceph-mgr[36288]: -- 172.21.15.196:0/2855237971 <== mon.2 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556cd7a48340 con 0x556cd7a21000 2021-10-08T19:25:29.748 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.745+0000 7f17a630e700 1 -- 172.21.15.157:0/1256202746 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00f84e0 msgr2=0x7f17a00f88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.745+0000 7f17a630e700 1 --2- 172.21.15.157:0/1256202746 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00f84e0 0x7f17a00f88f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17900046e0 tx=0x7f1790009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 -- 172.21.15.157:0/1256202746 shutdown_connections 2021-10-08T19:25:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 --2- 172.21.15.157:0/1256202746 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17a00fa110 0x7f17a01009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 --2- 172.21.15.157:0/1256202746 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00f84e0 0x7f17a00f88f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 --2- 172.21.15.157:0/1256202746 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17a00f9780 0x7f17a00f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 -- 172.21.15.157:0/1256202746 >> 172.21.15.157:0/1256202746 conn(0x7f17a00f3c30 msgr2=0x7f17a00f6060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 -- 172.21.15.157:0/1256202746 shutdown_connections 2021-10-08T19:25:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 -- 172.21.15.157:0/1256202746 wait complete. 2021-10-08T19:25:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 Processor -- start 2021-10-08T19:25:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 -- start start 2021-10-08T19:25:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17a00f84e0 0x7f17a0108970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17a00f9780 0x7f17a0108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00fa110 0x7f17a0109d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:29.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a010a370 con 0x7f17a00fa110 2021-10-08T19:25:29.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a010a4e0 con 0x7f17a00f84e0 2021-10-08T19:25:29.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a630e700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a010a6a0 con 0x7f17a00f9780 2021-10-08T19:25:29.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a5b0d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00fa110 0x7f17a0109d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:29.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a4b0b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17a00f9780 0x7f17a0108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:29.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a5b0d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00fa110 0x7f17a0109d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40620/0 (socket says 172.21.15.157:40620) 2021-10-08T19:25:29.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.746+0000 7f17a5b0d700 1 -- 172.21.15.157:0/262862401 learned_addr learned my addr 172.21.15.157:0/262862401 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:25:29.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a530c700 1 --2- 172.21.15.157:0/262862401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17a00f84e0 0x7f17a0108970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:29.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a5b0d700 1 -- 172.21.15.157:0/262862401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17a00f9780 msgr2=0x7f17a0108eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a5b0d700 1 --2- 172.21.15.157:0/262862401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17a00f9780 0x7f17a0108eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a5b0d700 1 -- 172.21.15.157:0/262862401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17a00f84e0 msgr2=0x7f17a0108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a5b0d700 1 --2- 172.21.15.157:0/262862401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17a00f84e0 0x7f17a0108970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a5b0d700 1 -- 172.21.15.157:0/262862401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798009640 con 0x7f17a00fa110 2021-10-08T19:25:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a4b0b700 1 --2- 172.21.15.157:0/262862401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17a00f9780 0x7f17a0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:25:29.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a5b0d700 1 --2- 172.21.15.157:0/262862401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00fa110 0x7f17a0109d50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1798001c30 tx=0x7f1798004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:29.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f1795ffb700 1 -- 172.21.15.157:0/262862401 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980092e0 con 0x7f17a00fa110 2021-10-08T19:25:29.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f1795ffb700 1 -- 172.21.15.157:0/262862401 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f1798009440 con 0x7f17a00fa110 2021-10-08T19:25:29.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1790005040 con 0x7f17a00fa110 2021-10-08T19:25:29.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f1795ffb700 1 -- 172.21.15.157:0/262862401 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798007b80 con 0x7f17a00fa110 2021-10-08T19:25:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.747+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a0110fa0 con 0x7f17a00fa110 2021-10-08T19:25:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.748+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a00f78d0 con 0x7f17a00fa110 2021-10-08T19:25:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.749+0000 7f1795ffb700 1 -- 172.21.15.157:0/262862401 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 80824+0+0 (secure 0 0 0) 0x7f179800f710 con 0x7f17a00fa110 2021-10-08T19:25:29.758 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.749+0000 7f1795ffb700 1 --2- 172.21.15.157:0/262862401 >> v2:172.21.15.157:6800/3606206634 conn(0x7f178c063410 0x7f178c0658c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:29.758 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.749+0000 7f17a530c700 1 -- 172.21.15.157:0/262862401 >> v2:172.21.15.157:6800/3606206634 conn(0x7f178c063410 msgr2=0x7f178c0658c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3606206634 2021-10-08T19:25:29.759 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.749+0000 7f1795ffb700 1 -- 172.21.15.157:0/262862401 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f179807f910 con 0x7f17a00fa110 2021-10-08T19:25:29.759 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.749+0000 7f17a530c700 1 --2- 172.21.15.157:0/262862401 >> v2:172.21.15.157:6800/3606206634 conn(0x7f178c063410 0x7f178c0658c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:25:29.759 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.753+0000 7f1795ffb700 1 -- 172.21.15.157:0/262862401 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f17980525f0 con 0x7f17a00fa110 2021-10-08T19:25:29.950 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.950+0000 7f17a530c700 1 -- 172.21.15.157:0/262862401 >> v2:172.21.15.157:6800/3606206634 conn(0x7f178c063410 msgr2=0x7f178c0658c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3606206634 2021-10-08T19:25:29.951 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.950+0000 7f17a530c700 1 --2- 172.21.15.157:0/262862401 >> v2:172.21.15.157:6800/3606206634 conn(0x7f178c063410 0x7f178c0658c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:25:29.979 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.979+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f17a0103400 con 0x7f17a00fa110 2021-10-08T19:25:29.983 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.982+0000 7f1795ffb700 1 -- 172.21.15.157:0/262862401 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (secure 0 0 0) 0x7f179801a050 con 0x7f17a00fa110 2021-10-08T19:25:29.983 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2021-10-08T19:25:29.983 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQApm2BhiyxuOhAA5wXmgFqDWn1YgQTTJsqQLQ== 2021-10-08T19:25:29.985 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.984+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 >> v2:172.21.15.157:6800/3606206634 conn(0x7f178c063410 msgr2=0x7f178c0658c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:25:29.986 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.984+0000 7f17a630e700 1 --2- 172.21.15.157:0/262862401 >> v2:172.21.15.157:6800/3606206634 conn(0x7f178c063410 0x7f178c0658c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.986 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.984+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00fa110 msgr2=0x7f17a0109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:29.986 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.984+0000 7f17a630e700 1 --2- 172.21.15.157:0/262862401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00fa110 0x7f17a0109d50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1798001c30 tx=0x7f1798004c50 comp rx=0 tx=0).stop 2021-10-08T19:25:29.986 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.985+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 shutdown_connections 2021-10-08T19:25:29.987 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.985+0000 7f17a630e700 1 --2- 172.21.15.157:0/262862401 >> v2:172.21.15.157:6800/3606206634 conn(0x7f178c063410 0x7f178c0658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.987 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.985+0000 7f17a630e700 1 --2- 172.21.15.157:0/262862401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17a00fa110 0x7f17a0109d50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.988 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.985+0000 7f17a630e700 1 --2- 172.21.15.157:0/262862401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17a00f84e0 0x7f17a0108970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.988 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.985+0000 7f17a630e700 1 --2- 172.21.15.157:0/262862401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17a00f9780 0x7f17a0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:29.988 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.985+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 >> 172.21.15.157:0/262862401 conn(0x7f17a00f3c30 msgr2=0x7f17a00fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:29.988 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.985+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 shutdown_connections 2021-10-08T19:25:29.989 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:29.985+0000 7f17a630e700 1 -- 172.21.15.157:0/262862401 wait complete. 2021-10-08T19:25:30.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:29 smithi157 ceph-mon[32847]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-10-08T19:25:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:29 smithi157 ceph-mon[32847]: mgrmap e17: y(active, since 4m), standbys: x 2021-10-08T19:25:30.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:29 smithi157 ceph-mon[42114]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-10-08T19:25:30.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:29 smithi157 ceph-mon[42114]: mgrmap e17: y(active, since 4m), standbys: x 2021-10-08T19:25:30.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:29 smithi196 ceph-mon[34258]: from='mgr.14150 172.21.15.157:0/3833200397' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-10-08T19:25:30.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:29 smithi196 ceph-mon[34258]: mgrmap e17: y(active, since 4m), standbys: x 2021-10-08T19:25:30.599 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:25:30.599 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-10-08T19:25:30.600 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-10-08T19:25:30.639 DEBUG:teuthology.orchestra.run.smithi196:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-10-08T19:25:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/262862401' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:25:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/262862401' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:25:31.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/262862401' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:25:31.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/262862401' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:25:31.094 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/262862401' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:25:31.095 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/262862401' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:25:32.737 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.736+0000 7f717d87b700 1 -- 172.21.15.196:0/1562585331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f8690 msgr2=0x7f71780f8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:32.738 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.736+0000 7f717d87b700 1 --2- 172.21.15.196:0/1562585331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f8690 0x7f71780f8ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71680046e0 tx=0x7f7168009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:32.738 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.736+0000 7f717d87b700 1 -- 172.21.15.196:0/1562585331 shutdown_connections 2021-10-08T19:25:32.738 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.736+0000 7f717d87b700 1 --2- 172.21.15.196:0/1562585331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780f9020 0x7f71780ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.739 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.736+0000 7f717d87b700 1 --2- 172.21.15.196:0/1562585331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780f73f0 0x7f71780f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.739 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.736+0000 7f717d87b700 1 --2- 172.21.15.196:0/1562585331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f8690 0x7f71780f8ae0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.739 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.736+0000 7f717d87b700 1 -- 172.21.15.196:0/1562585331 >> 172.21.15.196:0/1562585331 conn(0x7f71780f2b20 msgr2=0x7f71780f4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:32.739 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.736+0000 7f717d87b700 1 -- 172.21.15.196:0/1562585331 shutdown_connections 2021-10-08T19:25:32.739 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.736+0000 7f717d87b700 1 -- 172.21.15.196:0/1562585331 wait complete. 2021-10-08T19:25:32.742 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.737+0000 7f717d87b700 1 Processor -- start 2021-10-08T19:25:32.742 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.737+0000 7f717d87b700 1 -- start start 2021-10-08T19:25:32.743 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.737+0000 7f717d87b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780f73f0 0x7f717810b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:32.743 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f717d87b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780f8690 0x7f717810dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:32.743 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f717d87b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f9020 0x7f7178110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:32.744 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f717d87b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71781106b0 con 0x7f71780f8690 2021-10-08T19:25:32.744 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f717d87b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71781107f0 con 0x7f71780f9020 2021-10-08T19:25:32.744 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f717d87b700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7178110960 con 0x7f71780f73f0 2021-10-08T19:25:32.744 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71777fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f9020 0x7f7178110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:32.745 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71777fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f9020 0x7f7178110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49638/0 (socket says 172.21.15.196:49638) 2021-10-08T19:25:32.745 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71777fe700 1 -- 172.21.15.196:0/2573223113 learned_addr learned my addr 172.21.15.196:0/2573223113 (peer_addr_for_me v2:172.21.15.196:0/0) 2021-10-08T19:25:32.745 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f7176ffd700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780f73f0 0x7f717810b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:32.745 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71767fc700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780f8690 0x7f717810dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:32.745 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71777fe700 1 -- 172.21.15.196:0/2573223113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780f73f0 msgr2=0x7f717810b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:32.746 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71777fe700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780f73f0 0x7f717810b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.747 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71777fe700 1 -- 172.21.15.196:0/2573223113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780f8690 msgr2=0x7f717810dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:32.747 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71777fe700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780f8690 0x7f717810dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.747 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71777fe700 1 -- 172.21.15.196:0/2573223113 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168005040 con 0x7f71780f9020 2021-10-08T19:25:32.747 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71767fc700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780f8690 0x7f717810dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:25:32.748 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f71777fe700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f9020 0x7f7178110170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f717000d8d0 tx=0x7f7170004eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:32.748 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f715f7fe700 1 -- 172.21.15.196:0/2573223113 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71700125a0 con 0x7f71780f9020 2021-10-08T19:25:32.748 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7178110be0 con 0x7f71780f9020 2021-10-08T19:25:32.748 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f715f7fe700 1 -- 172.21.15.196:0/2573223113 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f717000f040 con 0x7f71780f9020 2021-10-08T19:25:32.748 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.738+0000 7f715f7fe700 1 -- 172.21.15.196:0/2573223113 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170013a10 con 0x7f71780f9020 2021-10-08T19:25:32.749 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.739+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71781110c0 con 0x7f71780f9020 2021-10-08T19:25:32.749 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.740+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71780472f0 con 0x7f71780f9020 2021-10-08T19:25:32.749 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.740+0000 7f715f7fe700 1 -- 172.21.15.196:0/2573223113 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) v1 ==== 80824+0+0 (secure 0 0 0) 0x7f717001d460 con 0x7f71780f9020 2021-10-08T19:25:32.750 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.740+0000 7f715f7fe700 1 --2- 172.21.15.196:0/2573223113 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7160063410 0x7f71600658c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:32.750 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.740+0000 7f7176ffd700 1 -- 172.21.15.196:0/2573223113 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7160063410 msgr2=0x7f71600658c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3606206634 2021-10-08T19:25:32.750 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.740+0000 7f715f7fe700 1 -- 172.21.15.196:0/2573223113 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f7170080070 con 0x7f71780f9020 2021-10-08T19:25:32.750 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.740+0000 7f7176ffd700 1 --2- 172.21.15.196:0/2573223113 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7160063410 0x7f71600658c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:25:32.751 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.745+0000 7f715f7fe700 1 -- 172.21.15.196:0/2573223113 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7170052c00 con 0x7f71780f9020 2021-10-08T19:25:32.942 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.941+0000 7f7176ffd700 1 -- 172.21.15.196:0/2573223113 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7160063410 msgr2=0x7f71600658c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3606206634 2021-10-08T19:25:32.942 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.941+0000 7f7176ffd700 1 --2- 172.21.15.196:0/2573223113 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7160063410 0x7f71600658c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:25:32.976 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.975+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f71780289c0 con 0x7f71780f9020 2021-10-08T19:25:32.980 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.980+0000 7f715f7fe700 1 -- 172.21.15.196:0/2573223113 <== mon.2 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) v1 ==== 170+0+59 (secure 0 0 0) 0x7f71700527f0 con 0x7f71780f9020 2021-10-08T19:25:32.981 INFO:teuthology.orchestra.run.smithi196.stdout:[client.1] 2021-10-08T19:25:32.981 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAsm2Bh4TNNOhAAW5NwBn11SFMk61uVsBVRtA== 2021-10-08T19:25:32.983 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7160063410 msgr2=0x7f71600658c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:25:32.983 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 --2- 172.21.15.196:0/2573223113 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7160063410 0x7f71600658c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.984 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f9020 msgr2=0x7f7178110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:32.984 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f9020 0x7f7178110170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f717000d8d0 tx=0x7f7170004eb0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.984 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 shutdown_connections 2021-10-08T19:25:32.984 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 --2- 172.21.15.196:0/2573223113 >> v2:172.21.15.157:6800/3606206634 conn(0x7f7160063410 0x7f71600658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.985 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71780f9020 0x7f7178110170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.985 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780f73f0 0x7f717810b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.985 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 --2- 172.21.15.196:0/2573223113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780f8690 0x7f717810dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:32.985 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 >> 172.21.15.196:0/2573223113 conn(0x7f71780f2b20 msgr2=0x7f71780f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:32.985 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 shutdown_connections 2021-10-08T19:25:32.986 INFO:teuthology.orchestra.run.smithi196.stderr:2021-10-08T19:25:32.982+0000 7f717d87b700 1 -- 172.21.15.196:0/2573223113 wait complete. 2021-10-08T19:25:33.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.196:0/2573223113' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:25:33.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:25:33.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:25:33.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.196:0/2573223113' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:25:33.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:25:33.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:25:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.196:0/2573223113' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:25:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:25:33.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:25:33.685 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2021-10-08T19:25:33.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-10-08T19:25:33.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-10-08T19:25:33.724 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:25:34.133 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:34.608 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[32847]: Standby manager daemon x restarted 2021-10-08T19:25:34.608 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[32847]: Standby manager daemon x started 2021-10-08T19:25:34.609 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[32847]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:25:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:34 smithi196 ceph-mon[34258]: Standby manager daemon x restarted 2021-10-08T19:25:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:34 smithi196 ceph-mon[34258]: Standby manager daemon x started 2021-10-08T19:25:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:34 smithi196 ceph-mon[34258]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:25:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:34 smithi196 ceph-mon[34258]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:25:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:34 smithi196 ceph-mon[34258]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:25:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:34 smithi196 ceph-mon[34258]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:25:34.868 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:25:34 smithi196 conmon[36265]: [08/Oct/2021:19:25:34] ENGINE Bus STARTING 2021-10-08T19:25:34.869 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:25:34 smithi196 conmon[36265]: CherryPy Checker: 2021-10-08T19:25:34.869 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:25:34 smithi196 conmon[36265]: The Application mounted at '' has an empty config. 2021-10-08T19:25:34.869 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:25:34 smithi196 conmon[36265]: 2021-10-08T19:25:34.869 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:25:34 smithi196 conmon[36265]: [08/Oct/2021:19:25:34] ENGINE Serving on http://:::9283 2021-10-08T19:25:34.870 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:25:34 smithi196 conmon[36265]: [08/Oct/2021:19:25:34] ENGINE Bus STARTED 2021-10-08T19:25:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[32847]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:25:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[32847]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:25:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[32847]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:25:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[42114]: Standby manager daemon x restarted 2021-10-08T19:25:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[42114]: Standby manager daemon x started 2021-10-08T19:25:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[42114]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:25:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[42114]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:25:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[42114]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:25:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:34 smithi157 ceph-mon[42114]: from='mgr.? 172.21.15.196:0/1475038030' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:25:35.746 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 -- 172.21.15.157:0/2047153008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 msgr2=0x7f24780fd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:35.746 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 --2- 172.21.15.157:0/2047153008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 0x7f24780fd6a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24680046e0 tx=0x7f2468009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:35.746 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 -- 172.21.15.157:0/2047153008 shutdown_connections 2021-10-08T19:25:35.747 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 --2- 172.21.15.157:0/2047153008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2478100500 0x7f2478102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:35.747 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 --2- 172.21.15.157:0/2047153008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 0x7f24780fd6a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:35.747 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 --2- 172.21.15.157:0/2047153008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f24780fdbe0 0x7f24780fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:35.747 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 -- 172.21.15.157:0/2047153008 >> 172.21.15.157:0/2047153008 conn(0x7f24780f2d90 msgr2=0x7f24780f51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 -- 172.21.15.157:0/2047153008 shutdown_connections 2021-10-08T19:25:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 -- 172.21.15.157:0/2047153008 wait complete. 2021-10-08T19:25:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.743+0000 7f247e713700 1 Processor -- start 2021-10-08T19:25:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247e713700 1 -- start start 2021-10-08T19:25:35.749 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247e713700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 0x7f247810ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:35.749 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247e713700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24780fdbe0 0x7f247810b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:35.749 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247e713700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478100500 0x7f24781121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:35.749 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247e713700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2478112740 con 0x7f2478062610 2021-10-08T19:25:35.749 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247e713700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24781128b0 con 0x7f24780fdbe0 2021-10-08T19:25:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247e713700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2478112a70 con 0x7f2478100500 2021-10-08T19:25:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247ccb0700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478100500 0x7f24781121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f2477fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 0x7f247810ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f2477fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 0x7f247810ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40780/0 (socket says 172.21.15.157:40780) 2021-10-08T19:25:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247ccb0700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478100500 0x7f24781121c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50030/0 (socket says 172.21.15.157:50030) 2021-10-08T19:25:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f2477fff700 1 -- 172.21.15.157:0/1414632311 learned_addr learned my addr 172.21.15.157:0/1414632311 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:25:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f2477fff700 1 -- 172.21.15.157:0/1414632311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478100500 msgr2=0x7f24781121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f2477fff700 1 --2- 172.21.15.157:0/1414632311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478100500 0x7f24781121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f2477fff700 1 -- 172.21.15.157:0/1414632311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24780fdbe0 msgr2=0x7f247810b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:35.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f2477fff700 1 --2- 172.21.15.157:0/1414632311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24780fdbe0 0x7f247810b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:35.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f2477fff700 1 -- 172.21.15.157:0/1414632311 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c005040 con 0x7f2478062610 2021-10-08T19:25:35.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f247ccb0700 1 --2- 172.21.15.157:0/1414632311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478100500 0x7f24781121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:25:35.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.744+0000 7f2477fff700 1 --2- 172.21.15.157:0/1414632311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 0x7f247810ac30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2468009f50 tx=0x7f2468009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:35.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.745+0000 7f2474ff9700 1 -- 172.21.15.157:0/1414632311 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468009510 con 0x7f2478062610 2021-10-08T19:25:35.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.745+0000 7f2474ff9700 1 -- 172.21.15.157:0/1414632311 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f2468009670 con 0x7f2478062610 2021-10-08T19:25:35.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.745+0000 7f2474ff9700 1 -- 172.21.15.157:0/1414632311 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246801cb00 con 0x7f2478062610 2021-10-08T19:25:35.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.745+0000 7f247e713700 1 -- 172.21.15.157:0/1414632311 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2468005040 con 0x7f2478062610 2021-10-08T19:25:35.755 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.745+0000 7f247e713700 1 -- 172.21.15.157:0/1414632311 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2478112f90 con 0x7f2478062610 2021-10-08T19:25:35.755 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.746+0000 7f247e713700 1 -- 172.21.15.157:0/1414632311 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24780289c0 con 0x7f2478062610 2021-10-08T19:25:35.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.747+0000 7f2474ff9700 1 -- 172.21.15.157:0/1414632311 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 80503+0+0 (secure 0 0 0) 0x7f2468007920 con 0x7f2478062610 2021-10-08T19:25:35.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.747+0000 7f2474ff9700 1 -- 172.21.15.157:0/1414632311 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f2468080d30 con 0x7f2478062610 2021-10-08T19:25:35.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.752+0000 7f2474ff9700 1 -- 172.21.15.157:0/1414632311 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f2468050050 con 0x7f2478062610 2021-10-08T19:25:35.759 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:35 smithi157 ceph-mon[32847]: mgrmap e18: y(active, since 4m), standbys: x 2021-10-08T19:25:35.759 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:35 smithi157 ceph-mon[32847]: Active manager daemon y restarted 2021-10-08T19:25:35.759 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:35 smithi157 ceph-mon[32847]: Activating manager daemon y 2021-10-08T19:25:35.760 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:35 smithi157 ceph-mon[32847]: osdmap e66: 8 total, 8 up, 8 in 2021-10-08T19:25:35.760 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:35 smithi157 conmon[33269]: [08/Oct/2021:19:25:35] ENGINE Bus STARTING 2021-10-08T19:25:35.761 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:35 smithi157 ceph-mon[42114]: mgrmap e18: y(active, since 4m), standbys: x 2021-10-08T19:25:35.761 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:35 smithi157 ceph-mon[42114]: Active manager daemon y restarted 2021-10-08T19:25:35.761 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:35 smithi157 ceph-mon[42114]: Activating manager daemon y 2021-10-08T19:25:35.761 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:35 smithi157 ceph-mon[42114]: osdmap e66: 8 total, 8 up, 8 in 2021-10-08T19:25:35.928 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.927+0000 7f247e713700 1 -- 172.21.15.157:0/1414632311 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24780f45c0 con 0x7f2478062610 2021-10-08T19:25:35.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.928+0000 7f2474ff9700 1 -- 172.21.15.157:0/1414632311 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+19229 (secure 0 0 0) 0x7f2468053670 con 0x7f2478062610 2021-10-08T19:25:35.930 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:25:35.930 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":66,"fsid":"906d7a14-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:20:03.138859+0000","modified":"2021-10-08T19:25:34.724596+0000","last_up_change":"2021-10-08T19:24:58.596843+0000","last_in_change":"2021-10-08T19:24:43.105089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:23:27.875376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:25:05.727043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:25:06.517474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:25:07.082305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:25:09.047171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:25:11.108303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"0872c520-e1e2-49e4-b0d2-02dad0732102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6801","nonce":1113941339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1113941339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1113941339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":1113941339}]},"public_addr":"172.21.15.157:6801/1113941339","cluster_addr":"172.21.15.157:6802/1113941339","heartbeat_back_addr":"172.21.15.157:6804/1113941339","heartbeat_front_addr":"172.21.15.157:6803/1113941339","state":["exists","up"]},{"osd":1,"uuid":"5c8904ce-90a6-414e-bedb-2c8cbdd3649b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6805","nonce":336233855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":336233855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":336233855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":336233855}]},"public_addr":"172.21.15.157:6805/336233855","cluster_addr":"172.21.15.157:6806/336233855","heartbeat_back_addr":"172.21.15.157:6808/336233855","heartbeat_front_addr":"172.21.15.157:6807/336233855","state":["exists","up"]},{"osd":2,"uuid":"a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":2873488643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2873488643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2873488643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":2873488643}]},"public_addr":"172.21.15.157:6809/2873488643","cluster_addr":"172.21.15.157:6810/2873488643","heartbeat_back_addr":"172.21.15.157:6812/2873488643","heartbeat_front_addr":"172.21.15.157:6811/2873488643","state":["exists","up"]},{"osd":3,"uuid":"a8da5733-a379-4817-a7ec-f46eafc1120f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":2430876343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2430876343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2430876343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":2430876343}]},"public_addr":"172.21.15.157:6813/2430876343","cluster_addr":"172.21.15.157:6814/2430876343","heartbeat_back_addr":"172.21.15.157:6816/2430876343","heartbeat_front_addr":"172.21.15.157:6815/2430876343","state":["exists","up"]},{"osd":4,"uuid":"88f55088-575c-4785-9c03-b24432151873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2530339252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":2530339252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6803","nonce":2530339252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2530339252}]},"public_addr":"172.21.15.196:6800/2530339252","cluster_addr":"172.21.15.196:6801/2530339252","heartbeat_back_addr":"172.21.15.196:6803/2530339252","heartbeat_front_addr":"172.21.15.196:6802/2530339252","state":["exists","up"]},{"osd":5,"uuid":"5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3344395065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":3344395065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":3344395065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3344395065}]},"public_addr":"172.21.15.196:6804/3344395065","cluster_addr":"172.21.15.196:6805/3344395065","heartbeat_back_addr":"172.21.15.196:6807/3344395065","heartbeat_front_addr":"172.21.15.196:6806/3344395065","state":["exists","up"]},{"osd":6,"uuid":"76cb7be3-7318-43cf-a34b-b86d2ef15bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":892194681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":892194681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6811","nonce":892194681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":892194681}]},"public_addr":"172.21.15.196:6808/892194681","cluster_addr":"172.21.15.196:6809/892194681","heartbeat_back_addr":"172.21.15.196:6811/892194681","heartbeat_front_addr":"172.21.15.196:6810/892194681","state":["exists","up"]},{"osd":7,"uuid":"66c7dc80-3bf0-47fe-8ec0-1352aae1a017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1866932410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":1866932410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1866932410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1866932410}]},"public_addr":"172.21.15.196:6812/1866932410","cluster_addr":"172.21.15.196:6813/1866932410","heartbeat_back_addr":"172.21.15.196:6815/1866932410","heartbeat_front_addr":"172.21.15.196:6814/1866932410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:48.440918+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:06.827358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:24.350047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:42.428480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:01.573333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:20.350984+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:38.627581+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:57.542353+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:0/3518861281":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/807653046":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/148035507":"2021-10-09T19:25:34.724551+0000","172.21.15.157:6800/3606206634":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/3965610325":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/1473441418":"2021-10-09T19:20:48.876877+0000","172.21.15.157:0/2931446654":"2021-10-09T19:20:48.876877+0000","172.21.15.157:0/772241757":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/2841195277":"2021-10-09T19:20:26.319723+0000","172.21.15.157:6800/4161241346":"2021-10-09T19:20:48.876877+0000","172.21.15.157:0/1646573385":"2021-10-09T19:20:26.319723+0000","172.21.15.157:0/2844775135":"2021-10-09T19:20:26.319723+0000","172.21.15.157:0/1515093903":"2021-10-09T19:20:48.876877+0000","172.21.15.157:6800/3137430012":"2021-10-09T19:20:26.319723+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:25:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.930+0000 7f247e713700 1 -- 172.21.15.157:0/1414632311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 msgr2=0x7f247810ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.930+0000 7f247e713700 1 --2- 172.21.15.157:0/1414632311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 0x7f247810ac30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2468009f50 tx=0x7f2468009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.930+0000 7f247e713700 1 -- 172.21.15.157:0/1414632311 shutdown_connections 2021-10-08T19:25:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.930+0000 7f247e713700 1 --2- 172.21.15.157:0/1414632311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478100500 0x7f24781121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.930+0000 7f247e713700 1 --2- 172.21.15.157:0/1414632311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2478062610 0x7f247810ac30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.930+0000 7f247e713700 1 --2- 172.21.15.157:0/1414632311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24780fdbe0 0x7f247810b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.930+0000 7f247e713700 1 -- 172.21.15.157:0/1414632311 >> 172.21.15.157:0/1414632311 conn(0x7f24780f2d90 msgr2=0x7f24780fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.930+0000 7f247e713700 1 -- 172.21.15.157:0/1414632311 shutdown_connections 2021-10-08T19:25:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:35.930+0000 7f247e713700 1 -- 172.21.15.157:0/1414632311 wait complete. 2021-10-08T19:25:36.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:35 smithi157 conmon[33269]: CherryPy Checker: 2021-10-08T19:25:36.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:35 smithi157 conmon[33269]: The Application mounted at '' has an empty config. 2021-10-08T19:25:36.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:35 smithi157 conmon[33269]: 2021-10-08T19:25:36.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:35 smithi157 conmon[33269]: [08/Oct/2021:19:25:35] ENGINE Serving on http://:::9283 2021-10-08T19:25:36.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:35 smithi157 conmon[33269]: [08/Oct/2021:19:25:35] ENGINE Bus STARTED 2021-10-08T19:25:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:35 smithi196 ceph-mon[34258]: mgrmap e18: y(active, since 4m), standbys: x 2021-10-08T19:25:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:35 smithi196 ceph-mon[34258]: Active manager daemon y restarted 2021-10-08T19:25:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:35 smithi196 ceph-mon[34258]: Activating manager daemon y 2021-10-08T19:25:36.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:35 smithi196 ceph-mon[34258]: osdmap e66: 8 total, 8 up, 8 in 2021-10-08T19:25:36.422 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:36 smithi157 conmon[33269]: [08/Oct/2021:19:25:36] ENGINE Bus STARTING 2021-10-08T19:25:36.422 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:36 smithi157 conmon[33269]: [08/Oct/2021:19:25:36] ENGINE Serving on https://172.21.15.157:8499 2021-10-08T19:25:36.423 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:36 smithi157 conmon[33269]: [08/Oct/2021:19:25:36] ENGINE Bus STARTED 2021-10-08T19:25:36.614 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:23:27.875376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:25:05.727043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:25:06.517474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:25:07.082305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:25:09.047171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:25:11.108303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}] 2021-10-08T19:25:36.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd pool get .mgr pg_num 2021-10-08T19:25:36.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: mgrmap e19: y(active, starting, since 0.894348s), standbys: x 2021-10-08T19:25:36.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:25:36.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:25:36.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:25:36.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:25:36.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:25:36.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:25:36.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:25:36.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:25:36.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:25:36.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:25:36.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:36.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:36.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:36.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:25:36.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:25:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:25:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: Manager daemon y is now available 2021-10-08T19:25:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: mgrmap e19: y(active, starting, since 0.894348s), standbys: x 2021-10-08T19:25:36.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:25:36.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:25:36.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:25:36.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:25:36.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:25:36.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:25:36.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:25:36.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:25:36.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:25:36.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:25:36.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:36.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:36.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:36.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:25:36.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:25:36.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:25:36.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: Manager daemon y is now available 2021-10-08T19:25:36.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:36.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:36.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:36.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:36.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]': finished 2021-10-08T19:25:36.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]': finished 2021-10-08T19:25:36.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: Updating smithi157:/etc/ceph/ceph.conf 2021-10-08T19:25:36.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: Updating smithi196:/etc/ceph/ceph.conf 2021-10-08T19:25:36.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:36.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:36.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:36.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:36.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1414632311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:25:36.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi157", "caps": []}]: dispatch 2021-10-08T19:25:36.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi157", "caps": []}]: dispatch 2021-10-08T19:25:36.846 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]': finished 2021-10-08T19:25:36.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]': finished 2021-10-08T19:25:36.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: Updating smithi157:/etc/ceph/ceph.conf 2021-10-08T19:25:36.847 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: Updating smithi196:/etc/ceph/ceph.conf 2021-10-08T19:25:36.848 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:36.848 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:36.848 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:36.848 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:36.849 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1414632311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:25:36.849 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.849 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.849 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.849 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi157", "caps": []}]: dispatch 2021-10-08T19:25:36.850 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi157", "caps": []}]: dispatch 2021-10-08T19:25:36.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:36 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:25:36.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: mgrmap e19: y(active, starting, since 0.894348s), standbys: x 2021-10-08T19:25:36.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:25:36.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:25:36.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:25:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:25:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:25:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:25:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:25:36.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:25:36.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:25:36.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:25:36.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:36.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:36.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:36.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:25:36.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:25:36.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:25:36.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: Manager daemon y is now available 2021-10-08T19:25:36.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:36.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:36.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:36.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:36.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:36.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]': finished 2021-10-08T19:25:36.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]': finished 2021-10-08T19:25:36.875 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: Updating smithi157:/etc/ceph/ceph.conf 2021-10-08T19:25:36.875 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: Updating smithi196:/etc/ceph/ceph.conf 2021-10-08T19:25:36.875 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:36.875 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:36.876 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:36.876 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:36.876 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1414632311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:25:36.876 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.876 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.877 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:36.877 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi157", "caps": []}]: dispatch 2021-10-08T19:25:36.877 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi157", "caps": []}]: dispatch 2021-10-08T19:25:36.904 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:37.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: Executing () created at /lib64/python3.6/asyncio/futures.py:343> took 0.219 seconds 2021-10-08T19:25:37.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: Starting cherrypy engine... 2021-10-08T19:25:37.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: [08/Oct/2021:19:25:36] ENGINE Bus STARTING 2021-10-08T19:25:37.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: [08/Oct/2021:19:25:36] ENGINE Serving on https://172.21.15.157:8499 2021-10-08T19:25:37.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: [08/Oct/2021:19:25:36] ENGINE Bus STARTED 2021-10-08T19:25:37.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: Cherrypy engine started. 2021-10-08T19:25:37.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:25:37.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:25:37.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:37.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: Reconfiguring agent.smithi157 (dependencies changed)... 2021-10-08T19:25:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: mgrmap e20: y(active, since 1.9134s), standbys: x 2021-10-08T19:25:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[42114]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:37.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: Executing () created at /lib64/python3.6/asyncio/futures.py:343> took 0.219 seconds 2021-10-08T19:25:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: Starting cherrypy engine... 2021-10-08T19:25:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: [08/Oct/2021:19:25:36] ENGINE Bus STARTING 2021-10-08T19:25:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: [08/Oct/2021:19:25:36] ENGINE Serving on https://172.21.15.157:8499 2021-10-08T19:25:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: [08/Oct/2021:19:25:36] ENGINE Bus STARTED 2021-10-08T19:25:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: Cherrypy engine started. 2021-10-08T19:25:37.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:25:37.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:25:37.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:37.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: Reconfiguring agent.smithi157 (dependencies changed)... 2021-10-08T19:25:37.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: mgrmap e20: y(active, since 1.9134s), standbys: x 2021-10-08T19:25:37.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:37.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:37 smithi157 ceph-mon[32847]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: Executing () created at /lib64/python3.6/asyncio/futures.py:343> took 0.219 seconds 2021-10-08T19:25:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: Starting cherrypy engine... 2021-10-08T19:25:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: [08/Oct/2021:19:25:36] ENGINE Bus STARTING 2021-10-08T19:25:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: [08/Oct/2021:19:25:36] ENGINE Serving on https://172.21.15.157:8499 2021-10-08T19:25:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: [08/Oct/2021:19:25:36] ENGINE Bus STARTED 2021-10-08T19:25:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: Cherrypy engine started. 2021-10-08T19:25:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:25:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:25:38.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:38.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: Reconfiguring agent.smithi157 (dependencies changed)... 2021-10-08T19:25:38.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: mgrmap e20: y(active, since 1.9134s), standbys: x 2021-10-08T19:25:38.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:38.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:37 smithi196 ceph-mon[34258]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 -- 172.21.15.157:0/1310907944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c40fefa0 msgr2=0x7f69c4061990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:38.536 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 --2- 172.21.15.157:0/1310907944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c40fefa0 0x7f69c4061990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f69b4004710 tx=0x7f69b4009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:38.536 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 -- 172.21.15.157:0/1310907944 shutdown_connections 2021-10-08T19:25:38.536 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 --2- 172.21.15.157:0/1310907944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69c4062070 0x7f69c4105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:38.536 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 --2- 172.21.15.157:0/1310907944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c40fe600 0x7f69c40fe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:38.536 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 --2- 172.21.15.157:0/1310907944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c40fefa0 0x7f69c4061990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:38.537 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 -- 172.21.15.157:0/1310907944 >> 172.21.15.157:0/1310907944 conn(0x7f69c406e330 msgr2=0x7f69c406e730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:38.537 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 -- 172.21.15.157:0/1310907944 shutdown_connections 2021-10-08T19:25:38.537 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 -- 172.21.15.157:0/1310907944 wait complete. 2021-10-08T19:25:38.538 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.532+0000 7f69c359e700 1 Processor -- start 2021-10-08T19:25:38.538 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c359e700 1 -- start start 2021-10-08T19:25:38.538 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c359e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69c4062070 0x7f69c410eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:38.538 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c359e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c40fe600 0x7f69c410eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:38.539 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c40fefa0 0x7f69c4108970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:38.539 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4108f40 con 0x7f69c40fefa0 2021-10-08T19:25:38.539 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c359e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41090b0 con 0x7f69c40fe600 2021-10-08T19:25:38.540 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c359e700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4109270 con 0x7f69c4062070 2021-10-08T19:25:38.540 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c259c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69c4062070 0x7f69c410eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:38.540 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c259c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69c4062070 0x7f69c410eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50080/0 (socket says 172.21.15.157:50080) 2021-10-08T19:25:38.540 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c259c700 1 -- 172.21.15.157:0/3374296791 learned_addr learned my addr 172.21.15.157:0/3374296791 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:25:38.541 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c2d9d700 1 --2- 172.21.15.157:0/3374296791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c40fefa0 0x7f69c4108970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:38.541 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c2d9d700 1 -- 172.21.15.157:0/3374296791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69c4062070 msgr2=0x7f69c410eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:38.541 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c2d9d700 1 --2- 172.21.15.157:0/3374296791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69c4062070 0x7f69c410eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:38.541 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c2d9d700 1 -- 172.21.15.157:0/3374296791 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c40fe600 msgr2=0x7f69c410eff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-10-08T19:25:38.542 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c2d9d700 1 --2- 172.21.15.157:0/3374296791 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c40fe600 0x7f69c410eff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:38.542 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c2d9d700 1 -- 172.21.15.157:0/3374296791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc009640 con 0x7f69c40fefa0 2021-10-08T19:25:38.542 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c259c700 1 --2- 172.21.15.157:0/3374296791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69c4062070 0x7f69c410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:25:38.542 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69c2d9d700 1 --2- 172.21.15.157:0/3374296791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c40fefa0 0x7f69c4108970 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f69bc001c80 tx=0x7f69bc004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:38.542 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.533+0000 7f69b2ffd700 1 -- 172.21.15.157:0/3374296791 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0092e0 con 0x7f69c40fefa0 2021-10-08T19:25:38.543 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.534+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b4005040 con 0x7f69c40fefa0 2021-10-08T19:25:38.543 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.534+0000 7f69b2ffd700 1 -- 172.21.15.157:0/3374296791 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f69bc009440 con 0x7f69c40fefa0 2021-10-08T19:25:38.543 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.534+0000 7f69b2ffd700 1 -- 172.21.15.157:0/3374296791 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc007bf0 con 0x7f69c40fefa0 2021-10-08T19:25:38.543 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.534+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c41158b0 con 0x7f69c40fefa0 2021-10-08T19:25:38.545 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.535+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c406fe50 con 0x7f69c40fefa0 2021-10-08T19:25:38.545 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.535+0000 7f69b2ffd700 1 -- 172.21.15.157:0/3374296791 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f69bc01c030 con 0x7f69c40fefa0 2021-10-08T19:25:38.545 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.535+0000 7f69b2ffd700 1 --2- 172.21.15.157:0/3374296791 >> v2:172.21.15.157:6800/1475557172 conn(0x7f69ac0635a0 0x7f69ac065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:38.545 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.535+0000 7f69b2ffd700 1 -- 172.21.15.157:0/3374296791 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f69bc07fb50 con 0x7f69c40fefa0 2021-10-08T19:25:38.546 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.535+0000 7f69c259c700 1 --2- 172.21.15.157:0/3374296791 >> v2:172.21.15.157:6800/1475557172 conn(0x7f69ac0635a0 0x7f69ac065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:38.546 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.536+0000 7f69c259c700 1 --2- 172.21.15.157:0/3374296791 >> v2:172.21.15.157:6800/1475557172 conn(0x7f69ac0635a0 0x7f69ac065a50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69b80041d0 tx=0x7f69b800b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:38.546 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.539+0000 7f69b2ffd700 1 -- 172.21.15.157:0/3374296791 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f69bc052770 con 0x7f69c40fefa0 2021-10-08T19:25:38.716 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.711+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69c40472f0 con 0x7f69c40fefa0 2021-10-08T19:25:38.717 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.712+0000 7f69b2ffd700 1 -- 172.21.15.157:0/3374296791 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69bc052360 con 0x7f69c40fefa0 2021-10-08T19:25:38.717 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2021-10-08T19:25:38.718 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 >> v2:172.21.15.157:6800/1475557172 conn(0x7f69ac0635a0 msgr2=0x7f69ac065a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:38.718 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 --2- 172.21.15.157:0/3374296791 >> v2:172.21.15.157:6800/1475557172 conn(0x7f69ac0635a0 0x7f69ac065a50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69b80041d0 tx=0x7f69b800b040 comp rx=0 tx=0).stop 2021-10-08T19:25:38.719 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c40fefa0 msgr2=0x7f69c4108970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:38.719 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 --2- 172.21.15.157:0/3374296791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c40fefa0 0x7f69c4108970 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f69bc001c80 tx=0x7f69bc004c50 comp rx=0 tx=0).stop 2021-10-08T19:25:38.719 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 shutdown_connections 2021-10-08T19:25:38.719 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 --2- 172.21.15.157:0/3374296791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c40fefa0 0x7f69c4108970 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:38.720 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 --2- 172.21.15.157:0/3374296791 >> v2:172.21.15.157:6800/1475557172 conn(0x7f69ac0635a0 0x7f69ac065a50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:38.720 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 --2- 172.21.15.157:0/3374296791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69c4062070 0x7f69c410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:38.720 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 --2- 172.21.15.157:0/3374296791 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c40fe600 0x7f69c410eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:38.720 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 >> 172.21.15.157:0/3374296791 conn(0x7f69c406e330 msgr2=0x7f69c40fc460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:38.720 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 shutdown_connections 2021-10-08T19:25:38.721 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:38.714+0000 7f69c359e700 1 -- 172.21.15.157:0/3374296791 wait complete. 2021-10-08T19:25:39.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:38 smithi157 ceph-mon[32847]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:39.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:38 smithi157 ceph-mon[32847]: mgrmap e21: y(active, since 2s), standbys: x 2021-10-08T19:25:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:38 smithi157 ceph-mon[42114]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:38 smithi157 ceph-mon[42114]: mgrmap e21: y(active, since 2s), standbys: x 2021-10-08T19:25:39.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:38 smithi196 ceph-mon[34258]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:38 smithi196 ceph-mon[34258]: mgrmap e21: y(active, since 2s), standbys: x 2021-10-08T19:25:39.412 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd pool get .rgw.root pg_num 2021-10-08T19:25:39.677 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[42114]: Reconfiguring daemon agent.smithi157 on smithi157 2021-10-08T19:25:39.677 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[42114]: poll took 1407.630 ms: 1 events 2021-10-08T19:25:39.677 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[42114]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.182 seconds 2021-10-08T19:25:39.677 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:39.678 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[42114]: Reconfiguring agent.smithi196 (dependencies changed)... 2021-10-08T19:25:39.678 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]: dispatch 2021-10-08T19:25:39.678 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]: dispatch 2021-10-08T19:25:39.678 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3374296791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2021-10-08T19:25:39.679 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[32847]: Reconfiguring daemon agent.smithi157 on smithi157 2021-10-08T19:25:39.679 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[32847]: poll took 1407.630 ms: 1 events 2021-10-08T19:25:39.679 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[32847]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.182 seconds 2021-10-08T19:25:39.679 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:39.680 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[32847]: Reconfiguring agent.smithi196 (dependencies changed)... 2021-10-08T19:25:39.680 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]: dispatch 2021-10-08T19:25:39.680 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]: dispatch 2021-10-08T19:25:39.680 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:39 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3374296791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2021-10-08T19:25:40.001 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:40.044 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:39 smithi196 ceph-mon[34258]: Reconfiguring daemon agent.smithi157 on smithi157 2021-10-08T19:25:40.045 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:39 smithi196 ceph-mon[34258]: poll took 1407.630 ms: 1 events 2021-10-08T19:25:40.045 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:39 smithi196 ceph-mon[34258]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.182 seconds 2021-10-08T19:25:40.045 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:39 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:40.046 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:39 smithi196 ceph-mon[34258]: Reconfiguring agent.smithi196 (dependencies changed)... 2021-10-08T19:25:40.046 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:39 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]: dispatch 2021-10-08T19:25:40.046 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:39 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi196", "caps": []}]: dispatch 2021-10-08T19:25:40.046 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:39 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3374296791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2021-10-08T19:25:40.772 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:40 smithi196 ceph-mon[34258]: Reconfiguring daemon agent.smithi196 on smithi196 2021-10-08T19:25:40.773 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:40 smithi196 ceph-mon[34258]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.184 seconds 2021-10-08T19:25:40.773 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:40 smithi196 ceph-mon[34258]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:40.773 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:40 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:40.774 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:40 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:40.774 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:40 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:40.774 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:40 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:40.774 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:40 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:40.929 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[32847]: Reconfiguring daemon agent.smithi196 on smithi196 2021-10-08T19:25:40.929 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[32847]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.184 seconds 2021-10-08T19:25:40.929 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[32847]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:40.930 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:40.930 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:40.930 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:40.930 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:40.930 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:40.931 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[42114]: Reconfiguring daemon agent.smithi196 on smithi196 2021-10-08T19:25:40.932 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[42114]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.184 seconds 2021-10-08T19:25:40.932 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[42114]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:40.932 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:40.933 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:40.933 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:40.933 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:40.933 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:40 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:42.006 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:41 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:42.007 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:41 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:41 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:25:42.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:42 smithi196 ceph-mon[34258]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.916+0000 7f851cced700 1 -- 172.21.15.157:0/2295880599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85180fe7f0 msgr2=0x7f85180febc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.916+0000 7f851cced700 1 --2- 172.21.15.157:0/2295880599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85180fe7f0 0x7f85180febc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85080046e0 tx=0x7f8508009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.916+0000 7f851cced700 1 -- 172.21.15.157:0/2295880599 shutdown_connections 2021-10-08T19:25:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.916+0000 7f851cced700 1 --2- 172.21.15.157:0/2295880599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85180f7880 0x7f8518105550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.916+0000 7f851cced700 1 --2- 172.21.15.157:0/2295880599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85180fe7f0 0x7f85180febc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.916+0000 7f851cced700 1 --2- 172.21.15.157:0/2295880599 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85180f6ed0 0x7f85180f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.916+0000 7f851cced700 1 -- 172.21.15.157:0/2295880599 >> 172.21.15.157:0/2295880599 conn(0x7f851806cf40 msgr2=0x7f851806d340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:42.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.916+0000 7f851cced700 1 -- 172.21.15.157:0/2295880599 shutdown_connections 2021-10-08T19:25:42.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.916+0000 7f851cced700 1 -- 172.21.15.157:0/2295880599 wait complete. 2021-10-08T19:25:42.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f851cced700 1 Processor -- start 2021-10-08T19:25:42.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f851cced700 1 -- start start 2021-10-08T19:25:42.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f851cced700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85180f6ed0 0x7f85180f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:42.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f851cced700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85180f7880 0x7f85180f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:42.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f851cced700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85180fe7f0 0x7f85180f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:42.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f851cced700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8518116fc0 con 0x7f85180f7880 2021-10-08T19:25:42.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f851cced700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8518117130 con 0x7f85180f6ed0 2021-10-08T19:25:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f851cced700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85181172f0 con 0x7f85180fe7f0 2021-10-08T19:25:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f8516d9d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85180fe7f0 0x7f85180f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f8516d9d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85180fe7f0 0x7f85180f8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50096/0 (socket says 172.21.15.157:50096) 2021-10-08T19:25:42.924 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f8516d9d700 1 -- 172.21.15.157:0/418950333 learned_addr learned my addr 172.21.15.157:0/418950333 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:25:42.924 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f851659c700 1 --2- 172.21.15.157:0/418950333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85180f6ed0 0x7f85180f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:42.924 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f8516d9d700 1 -- 172.21.15.157:0/418950333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85180f6ed0 msgr2=0x7f85180f80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f8516d9d700 1 --2- 172.21.15.157:0/418950333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85180f6ed0 0x7f85180f80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f8516d9d700 1 -- 172.21.15.157:0/418950333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85180f7880 msgr2=0x7f85180f85f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:25:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f8516d9d700 1 --2- 172.21.15.157:0/418950333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85180f7880 0x7f85180f85f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f8516d9d700 1 -- 172.21.15.157:0/418950333 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c005040 con 0x7f85180fe7f0 2021-10-08T19:25:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.917+0000 7f8516d9d700 1 --2- 172.21.15.157:0/418950333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85180fe7f0 0x7f85180f8b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f851000c810 tx=0x7f8510004cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.918+0000 7f8506ffd700 1 -- 172.21.15.157:0/418950333 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85100115b0 con 0x7f85180fe7f0 2021-10-08T19:25:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.918+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8508005040 con 0x7f85180fe7f0 2021-10-08T19:25:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.918+0000 7f8506ffd700 1 -- 172.21.15.157:0/418950333 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f8510004df0 con 0x7f85180fe7f0 2021-10-08T19:25:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.918+0000 7f8506ffd700 1 -- 172.21.15.157:0/418950333 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8510012b30 con 0x7f85180fe7f0 2021-10-08T19:25:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.918+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85181178e0 con 0x7f85180fe7f0 2021-10-08T19:25:42.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.919+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8518047b50 con 0x7f85180fe7f0 2021-10-08T19:25:42.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.920+0000 7f8506ffd700 1 -- 172.21.15.157:0/418950333 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f8510010070 con 0x7f85180fe7f0 2021-10-08T19:25:42.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.920+0000 7f8506ffd700 1 --2- 172.21.15.157:0/418950333 >> v2:172.21.15.157:6800/1475557172 conn(0x7f85000635b0 0x7f8500065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:42.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.920+0000 7f8506ffd700 1 -- 172.21.15.157:0/418950333 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f8510080a80 con 0x7f85180fe7f0 2021-10-08T19:25:42.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.920+0000 7f851659c700 1 --2- 172.21.15.157:0/418950333 >> v2:172.21.15.157:6800/1475557172 conn(0x7f85000635b0 0x7f8500065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:42.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.920+0000 7f851659c700 1 --2- 172.21.15.157:0/418950333 >> v2:172.21.15.157:6800/1475557172 conn(0x7f85000635b0 0x7f8500065a60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85080046b0 tx=0x7f8508009b30 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:42.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:42.924+0000 7f8506ffd700 1 -- 172.21.15.157:0/418950333 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f8510053550 con 0x7f85180fe7f0 2021-10-08T19:25:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:42 smithi157 ceph-mon[32847]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:43.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:42 smithi157 ceph-mon[42114]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:43.102 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.100+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"} v 0) v1 -- 0x7f85180f9680 con 0x7f85180fe7f0 2021-10-08T19:25:43.103 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.101+0000 7f8506ffd700 1 -- 172.21.15.157:0/418950333 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]=0 v66) v1 ==== 98+0+11 (secure 0 0 0) 0x7f8510053140 con 0x7f85180fe7f0 2021-10-08T19:25:43.104 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2021-10-08T19:25:43.106 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 >> v2:172.21.15.157:6800/1475557172 conn(0x7f85000635b0 msgr2=0x7f8500065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:43.106 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 --2- 172.21.15.157:0/418950333 >> v2:172.21.15.157:6800/1475557172 conn(0x7f85000635b0 0x7f8500065a60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85080046b0 tx=0x7f8508009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:43.107 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85180fe7f0 msgr2=0x7f85180f8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:43.107 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 --2- 172.21.15.157:0/418950333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85180fe7f0 0x7f85180f8b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f851000c810 tx=0x7f8510004cb0 comp rx=0 tx=0).stop 2021-10-08T19:25:43.108 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 shutdown_connections 2021-10-08T19:25:43.108 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 --2- 172.21.15.157:0/418950333 >> v2:172.21.15.157:6800/1475557172 conn(0x7f85000635b0 0x7f8500065a60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:43.108 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 --2- 172.21.15.157:0/418950333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85180fe7f0 0x7f85180f8b50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:43.109 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 --2- 172.21.15.157:0/418950333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85180f6ed0 0x7f85180f80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:43.109 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 --2- 172.21.15.157:0/418950333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85180f7880 0x7f85180f85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:43.110 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 >> 172.21.15.157:0/418950333 conn(0x7f851806cf40 msgr2=0x7f85180f5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:43.110 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 shutdown_connections 2021-10-08T19:25:43.111 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:43.103+0000 7f851cced700 1 -- 172.21.15.157:0/418950333 wait complete. 2021-10-08T19:25:43.944 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/418950333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-10-08T19:25:43.945 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/418950333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-10-08T19:25:43.946 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd pool get iscsi pg_num 2021-10-08T19:25:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/418950333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-10-08T19:25:44.250 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:44.796 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:44 smithi157 ceph-mon[32847]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2021-10-08T19:25:44.797 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:44 smithi157 ceph-mon[42114]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2021-10-08T19:25:45.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:44 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:25:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:45.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:44 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:25:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:45.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:44 smithi196 ceph-mon[34258]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2021-10-08T19:25:45.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[42114]: Sending message to agent on host smithi196 2021-10-08T19:25:45.876 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[42114]: Received old metadata from agent on host smithi196. Requested up-to-date metadata. 2021-10-08T19:25:45.876 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:45.877 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:25:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:45.877 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[42114]: Sending message to agent on host smithi157 2021-10-08T19:25:45.877 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[42114]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:25:45.877 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:45.878 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:25:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:45.878 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[32847]: Sending message to agent on host smithi196 2021-10-08T19:25:45.878 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[32847]: Received old metadata from agent on host smithi196. Requested up-to-date metadata. 2021-10-08T19:25:45.879 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:45.879 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:25:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:45.879 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[32847]: Sending message to agent on host smithi157 2021-10-08T19:25:45.879 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[32847]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:25:45.880 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:45.880 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:45 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:25:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:46.005 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:45 smithi196 ceph-mon[34258]: Sending message to agent on host smithi196 2021-10-08T19:25:46.006 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:45 smithi196 ceph-mon[34258]: Received old metadata from agent on host smithi196. Requested up-to-date metadata. 2021-10-08T19:25:46.006 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:45 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:46.006 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:45 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:25:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:46.006 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:45 smithi196 ceph-mon[34258]: Sending message to agent on host smithi157 2021-10-08T19:25:46.007 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:45 smithi196 ceph-mon[34258]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:25:46.007 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:45 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:46.007 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:45 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:25:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:46.130 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 -- 172.21.15.157:0/1961544 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f150c0ff090 msgr2=0x7f150c0f8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:46.140 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 --2- 172.21.15.157:0/1961544 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f150c0ff090 0x7f150c0f8740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009a60 tx=0x7f14fc004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:46.140 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 -- 172.21.15.157:0/1961544 shutdown_connections 2021-10-08T19:25:46.140 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 --2- 172.21.15.157:0/1961544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f150c0f8e70 0x7f150c105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:46.141 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 --2- 172.21.15.157:0/1961544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f150c0fe6f0 0x7f150c0feac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:46.141 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 --2- 172.21.15.157:0/1961544 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f150c0ff090 0x7f150c0f8740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:46.141 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 -- 172.21.15.157:0/1961544 >> 172.21.15.157:0/1961544 conn(0x7f150c06f3d0 msgr2=0x7f150c0f6800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:46.141 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 -- 172.21.15.157:0/1961544 shutdown_connections 2021-10-08T19:25:46.141 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 -- 172.21.15.157:0/1961544 wait complete. 2021-10-08T19:25:46.142 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.127+0000 7f1512ebc700 1 Processor -- start 2021-10-08T19:25:46.142 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1512ebc700 1 -- start start 2021-10-08T19:25:46.142 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1512ebc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f150c0f8e70 0x7f150c10e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:46.142 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1512ebc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f150c0fe6f0 0x7f150c10ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:46.143 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1512ebc700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f150c0ff090 0x7f150c108a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:46.143 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1512ebc700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c108fe0 con 0x7f150c0fe6f0 2021-10-08T19:25:46.143 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1512ebc700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c109150 con 0x7f150c0f8e70 2021-10-08T19:25:46.143 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1512ebc700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c109310 con 0x7f150c0ff090 2021-10-08T19:25:46.143 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1511459700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f150c0ff090 0x7f150c108a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:46.144 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f150bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f150c0fe6f0 0x7f150c10ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:46.144 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f150bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f150c0fe6f0 0x7f150c10ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40866/0 (socket says 172.21.15.157:40866) 2021-10-08T19:25:46.144 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1511459700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f150c0ff090 0x7f150c108a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50116/0 (socket says 172.21.15.157:50116) 2021-10-08T19:25:46.144 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f1510c58700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f150c0f8e70 0x7f150c10e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:46.144 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f150bfff700 1 -- 172.21.15.157:0/709774301 learned_addr learned my addr 172.21.15.157:0/709774301 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:25:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f150bfff700 1 -- 172.21.15.157:0/709774301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f150c0ff090 msgr2=0x7f150c108a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f150bfff700 1 --2- 172.21.15.157:0/709774301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f150c0ff090 0x7f150c108a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f150bfff700 1 -- 172.21.15.157:0/709774301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f150c0f8e70 msgr2=0x7f150c10e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f150bfff700 1 --2- 172.21.15.157:0/709774301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f150c0f8e70 0x7f150c10e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:46.146 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f150bfff700 1 -- 172.21.15.157:0/709774301 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc009640 con 0x7f150c0fe6f0 2021-10-08T19:25:46.146 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.128+0000 7f150bfff700 1 --2- 172.21.15.157:0/709774301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f150c0fe6f0 0x7f150c10ee80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00b3b0 tx=0x7f14fc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:46.146 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.129+0000 7f15097fa700 1 -- 172.21.15.157:0/709774301 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00e030 con 0x7f150c0fe6f0 2021-10-08T19:25:46.146 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.129+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c109590 con 0x7f150c0fe6f0 2021-10-08T19:25:46.146 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.129+0000 7f15097fa700 1 -- 172.21.15.157:0/709774301 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f14fc009450 con 0x7f150c0fe6f0 2021-10-08T19:25:46.147 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.129+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c06b830 con 0x7f150c0fe6f0 2021-10-08T19:25:46.147 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.129+0000 7f15097fa700 1 -- 172.21.15.157:0/709774301 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc01bc20 con 0x7f150c0fe6f0 2021-10-08T19:25:46.148 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.130+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c047b50 con 0x7f150c0fe6f0 2021-10-08T19:25:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.130+0000 7f15097fa700 1 -- 172.21.15.157:0/709774301 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f14fc007830 con 0x7f150c0fe6f0 2021-10-08T19:25:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.130+0000 7f15097fa700 1 --2- 172.21.15.157:0/709774301 >> v2:172.21.15.157:6800/1475557172 conn(0x7f14f80635b0 0x7f14f8065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.130+0000 7f15097fa700 1 -- 172.21.15.157:0/709774301 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f14fc0858d0 con 0x7f150c0fe6f0 2021-10-08T19:25:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.130+0000 7f1510c58700 1 --2- 172.21.15.157:0/709774301 >> v2:172.21.15.157:6800/1475557172 conn(0x7f14f80635b0 0x7f14f8065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.131+0000 7f1510c58700 1 --2- 172.21.15.157:0/709774301 >> v2:172.21.15.157:6800/1475557172 conn(0x7f14f80635b0 0x7f14f8065a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1504009fd0 tx=0x7f150400b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.134+0000 7f15097fa700 1 -- 172.21.15.157:0/709774301 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f14fc0584f0 con 0x7f150c0fe6f0 2021-10-08T19:25:46.304 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.301+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"} v 0) v1 -- 0x7f150c109f20 con 0x7f150c0fe6f0 2021-10-08T19:25:46.305 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.301+0000 7f15097fa700 1 -- 172.21.15.157:0/709774301 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]=0 v66) v1 ==== 94+0+10 (secure 0 0 0) 0x7f14fc017020 con 0x7f150c0fe6f0 2021-10-08T19:25:46.306 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 3 2021-10-08T19:25:46.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 >> v2:172.21.15.157:6800/1475557172 conn(0x7f14f80635b0 msgr2=0x7f14f8065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:46.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 --2- 172.21.15.157:0/709774301 >> v2:172.21.15.157:6800/1475557172 conn(0x7f14f80635b0 0x7f14f8065a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1504009fd0 tx=0x7f150400b040 comp rx=0 tx=0).stop 2021-10-08T19:25:46.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f150c0fe6f0 msgr2=0x7f150c10ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:46.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 --2- 172.21.15.157:0/709774301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f150c0fe6f0 0x7f150c10ee80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00b3b0 tx=0x7f14fc004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:46.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 shutdown_connections 2021-10-08T19:25:46.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 --2- 172.21.15.157:0/709774301 >> v2:172.21.15.157:6800/1475557172 conn(0x7f14f80635b0 0x7f14f8065a60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 --2- 172.21.15.157:0/709774301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f150c0ff090 0x7f150c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 --2- 172.21.15.157:0/709774301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f150c0f8e70 0x7f150c10e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 --2- 172.21.15.157:0/709774301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f150c0fe6f0 0x7f150c10ee80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:46.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 >> 172.21.15.157:0/709774301 conn(0x7f150c06f3d0 msgr2=0x7f150c0702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:46.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 shutdown_connections 2021-10-08T19:25:46.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:46.304+0000 7f1512ebc700 1 -- 172.21.15.157:0/709774301 wait complete. 2021-10-08T19:25:47.053 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:46 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi157 2021-10-08T19:25:47.054 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:46 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi196 2021-10-08T19:25:47.055 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:46 smithi196 ceph-mon[34258]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 570 B/s rd, 0 op/s 2021-10-08T19:25:47.055 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/709774301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-10-08T19:25:47.055 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:46 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:25:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:46 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi157 2021-10-08T19:25:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:46 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi196 2021-10-08T19:25:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:46 smithi157 ceph-mon[32847]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 570 B/s rd, 0 op/s 2021-10-08T19:25:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/709774301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-10-08T19:25:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:46 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi157 2021-10-08T19:25:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:46 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi196 2021-10-08T19:25:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:46 smithi157 ceph-mon[42114]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 570 B/s rd, 0 op/s 2021-10-08T19:25:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/709774301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-10-08T19:25:47.149 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd pool get default.rgw.log pg_num 2021-10-08T19:25:47.489 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:48.048 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:47 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:48.048 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:47 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:48.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:47 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:49.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:48 smithi196 ceph-mon[34258]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2021-10-08T19:25:49.316 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:48 smithi157 ceph-mon[32847]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2021-10-08T19:25:49.316 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:48 smithi157 ceph-mon[42114]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2021-10-08T19:25:49.543 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.540+0000 7f9734d57700 1 -- 172.21.15.157:0/3200004091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97300fdf70 msgr2=0x7f97300f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:49.543 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.540+0000 7f9734d57700 1 --2- 172.21.15.157:0/3200004091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97300fdf70 0x7f97300f7680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9724004620 tx=0x7f9724009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:49.544 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.540+0000 7f9734d57700 1 -- 172.21.15.157:0/3200004091 shutdown_connections 2021-10-08T19:25:49.544 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.540+0000 7f9734d57700 1 --2- 172.21.15.157:0/3200004091 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97300f7d60 0x7f97301043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.544 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.540+0000 7f9734d57700 1 --2- 172.21.15.157:0/3200004091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97300fd5d0 0x7f97300fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.544 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.540+0000 7f9734d57700 1 --2- 172.21.15.157:0/3200004091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97300fdf70 0x7f97300f7680 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.544 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.540+0000 7f9734d57700 1 -- 172.21.15.157:0/3200004091 >> 172.21.15.157:0/3200004091 conn(0x7f973006f330 msgr2=0x7f973006f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:49.545 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.540+0000 7f9734d57700 1 -- 172.21.15.157:0/3200004091 shutdown_connections 2021-10-08T19:25:49.545 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.540+0000 7f9734d57700 1 -- 172.21.15.157:0/3200004091 wait complete. 2021-10-08T19:25:49.546 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f9734d57700 1 Processor -- start 2021-10-08T19:25:49.546 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f9734d57700 1 -- start start 2021-10-08T19:25:49.546 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f9734d57700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97300f7d60 0x7f9730109b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:49.546 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f9734d57700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97300fd5d0 0x7f973010a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:49.546 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f9734d57700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97300fdf70 0x7f9730114bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:49.547 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f9734d57700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973010a830 con 0x7f97300f7d60 2021-10-08T19:25:49.547 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f9734d57700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973010a9a0 con 0x7f97300fd5d0 2021-10-08T19:25:49.547 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f9734d57700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9730115120 con 0x7f97300fdf70 2021-10-08T19:25:49.547 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97300f7d60 0x7f9730109b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:49.548 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972ed9d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97300fdf70 0x7f9730114bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:49.548 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97300f7d60 0x7f9730109b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40876/0 (socket says 172.21.15.157:40876) 2021-10-08T19:25:49.548 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972e59c700 1 -- 172.21.15.157:0/2445212532 learned_addr learned my addr 172.21.15.157:0/2445212532 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:25:49.548 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972dd9b700 1 --2- 172.21.15.157:0/2445212532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97300fd5d0 0x7f973010a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:49.548 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972e59c700 1 -- 172.21.15.157:0/2445212532 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97300fdf70 msgr2=0x7f9730114bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:49.549 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972e59c700 1 --2- 172.21.15.157:0/2445212532 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97300fdf70 0x7f9730114bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.549 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972e59c700 1 -- 172.21.15.157:0/2445212532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97300fd5d0 msgr2=0x7f973010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:49.549 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972e59c700 1 --2- 172.21.15.157:0/2445212532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97300fd5d0 0x7f973010a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.549 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.541+0000 7f972e59c700 1 -- 172.21.15.157:0/2445212532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9720005040 con 0x7f97300f7d60 2021-10-08T19:25:49.549 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.542+0000 7f972e59c700 1 --2- 172.21.15.157:0/2445212532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97300f7d60 0x7f9730109b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97200049e0 tx=0x7f9720009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:49.550 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.542+0000 7f971effd700 1 -- 172.21.15.157:0/2445212532 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720010460 con 0x7f97300f7d60 2021-10-08T19:25:49.550 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.542+0000 7f971effd700 1 -- 172.21.15.157:0/2445212532 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f9720014070 con 0x7f97300f7d60 2021-10-08T19:25:49.550 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.542+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9724005040 con 0x7f97300f7d60 2021-10-08T19:25:49.550 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.542+0000 7f971effd700 1 -- 172.21.15.157:0/2445212532 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200175e0 con 0x7f97300f7d60 2021-10-08T19:25:49.551 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.542+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9730107d80 con 0x7f97300f7d60 2021-10-08T19:25:49.552 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.543+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9730047b50 con 0x7f97300f7d60 2021-10-08T19:25:49.552 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.544+0000 7f971effd700 1 -- 172.21.15.157:0/2445212532 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f9720020070 con 0x7f97300f7d60 2021-10-08T19:25:49.552 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.544+0000 7f971effd700 1 --2- 172.21.15.157:0/2445212532 >> v2:172.21.15.157:6800/1475557172 conn(0x7f97180635b0 0x7f9718065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:49.552 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.544+0000 7f971effd700 1 -- 172.21.15.157:0/2445212532 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f972007f0c0 con 0x7f97300f7d60 2021-10-08T19:25:49.553 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.544+0000 7f972dd9b700 1 --2- 172.21.15.157:0/2445212532 >> v2:172.21.15.157:6800/1475557172 conn(0x7f97180635b0 0x7f9718065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:49.553 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.544+0000 7f972dd9b700 1 --2- 172.21.15.157:0/2445212532 >> v2:172.21.15.157:6800/1475557172 conn(0x7f97180635b0 0x7f9718065a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97240045f0 tx=0x7f9724009b30 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:49.554 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.547+0000 7f971effd700 1 -- 172.21.15.157:0/2445212532 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f9720051d10 con 0x7f97300f7d60 2021-10-08T19:25:49.717 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.717+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"} v 0) v1 -- 0x7f9730062090 con 0x7f97300f7d60 2021-10-08T19:25:49.718 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.717+0000 7f971effd700 1 -- 172.21.15.157:0/2445212532 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f972001e020 con 0x7f97300f7d60 2021-10-08T19:25:49.719 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2021-10-08T19:25:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 >> v2:172.21.15.157:6800/1475557172 conn(0x7f97180635b0 msgr2=0x7f9718065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 --2- 172.21.15.157:0/2445212532 >> v2:172.21.15.157:6800/1475557172 conn(0x7f97180635b0 0x7f9718065a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97240045f0 tx=0x7f9724009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97300f7d60 msgr2=0x7f9730109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 --2- 172.21.15.157:0/2445212532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97300f7d60 0x7f9730109b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97200049e0 tx=0x7f9720009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 shutdown_connections 2021-10-08T19:25:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 --2- 172.21.15.157:0/2445212532 >> v2:172.21.15.157:6800/1475557172 conn(0x7f97180635b0 0x7f9718065a60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 --2- 172.21.15.157:0/2445212532 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97300fdf70 0x7f9730114bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 --2- 172.21.15.157:0/2445212532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97300f7d60 0x7f9730109b30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.723 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 --2- 172.21.15.157:0/2445212532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97300fd5d0 0x7f973010a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.723 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 >> 172.21.15.157:0/2445212532 conn(0x7f973006f330 msgr2=0x7f97300f6750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:49.723 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 shutdown_connections 2021-10-08T19:25:49.723 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:49.719+0000 7f9734d57700 1 -- 172.21.15.157:0/2445212532 wait complete. 2021-10-08T19:25:50.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2445212532' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2021-10-08T19:25:50.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2445212532' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2021-10-08T19:25:50.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2445212532' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2021-10-08T19:25:50.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd pool get default.rgw.control pg_num 2021-10-08T19:25:50.516 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:50 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:25:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:50.795 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:51.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:50 smithi196 ceph-mon[34258]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:25:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:50 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:51.239 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:50 smithi157 ceph-mon[32847]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:25:51.239 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:50 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:51.240 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:25:51 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:25:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:51.240 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:50 smithi157 ceph-mon[42114]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:25:51.240 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:50 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:52.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:51 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:25:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:51 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:25:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:51 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:51 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:52.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:51 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:52.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:51 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:52.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:51 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:52.243 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:25:52.243 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:25:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:52.243 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:52.244 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:52.244 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:52.244 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:52.245 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:52.245 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:25:52.245 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:25:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:52.245 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:52.246 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:52.246 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:52.246 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:52.246 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:51 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:25:52.452 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.449+0000 7f7c67387700 1 -- 172.21.15.157:0/3646973218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600f7d60 msgr2=0x7f7c601043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.452 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.449+0000 7f7c67387700 1 --2- 172.21.15.157:0/3646973218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600f7d60 0x7f7c601043d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009a90 tx=0x7f7c58004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:52.452 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.449+0000 7f7c67387700 1 -- 172.21.15.157:0/3646973218 shutdown_connections 2021-10-08T19:25:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.449+0000 7f7c67387700 1 --2- 172.21.15.157:0/3646973218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600f7d60 0x7f7c601043d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.449+0000 7f7c67387700 1 --2- 172.21.15.157:0/3646973218 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c600fd5d0 0x7f7c600fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.449+0000 7f7c67387700 1 --2- 172.21.15.157:0/3646973218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c600fdf70 0x7f7c600f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.449+0000 7f7c67387700 1 -- 172.21.15.157:0/3646973218 >> 172.21.15.157:0/3646973218 conn(0x7f7c6006f330 msgr2=0x7f7c6006f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:52.454 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.449+0000 7f7c67387700 1 -- 172.21.15.157:0/3646973218 shutdown_connections 2021-10-08T19:25:52.454 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.449+0000 7f7c67387700 1 -- 172.21.15.157:0/3646973218 wait complete. 2021-10-08T19:25:52.454 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c67387700 1 Processor -- start 2021-10-08T19:25:52.454 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c67387700 1 -- start start 2021-10-08T19:25:52.454 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c67387700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c600f7d60 0x7f7c6010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:52.455 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c67387700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c600fd5d0 0x7f7c6010dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:52.455 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c67387700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600fdf70 0x7f7c601076f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:52.456 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c67387700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60107d40 con 0x7f7c600fdf70 2021-10-08T19:25:52.456 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c67387700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60107eb0 con 0x7f7c600fd5d0 2021-10-08T19:25:52.456 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c67387700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60108070 con 0x7f7c600f7d60 2021-10-08T19:25:52.457 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c65123700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c600f7d60 0x7f7c6010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:52.457 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c65123700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c600f7d60 0x7f7c6010d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50146/0 (socket says 172.21.15.157:50146) 2021-10-08T19:25:52.457 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c65924700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600fdf70 0x7f7c601076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:52.458 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c65123700 1 -- 172.21.15.157:0/2745601255 learned_addr learned my addr 172.21.15.157:0/2745601255 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:25:52.458 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.450+0000 7f7c64922700 1 --2- 172.21.15.157:0/2745601255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c600fd5d0 0x7f7c6010dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:52.458 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c65123700 1 -- 172.21.15.157:0/2745601255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c600fd5d0 msgr2=0x7f7c6010dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.458 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c65123700 1 --2- 172.21.15.157:0/2745601255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c600fd5d0 0x7f7c6010dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.459 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c65123700 1 -- 172.21.15.157:0/2745601255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600fdf70 msgr2=0x7f7c601076f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.459 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c65123700 1 --2- 172.21.15.157:0/2745601255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600fdf70 0x7f7c601076f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.459 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c65123700 1 -- 172.21.15.157:0/2745601255 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50005040 con 0x7f7c600f7d60 2021-10-08T19:25:52.459 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c65123700 1 --2- 172.21.15.157:0/2745601255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c600f7d60 0x7f7c6010d620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00ea20 tx=0x7f7c5c007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:52.460 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c55ffb700 1 -- 172.21.15.157:0/2745601255 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00c7a0 con 0x7f7c600f7d60 2021-10-08T19:25:52.460 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c55ffb700 1 -- 172.21.15.157:0/2745601255 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f7c5c00cd80 con 0x7f7c600f7d60 2021-10-08T19:25:52.460 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c55ffb700 1 -- 172.21.15.157:0/2745601255 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0103d0 con 0x7f7c600f7d60 2021-10-08T19:25:52.460 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c58009640 con 0x7f7c600f7d60 2021-10-08T19:25:52.460 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.451+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c60061960 con 0x7f7c600f7d60 2021-10-08T19:25:52.462 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.452+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c60047b50 con 0x7f7c600f7d60 2021-10-08T19:25:52.462 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.452+0000 7f7c55ffb700 1 -- 172.21.15.157:0/2745601255 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f7c5c021070 con 0x7f7c600f7d60 2021-10-08T19:25:52.462 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.453+0000 7f7c55ffb700 1 --2- 172.21.15.157:0/2745601255 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7c4c0635b0 0x7f7c4c065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:52.463 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.453+0000 7f7c55ffb700 1 -- 172.21.15.157:0/2745601255 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f7c5c0824b0 con 0x7f7c600f7d60 2021-10-08T19:25:52.463 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.453+0000 7f7c64922700 1 --2- 172.21.15.157:0/2745601255 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7c4c0635b0 0x7f7c4c065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:52.463 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.453+0000 7f7c64922700 1 --2- 172.21.15.157:0/2745601255 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7c4c0635b0 0x7f7c4c065a60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c60108ec0 tx=0x7f7c50009b30 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:52.463 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.457+0000 7f7c55ffb700 1 -- 172.21.15.157:0/2745601255 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7c5c055100 con 0x7f7c600f7d60 2021-10-08T19:25:52.619 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.619+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"} v 0) v1 -- 0x7f7c60108c00 con 0x7f7c600f7d60 2021-10-08T19:25:52.620 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.619+0000 7f7c55ffb700 1 -- 172.21.15.157:0/2745601255 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]=0 v66) v1 ==== 108+0+11 (secure 0 0 0) 0x7f7c5c015020 con 0x7f7c600f7d60 2021-10-08T19:25:52.620 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2021-10-08T19:25:52.622 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7c4c0635b0 msgr2=0x7f7c4c065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.622 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 --2- 172.21.15.157:0/2745601255 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7c4c0635b0 0x7f7c4c065a60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c60108ec0 tx=0x7f7c50009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:52.622 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c600f7d60 msgr2=0x7f7c6010d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.622 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 --2- 172.21.15.157:0/2745601255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c600f7d60 0x7f7c6010d620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00ea20 tx=0x7f7c5c007e00 comp rx=0 tx=0).stop 2021-10-08T19:25:52.623 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 shutdown_connections 2021-10-08T19:25:52.623 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 --2- 172.21.15.157:0/2745601255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600fdf70 0x7f7c601076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.623 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 --2- 172.21.15.157:0/2745601255 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7c4c0635b0 0x7f7c4c065a60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.623 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 --2- 172.21.15.157:0/2745601255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c600f7d60 0x7f7c6010d620 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.623 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 --2- 172.21.15.157:0/2745601255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c600fd5d0 0x7f7c6010dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.624 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 >> 172.21.15.157:0/2745601255 conn(0x7f7c6006f330 msgr2=0x7f7c600fb170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:52.624 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 shutdown_connections 2021-10-08T19:25:52.624 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:52.621+0000 7f7c67387700 1 -- 172.21.15.157:0/2745601255 wait complete. 2021-10-08T19:25:53.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:25:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:25:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:25:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[32847]: Deploying daemon alertmanager.a on smithi157 2021-10-08T19:25:53.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[32847]: poll took 11369.653 ms: 1 events 2021-10-08T19:25:53.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[32847]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:25:53.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2745601255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2021-10-08T19:25:53.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[42114]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:25:53.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:25:53.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:25:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:53.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[42114]: Deploying daemon alertmanager.a on smithi157 2021-10-08T19:25:53.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[42114]: poll took 11369.653 ms: 1 events 2021-10-08T19:25:53.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[42114]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:25:53.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2745601255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2021-10-08T19:25:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:52 smithi196 ceph-mon[34258]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:25:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:52 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:25:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:52 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:25:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:52 smithi196 ceph-mon[34258]: Deploying daemon alertmanager.a on smithi157 2021-10-08T19:25:53.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:52 smithi196 ceph-mon[34258]: poll took 11369.653 ms: 1 events 2021-10-08T19:25:53.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:52 smithi196 ceph-mon[34258]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:25:53.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2745601255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2021-10-08T19:25:53.320 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd pool get default.rgw.meta pg_num 2021-10-08T19:25:53.631 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:54.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:54 smithi196 ceph-mon[34258]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:25:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:54 smithi157 ceph-mon[32847]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:25:55.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:54 smithi157 ceph-mon[42114]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:25:55.398 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 -- 172.21.15.157:0/597905582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440fef40 msgr2=0x7f38440f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:55.398 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 --2- 172.21.15.157:0/597905582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440fef40 0x7f38440f6a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f382c004710 tx=0x7f382c009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:55.399 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 -- 172.21.15.157:0/597905582 shutdown_connections 2021-10-08T19:25:55.399 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 --2- 172.21.15.157:0/597905582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38440f7130 0x7f38441053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:55.399 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 --2- 172.21.15.157:0/597905582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38440fe5a0 0x7f38440fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:55.399 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 --2- 172.21.15.157:0/597905582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440fef40 0x7f38440f6a00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:55.400 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 -- 172.21.15.157:0/597905582 >> 172.21.15.157:0/597905582 conn(0x7f384406d7e0 msgr2=0x7f38440f4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:55.400 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 -- 172.21.15.157:0/597905582 shutdown_connections 2021-10-08T19:25:55.400 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 -- 172.21.15.157:0/597905582 wait complete. 2021-10-08T19:25:55.400 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 Processor -- start 2021-10-08T19:25:55.400 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 -- start start 2021-10-08T19:25:55.401 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440f7130 0x7f38440f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:55.401 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38440fe5a0 0x7f38440f8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:55.401 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38440fef40 0x7f3844116d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:55.401 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38440f8a10 con 0x7f38440f7130 2021-10-08T19:25:55.402 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844117280 con 0x7f38440fe5a0 2021-10-08T19:25:55.402 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.396+0000 7f384359e700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38441173f0 con 0x7f38440fef40 2021-10-08T19:25:55.402 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440f7130 0x7f38440f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:55.402 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440f7130 0x7f38440f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40940/0 (socket says 172.21.15.157:40940) 2021-10-08T19:25:55.402 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384259c700 1 -- 172.21.15.157:0/2997214857 learned_addr learned my addr 172.21.15.157:0/2997214857 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:25:55.403 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f3842d9d700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38440fef40 0x7f3844116d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:55.403 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f383bfff700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38440fe5a0 0x7f38440f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:55.403 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384259c700 1 -- 172.21.15.157:0/2997214857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38440fef40 msgr2=0x7f3844116d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:55.403 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384259c700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38440fef40 0x7f3844116d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:55.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384259c700 1 -- 172.21.15.157:0/2997214857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38440fe5a0 msgr2=0x7f38440f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:55.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384259c700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38440fe5a0 0x7f38440f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:55.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384259c700 1 -- 172.21.15.157:0/2997214857 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834005040 con 0x7f38440f7130 2021-10-08T19:25:55.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f383bfff700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38440fe5a0 0x7f38440f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:25:55.404 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f3842d9d700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38440fef40 0x7f3844116d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:25:55.405 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384259c700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440f7130 0x7f38440f7be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3834004920 tx=0x7f3834009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:55.405 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f383affd700 1 -- 172.21.15.157:0/2997214857 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383400e050 con 0x7f38440f7130 2021-10-08T19:25:55.405 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f383affd700 1 -- 172.21.15.157:0/2997214857 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f383400f040 con 0x7f38440f7130 2021-10-08T19:25:55.405 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c005040 con 0x7f38440f7130 2021-10-08T19:25:55.406 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f383affd700 1 -- 172.21.15.157:0/2997214857 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834014880 con 0x7f38440f7130 2021-10-08T19:25:55.406 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.397+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3844117a80 con 0x7f38440f7130 2021-10-08T19:25:55.407 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.399+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38440f6430 con 0x7f38440f7130 2021-10-08T19:25:55.407 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.399+0000 7f383affd700 1 -- 172.21.15.157:0/2997214857 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f383401b030 con 0x7f38440f7130 2021-10-08T19:25:55.407 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.399+0000 7f383affd700 1 --2- 172.21.15.157:0/2997214857 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38300635a0 0x7f3830065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:55.408 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.399+0000 7f383affd700 1 -- 172.21.15.157:0/2997214857 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f383407f490 con 0x7f38440f7130 2021-10-08T19:25:55.408 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.399+0000 7f383bfff700 1 --2- 172.21.15.157:0/2997214857 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38300635a0 0x7f3830065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:55.408 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.400+0000 7f383bfff700 1 --2- 172.21.15.157:0/2997214857 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38300635a0 0x7f3830065a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f382c014510 tx=0x7f382c009b30 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:55.408 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.403+0000 7f383affd700 1 -- 172.21.15.157:0/2997214857 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f3834048b00 con 0x7f38440f7130 2021-10-08T19:25:55.576 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.575+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"} v 0) v1 -- 0x7f3844047380 con 0x7f38440f7130 2021-10-08T19:25:55.576 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.575+0000 7f383affd700 1 -- 172.21.15.157:0/2997214857 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]=0 v66) v1 ==== 105+0+11 (secure 0 0 0) 0x7f38340190b0 con 0x7f38440f7130 2021-10-08T19:25:55.577 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2021-10-08T19:25:55.578 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38300635a0 msgr2=0x7f3830065a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:55.578 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 --2- 172.21.15.157:0/2997214857 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38300635a0 0x7f3830065a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f382c014510 tx=0x7f382c009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:55.578 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440f7130 msgr2=0x7f38440f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:55.579 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440f7130 0x7f38440f7be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3834004920 tx=0x7f3834009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:55.579 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 shutdown_connections 2021-10-08T19:25:55.579 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 --2- 172.21.15.157:0/2997214857 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38300635a0 0x7f3830065a50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:55.579 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38440fef40 0x7f3844116d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:55.580 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38440f7130 0x7f38440f7be0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:55.580 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 --2- 172.21.15.157:0/2997214857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38440fe5a0 0x7f38440f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:55.580 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.577+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 >> 172.21.15.157:0/2997214857 conn(0x7f384406d7e0 msgr2=0x7f384406e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:55.581 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.578+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 shutdown_connections 2021-10-08T19:25:55.581 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:25:55.578+0000 7f384359e700 1 -- 172.21.15.157:0/2997214857 wait complete. 2021-10-08T19:25:55.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2997214857' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2021-10-08T19:25:56.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2997214857' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2021-10-08T19:25:56.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2997214857' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2021-10-08T19:25:56.394 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-10-08T19:25:56.395 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-10-08T19:25:56.395 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph mgr dump --format=json 2021-10-08T19:25:56.672 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:25:56.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:56 smithi157 ceph-mon[32847]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:25:56.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:56 smithi157 ceph-mon[42114]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:25:57.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:56 smithi196 ceph-mon[34258]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:25:57.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:25:56 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:25:58.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:57 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:58.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:57 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:58.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:57 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:25:59.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:25:58 smithi157 ceph-mon[32847]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:25:59.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:25:58 smithi157 ceph-mon[42114]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:25:59.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:25:58 smithi196 ceph-mon[34258]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:00.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 -- 172.21.15.157:0/3233552950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00ff0c0 msgr2=0x7f7de00f8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/3233552950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00ff0c0 0x7f7de00f8770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40046e0 tx=0x7f7dd4009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 -- 172.21.15.157:0/3233552950 shutdown_connections 2021-10-08T19:26:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/3233552950 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7de00f8ea0 0x7f7de0105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/3233552950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7de00fe720 0x7f7de00feaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/3233552950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00ff0c0 0x7f7de00f8770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 -- 172.21.15.157:0/3233552950 >> 172.21.15.157:0/3233552950 conn(0x7f7de006f3f0 msgr2=0x7f7de00f6820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:00.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 -- 172.21.15.157:0/3233552950 shutdown_connections 2021-10-08T19:26:00.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 -- 172.21.15.157:0/3233552950 wait complete. 2021-10-08T19:26:00.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.326+0000 7f7de5a0b700 1 Processor -- start 2021-10-08T19:26:00.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7de5a0b700 1 -- start start 2021-10-08T19:26:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7de5a0b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00f8ea0 0x7f7de006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7de5a0b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7de00fe720 0x7f7de006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7de5a0b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7de00ff0c0 0x7f7de006c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7de5a0b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de0116f50 con 0x7f7de00ff0c0 2021-10-08T19:26:00.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7de5a0b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de01170c0 con 0x7f7de00fe720 2021-10-08T19:26:00.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7de5a0b700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de0117280 con 0x7f7de00f8ea0 2021-10-08T19:26:00.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddeffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00f8ea0 0x7f7de006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:00.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddeffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00f8ea0 0x7f7de006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50200/0 (socket says 172.21.15.157:50200) 2021-10-08T19:26:00.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddeffd700 1 -- 172.21.15.157:0/232442610 learned_addr learned my addr 172.21.15.157:0/232442610 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:00.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddf7fe700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7de00ff0c0 0x7f7de006c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:00.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7dde7fc700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7de00fe720 0x7f7de006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:00.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddeffd700 1 -- 172.21.15.157:0/232442610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7de00fe720 msgr2=0x7f7de006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:00.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddeffd700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7de00fe720 0x7f7de006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:00.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddeffd700 1 -- 172.21.15.157:0/232442610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7de00ff0c0 msgr2=0x7f7de006c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:00.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddeffd700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7de00ff0c0 0x7f7de006c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:00.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddeffd700 1 -- 172.21.15.157:0/232442610 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0005040 con 0x7f7de00f8ea0 2021-10-08T19:26:00.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7dde7fc700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7de00fe720 0x7f7de006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:26:00.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddf7fe700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7de00ff0c0 0x7f7de006c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:00.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.327+0000 7f7ddeffd700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00f8ea0 0x7f7de006b6c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00048f0 tx=0x7f7dd0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:00.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.328+0000 7f7dc37fe700 1 -- 172.21.15.157:0/232442610 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000e050 con 0x7f7de00f8ea0 2021-10-08T19:26:00.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.328+0000 7f7dc37fe700 1 -- 172.21.15.157:0/232442610 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f7dd000f040 con 0x7f7de00f8ea0 2021-10-08T19:26:00.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.328+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd4005040 con 0x7f7de00f8ea0 2021-10-08T19:26:00.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.328+0000 7f7dc37fe700 1 -- 172.21.15.157:0/232442610 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0014810 con 0x7f7de00f8ea0 2021-10-08T19:26:00.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.328+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de01178e0 con 0x7f7de00f8ea0 2021-10-08T19:26:00.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.328+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de0047b50 con 0x7f7de00f8ea0 2021-10-08T19:26:00.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.329+0000 7f7dc37fe700 1 -- 172.21.15.157:0/232442610 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f7dd001b030 con 0x7f7de00f8ea0 2021-10-08T19:26:00.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.330+0000 7f7dc37fe700 1 --2- 172.21.15.157:0/232442610 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7dc80635b0 0x7f7dc8065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:00.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.330+0000 7f7dc37fe700 1 -- 172.21.15.157:0/232442610 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f7dd007f3a0 con 0x7f7de00f8ea0 2021-10-08T19:26:00.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.330+0000 7f7dde7fc700 1 --2- 172.21.15.157:0/232442610 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7dc80635b0 0x7f7dc8065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:00.343 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.330+0000 7f7dde7fc700 1 --2- 172.21.15.157:0/232442610 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7dc80635b0 0x7f7dc8065a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009c00 tx=0x7f7dd4009b30 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:00.343 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.334+0000 7f7dc37fe700 1 -- 172.21.15.157:0/232442610 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7dd0052040 con 0x7f7de00f8ea0 2021-10-08T19:26:00.552 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.552+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7de006cc80 con 0x7f7de00f8ea0 2021-10-08T19:26:00.555 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.554+0000 7f7dc37fe700 1 -- 172.21.15.157:0/232442610 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) v1 ==== 74+0+156898 (secure 0 0 0) 0x7f7dd0051c30 con 0x7f7de00f8ea0 2021-10-08T19:26:00.557 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:26:00.559 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7dc80635b0 msgr2=0x7f7dc8065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:00.560 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/232442610 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7dc80635b0 0x7f7dc8065a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009c00 tx=0x7f7dd4009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:00.560 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00f8ea0 msgr2=0x7f7de006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:00.560 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00f8ea0 0x7f7de006b6c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00048f0 tx=0x7f7dd0009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:00.560 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 shutdown_connections 2021-10-08T19:26:00.561 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7de00ff0c0 0x7f7de006c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:00.561 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/232442610 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7dc80635b0 0x7f7dc8065a60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:00.561 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7de00f8ea0 0x7f7de006b6c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:00.561 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 --2- 172.21.15.157:0/232442610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7de00fe720 0x7f7de006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:00.561 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 >> 172.21.15.157:0/232442610 conn(0x7f7de006f3f0 msgr2=0x7f7de0070200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:00.562 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 shutdown_connections 2021-10-08T19:26:00.562 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:00.557+0000 7f7de5a0b700 1 -- 172.21.15.157:0/232442610 wait complete. 2021-10-08T19:26:00.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:00 smithi157 ceph-mon[32847]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:00.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/232442610' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-10-08T19:26:00.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:00 smithi157 ceph-mon[42114]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:00.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/232442610' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-10-08T19:26:01.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:00 smithi196 ceph-mon[34258]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/232442610' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-10-08T19:26:01.758 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"active_gid":24490,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1475557172}]},"active_addr":"172.21.15.157:6800/1475557172","active_change":"2021-10-08T19:25:34.724980+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":24485,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"endpoint_port":{"name":"endpoint_port","type":"int","level":"advanced","flags":0,"default_value":"8499","min":"","max":"","enum_allowed":[],"desc":"Which port cephadm http endpoint will listen on","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-up","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"Determines the behavior of the autoscaler algorithm `scale-up` means that it starts out with minmum pgs and scales up when there is pressure, `scale-down` means starts out with full pgs and scales down when there is pressure ","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share perf counter metrics summed across the whole cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"endpoint_port":{"name":"endpoint_port","type":"int","level":"advanced","flags":0,"default_value":"8499","min":"","max":"","enum_allowed":[],"desc":"Which port cephadm http endpoint will listen on","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-up","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"Determines the behavior of the autoscaler algorithm `scale-up` means that it starts out with minmum pgs and scales up when there is pressure, `scale-down` means starts out with full pgs and scales down when there is pressure ","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share perf counter metrics summed across the whole cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"cephadm":"https://172.21.15.157:8499/","dashboard":"https://172.21.15.157:8443/","prometheus":"http://172.21.15.157:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":66,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":231336924}]},{"addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":2639222530}]},{"addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3056247684}]},{"addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3210798967}]}]}} 2021-10-08T19:26:01.764 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-10-08T19:26:01.764 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-10-08T19:26:01.764 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:26:02.329 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:02.951 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:02 smithi157 ceph-mon[32847]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:02.952 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:02 smithi157 ceph-mon[42114]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:03.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:02 smithi196 ceph-mon[34258]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:03.329 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:03 smithi157 systemd[1]: Starting Ceph alertmanager.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:26:04.827 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.827+0000 7fd291636700 1 -- 172.21.15.157:0/1508133223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd28c0fe7d0 msgr2=0x7fd28c0feba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:04.828 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.827+0000 7fd291636700 1 --2- 172.21.15.157:0/1508133223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd28c0fe7d0 0x7fd28c0feba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd2800046e0 tx=0x7fd280009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:04.828 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.827+0000 7fd291636700 1 -- 172.21.15.157:0/1508133223 shutdown_connections 2021-10-08T19:26:04.828 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.827+0000 7fd291636700 1 --2- 172.21.15.157:0/1508133223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd28c0f8f00 0x7fd28c1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:04.829 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.827+0000 7fd291636700 1 --2- 172.21.15.157:0/1508133223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd28c0fe7d0 0x7fd28c0feba0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:04.829 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.827+0000 7fd291636700 1 --2- 172.21.15.157:0/1508133223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd28c0ff170 0x7fd28c0f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:04.829 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.827+0000 7fd291636700 1 -- 172.21.15.157:0/1508133223 >> 172.21.15.157:0/1508133223 conn(0x7fd28c06f500 msgr2=0x7fd28c0f67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:04.829 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.827+0000 7fd291636700 1 -- 172.21.15.157:0/1508133223 shutdown_connections 2021-10-08T19:26:04.830 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.827+0000 7fd291636700 1 -- 172.21.15.157:0/1508133223 wait complete. 2021-10-08T19:26:04.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[42114]: poll took 10843.865 ms: 1 events 2021-10-08T19:26:04.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[42114]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:04.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:04.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:04.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:04.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:26:04.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:04.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[32847]: poll took 10843.865 ms: 1 events 2021-10-08T19:26:04.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[32847]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:04.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:04.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:04.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:04.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:26:04.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:04 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:04.834 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:04 smithi157 conmon[74087]: level=info ts=2021-10-08T19:26:04.454Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-10-08T19:26:04.834 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:04 smithi157 conmon[74087]: level=info ts=2021-10-08T19:26:04.454Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-10-08T19:26:04.834 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:04 smithi157 conmon[74087]: level=info ts=2021-10-08T19:26:04.455Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.157 port=9094 2021-10-08T19:26:04.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:04 smithi157 conmon[74087]: level=info ts=2021-10-08T19:26:04.456Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-10-08T19:26:04.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:04 smithi157 bash[73849]: a3fa7b05d4e2d5162b5487c783b4aaa94bbc94eecbdbaa1d3cd98cfd30b83525 2021-10-08T19:26:04.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:04 smithi157 systemd[1]: Started Ceph alertmanager.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:26:04.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:04 smithi157 conmon[74087]: level=info ts=2021-10-08T19:26:04.477Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:26:04.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:04 smithi157 conmon[74087]: level=info ts=2021-10-08T19:26:04.477Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:26:04.836 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:04 smithi157 conmon[74087]: level=info ts=2021-10-08T19:26:04.480Z caller=main.go:497 msg=Listening address=:9093 2021-10-08T19:26:04.839 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd291636700 1 Processor -- start 2021-10-08T19:26:04.839 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd291636700 1 -- start start 2021-10-08T19:26:04.839 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd291636700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd28c0f8f00 0x7fd28c063510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:04.840 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd291636700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd28c0fe7d0 0x7fd28c063a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:04.840 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd291636700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd28c0ff170 0x7fd28c11d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:04.840 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd291636700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c064230 con 0x7fd28c0fe7d0 2021-10-08T19:26:04.840 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd291636700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0643a0 con 0x7fd28c0ff170 2021-10-08T19:26:04.840 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd291636700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c11d8e0 con 0x7fd28c0f8f00 2021-10-08T19:26:04.841 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd28affd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd28c0f8f00 0x7fd28c063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:04.841 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd28affd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd28c0f8f00 0x7fd28c063510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50210/0 (socket says 172.21.15.157:50210) 2021-10-08T19:26:04.841 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd28affd700 1 -- 172.21.15.157:0/2724983312 learned_addr learned my addr 172.21.15.157:0/2724983312 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:04.841 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.828+0000 7fd28a7fc700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd28c0fe7d0 0x7fd28c063a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:04.841 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd28b7fe700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd28c0ff170 0x7fd28c11d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:04.842 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd28affd700 1 -- 172.21.15.157:0/2724983312 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd28c0ff170 msgr2=0x7fd28c11d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:04.842 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd28affd700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd28c0ff170 0x7fd28c11d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:04.842 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd28affd700 1 -- 172.21.15.157:0/2724983312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd28c0fe7d0 msgr2=0x7fd28c063a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:04.843 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd28affd700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd28c0fe7d0 0x7fd28c063a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:04.843 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd28affd700 1 -- 172.21.15.157:0/2724983312 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c005040 con 0x7fd28c0f8f00 2021-10-08T19:26:04.843 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd28a7fc700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd28c0fe7d0 0x7fd28c063a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:04.843 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd28affd700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd28c0f8f00 0x7fd28c063510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd280005010 tx=0x7fd280009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd2737fe700 1 -- 172.21.15.157:0/2724983312 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280000d10 con 0x7fd28c0f8f00 2021-10-08T19:26:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd280005040 con 0x7fd28c0f8f00 2021-10-08T19:26:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd2737fe700 1 -- 172.21.15.157:0/2724983312 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fd280004200 con 0x7fd28c0f8f00 2021-10-08T19:26:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd2737fe700 1 -- 172.21.15.157:0/2724983312 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28001cc40 con 0x7fd28c0f8f00 2021-10-08T19:26:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.829+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c11de80 con 0x7fd28c0f8f00 2021-10-08T19:26:04.845 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.830+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c11dad0 con 0x7fd28c0f8f00 2021-10-08T19:26:04.845 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.831+0000 7fd2737fe700 1 -- 172.21.15.157:0/2724983312 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fd280007920 con 0x7fd28c0f8f00 2021-10-08T19:26:04.845 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.831+0000 7fd2737fe700 1 --2- 172.21.15.157:0/2724983312 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd2740635b0 0x7fd274065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:04.845 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.831+0000 7fd2737fe700 1 -- 172.21.15.157:0/2724983312 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fd280080cb0 con 0x7fd28c0f8f00 2021-10-08T19:26:04.846 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.831+0000 7fd28a7fc700 1 --2- 172.21.15.157:0/2724983312 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd2740635b0 0x7fd274065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:04.846 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.831+0000 7fd28a7fc700 1 --2- 172.21.15.157:0/2724983312 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd2740635b0 0x7fd274065a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd27c007fd0 tx=0x7fd27c00b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:04.846 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:04.835+0000 7fd2737fe700 1 -- 172.21.15.157:0/2724983312 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fd28c11dad0 con 0x7fd28c0f8f00 2021-10-08T19:26:05.010 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.010+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd28c047b50 con 0x7fd28c0f8f00 2021-10-08T19:26:05.011 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.011+0000 7fd2737fe700 1 -- 172.21.15.157:0/2724983312 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+19229 (secure 0 0 0) 0x7fd280053950 con 0x7fd28c0f8f00 2021-10-08T19:26:05.012 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:26:05.012 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":66,"fsid":"906d7a14-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:20:03.138859+0000","modified":"2021-10-08T19:25:34.724596+0000","last_up_change":"2021-10-08T19:24:58.596843+0000","last_in_change":"2021-10-08T19:24:43.105089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:23:27.875376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:25:05.727043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:25:06.517474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:25:07.082305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:25:09.047171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:25:11.108303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"0872c520-e1e2-49e4-b0d2-02dad0732102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6801","nonce":1113941339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1113941339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1113941339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":1113941339}]},"public_addr":"172.21.15.157:6801/1113941339","cluster_addr":"172.21.15.157:6802/1113941339","heartbeat_back_addr":"172.21.15.157:6804/1113941339","heartbeat_front_addr":"172.21.15.157:6803/1113941339","state":["exists","up"]},{"osd":1,"uuid":"5c8904ce-90a6-414e-bedb-2c8cbdd3649b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6805","nonce":336233855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":336233855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":336233855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":336233855}]},"public_addr":"172.21.15.157:6805/336233855","cluster_addr":"172.21.15.157:6806/336233855","heartbeat_back_addr":"172.21.15.157:6808/336233855","heartbeat_front_addr":"172.21.15.157:6807/336233855","state":["exists","up"]},{"osd":2,"uuid":"a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":2873488643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2873488643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2873488643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":2873488643}]},"public_addr":"172.21.15.157:6809/2873488643","cluster_addr":"172.21.15.157:6810/2873488643","heartbeat_back_addr":"172.21.15.157:6812/2873488643","heartbeat_front_addr":"172.21.15.157:6811/2873488643","state":["exists","up"]},{"osd":3,"uuid":"a8da5733-a379-4817-a7ec-f46eafc1120f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":2430876343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2430876343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2430876343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":2430876343}]},"public_addr":"172.21.15.157:6813/2430876343","cluster_addr":"172.21.15.157:6814/2430876343","heartbeat_back_addr":"172.21.15.157:6816/2430876343","heartbeat_front_addr":"172.21.15.157:6815/2430876343","state":["exists","up"]},{"osd":4,"uuid":"88f55088-575c-4785-9c03-b24432151873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2530339252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":2530339252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6803","nonce":2530339252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2530339252}]},"public_addr":"172.21.15.196:6800/2530339252","cluster_addr":"172.21.15.196:6801/2530339252","heartbeat_back_addr":"172.21.15.196:6803/2530339252","heartbeat_front_addr":"172.21.15.196:6802/2530339252","state":["exists","up"]},{"osd":5,"uuid":"5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3344395065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":3344395065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":3344395065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3344395065}]},"public_addr":"172.21.15.196:6804/3344395065","cluster_addr":"172.21.15.196:6805/3344395065","heartbeat_back_addr":"172.21.15.196:6807/3344395065","heartbeat_front_addr":"172.21.15.196:6806/3344395065","state":["exists","up"]},{"osd":6,"uuid":"76cb7be3-7318-43cf-a34b-b86d2ef15bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":892194681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":892194681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6811","nonce":892194681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":892194681}]},"public_addr":"172.21.15.196:6808/892194681","cluster_addr":"172.21.15.196:6809/892194681","heartbeat_back_addr":"172.21.15.196:6811/892194681","heartbeat_front_addr":"172.21.15.196:6810/892194681","state":["exists","up"]},{"osd":7,"uuid":"66c7dc80-3bf0-47fe-8ec0-1352aae1a017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1866932410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":1866932410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1866932410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1866932410}]},"public_addr":"172.21.15.196:6812/1866932410","cluster_addr":"172.21.15.196:6813/1866932410","heartbeat_back_addr":"172.21.15.196:6815/1866932410","heartbeat_front_addr":"172.21.15.196:6814/1866932410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:48.440918+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:06.827358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:24.350047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:42.428480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:01.573333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:20.350984+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:38.627581+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:57.542353+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:0/3518861281":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/807653046":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/148035507":"2021-10-09T19:25:34.724551+0000","172.21.15.157:6800/3606206634":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/3965610325":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/1473441418":"2021-10-09T19:20:48.876877+0000","172.21.15.157:0/2931446654":"2021-10-09T19:20:48.876877+0000","172.21.15.157:0/772241757":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/2841195277":"2021-10-09T19:20:26.319723+0000","172.21.15.157:6800/4161241346":"2021-10-09T19:20:48.876877+0000","172.21.15.157:0/1646573385":"2021-10-09T19:20:26.319723+0000","172.21.15.157:0/2844775135":"2021-10-09T19:20:26.319723+0000","172.21.15.157:0/1515093903":"2021-10-09T19:20:48.876877+0000","172.21.15.157:6800/3137430012":"2021-10-09T19:20:26.319723+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:26:05.013 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd2740635b0 msgr2=0x7fd274065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:05.014 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 --2- 172.21.15.157:0/2724983312 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd2740635b0 0x7fd274065a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd27c007fd0 tx=0x7fd27c00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:05.014 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd28c0f8f00 msgr2=0x7fd28c063510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:05.014 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd28c0f8f00 0x7fd28c063510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd280005010 tx=0x7fd280009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:05.014 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 shutdown_connections 2021-10-08T19:26:05.015 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd28c0ff170 0x7fd28c11d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.015 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 --2- 172.21.15.157:0/2724983312 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd2740635b0 0x7fd274065a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.015 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd28c0f8f00 0x7fd28c063510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.015 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 --2- 172.21.15.157:0/2724983312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd28c0fe7d0 0x7fd28c063a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.016 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 >> 172.21.15.157:0/2724983312 conn(0x7fd28c06f500 msgr2=0x7fd28c070760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:05.016 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 shutdown_connections 2021-10-08T19:26:05.016 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:05.013+0000 7fd291636700 1 -- 172.21.15.157:0/2724983312 wait complete. 2021-10-08T19:26:05.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:04 smithi196 ceph-mon[34258]: poll took 10843.865 ms: 1 events 2021-10-08T19:26:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:04 smithi196 ceph-mon[34258]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:04 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:04 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:04 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:05.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:04 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:26:05.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:04 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:06.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[42114]: poll took 1579.699 ms: 1 events 2021-10-08T19:26:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[42114]: Sending message to agent on host smithi157 2021-10-08T19:26:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:26:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[42114]: Deploying daemon grafana.a on smithi196 2021-10-08T19:26:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2724983312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:26:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[32847]: poll took 1579.699 ms: 1 events 2021-10-08T19:26:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[32847]: Sending message to agent on host smithi157 2021-10-08T19:26:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:26:06.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[32847]: Deploying daemon grafana.a on smithi196 2021-10-08T19:26:06.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2724983312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:26:06.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:05 smithi196 ceph-mon[34258]: poll took 1579.699 ms: 1 events 2021-10-08T19:26:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:05 smithi196 ceph-mon[34258]: Sending message to agent on host smithi157 2021-10-08T19:26:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:05 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:26:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:05 smithi196 ceph-mon[34258]: Deploying daemon grafana.a on smithi196 2021-10-08T19:26:06.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2724983312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:26:06.154 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-10-08T19:26:06.154 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:26:06.457 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:06 smithi157 conmon[74087]: level=info ts=2021-10-08T19:26:06.456Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00008927s 2021-10-08T19:26:06.652 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:06.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:06 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi157 2021-10-08T19:26:06.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:06 smithi157 ceph-mon[32847]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:06.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:06 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:06.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:06 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi157 2021-10-08T19:26:06.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:06 smithi157 ceph-mon[42114]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:06.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:06 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:07.116 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:26:06 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:26:07.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:06 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi157 2021-10-08T19:26:07.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:06 smithi196 ceph-mon[34258]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:07.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:06 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:08.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:07 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:08.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:07 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:08.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:07 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:08.623 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.620+0000 7ff9b7a65700 1 -- 172.21.15.157:0/437786027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f6ba0 msgr2=0x7ff9b00f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.623 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.620+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/437786027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f6ba0 0x7ff9b00f7010 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00046e0 tx=0x7ff9a0009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:08.623 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.620+0000 7ff9b7a65700 1 -- 172.21.15.157:0/437786027 shutdown_connections 2021-10-08T19:26:08.624 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.620+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/437786027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9b00f76f0 0x7ff9b0107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.624 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.620+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/437786027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9b00f94d0 0x7ff9b00f98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.624 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.620+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/437786027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f6ba0 0x7ff9b00f7010 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.624 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.620+0000 7ff9b7a65700 1 -- 172.21.15.157:0/437786027 >> 172.21.15.157:0/437786027 conn(0x7ff9b006da50 msgr2=0x7ff9b00f4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:08.625 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.620+0000 7ff9b7a65700 1 -- 172.21.15.157:0/437786027 shutdown_connections 2021-10-08T19:26:08.625 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.620+0000 7ff9b7a65700 1 -- 172.21.15.157:0/437786027 wait complete. 2021-10-08T19:26:08.625 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b7a65700 1 Processor -- start 2021-10-08T19:26:08.625 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b7a65700 1 -- start start 2021-10-08T19:26:08.625 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b7a65700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9b00f6ba0 0x7ff9b0110b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:08.626 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b7a65700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9b00f76f0 0x7ff9b0111070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:08.634 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b7a65700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f94d0 0x7ff9b010abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:08.634 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b7a65700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b010b170 con 0x7ff9b00f94d0 2021-10-08T19:26:08.634 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b7a65700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b010b2b0 con 0x7ff9b00f76f0 2021-10-08T19:26:08.635 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b7a65700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b010b470 con 0x7ff9b00f6ba0 2021-10-08T19:26:08.635 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b5000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9b00f76f0 0x7ff9b0111070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:08.635 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b6002700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f94d0 0x7ff9b010abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:08.635 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b5801700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9b00f6ba0 0x7ff9b0110b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:08.636 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b5000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9b00f76f0 0x7ff9b0111070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.157:36026/0 (socket says 172.21.15.157:36026) 2021-10-08T19:26:08.636 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b6002700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f94d0 0x7ff9b010abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40982/0 (socket says 172.21.15.157:40982) 2021-10-08T19:26:08.636 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b5000700 1 -- 172.21.15.157:0/2979706985 learned_addr learned my addr 172.21.15.157:0/2979706985 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:08.636 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b6002700 1 -- 172.21.15.157:0/2979706985 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9b00f6ba0 msgr2=0x7ff9b0110b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.637 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b6002700 1 --2- 172.21.15.157:0/2979706985 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9b00f6ba0 0x7ff9b0110b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.637 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b6002700 1 -- 172.21.15.157:0/2979706985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9b00f76f0 msgr2=0x7ff9b0111070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.637 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b6002700 1 --2- 172.21.15.157:0/2979706985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9b00f76f0 0x7ff9b0111070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.637 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b6002700 1 -- 172.21.15.157:0/2979706985 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0005040 con 0x7ff9b00f94d0 2021-10-08T19:26:08.638 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b5801700 1 --2- 172.21.15.157:0/2979706985 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9b00f6ba0 0x7ff9b0110b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:08.638 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.621+0000 7ff9b6002700 1 --2- 172.21.15.157:0/2979706985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f94d0 0x7ff9b010abe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800d720 tx=0x7ff9a8004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:08.638 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.622+0000 7ff9a5ffb700 1 -- 172.21.15.157:0/2979706985 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8011500 con 0x7ff9b00f94d0 2021-10-08T19:26:08.638 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.622+0000 7ff9a5ffb700 1 -- 172.21.15.157:0/2979706985 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7ff9a800f040 con 0x7ff9b00f94d0 2021-10-08T19:26:08.639 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.622+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b010b750 con 0x7ff9b00f94d0 2021-10-08T19:26:08.639 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.622+0000 7ff9a5ffb700 1 -- 172.21.15.157:0/2979706985 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8013a00 con 0x7ff9b00f94d0 2021-10-08T19:26:08.639 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.622+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b01179e0 con 0x7ff9b00f94d0 2021-10-08T19:26:08.640 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.623+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b0047b50 con 0x7ff9b00f94d0 2021-10-08T19:26:08.641 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.623+0000 7ff9a5ffb700 1 -- 172.21.15.157:0/2979706985 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7ff9a8011660 con 0x7ff9b00f94d0 2021-10-08T19:26:08.641 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.624+0000 7ff9a5ffb700 1 --2- 172.21.15.157:0/2979706985 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff99c0635b0 0x7ff99c065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:08.641 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.624+0000 7ff9a5ffb700 1 -- 172.21.15.157:0/2979706985 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7ff9a807fcf0 con 0x7ff9b00f94d0 2021-10-08T19:26:08.641 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.624+0000 7ff9b5801700 1 --2- 172.21.15.157:0/2979706985 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff99c0635b0 0x7ff99c065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:08.642 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.624+0000 7ff9b5801700 1 --2- 172.21.15.157:0/2979706985 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff99c0635b0 0x7ff99c065a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009fd0 tx=0x7ff9ac00b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:08.642 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.628+0000 7ff9a5ffb700 1 -- 172.21.15.157:0/2979706985 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7ff9a8052820 con 0x7ff9b00f94d0 2021-10-08T19:26:08.710 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:08 smithi157 ceph-mon[42114]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:08.710 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:08 smithi157 ceph-mon[32847]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:08.799 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.799+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b010c110 con 0x7ff9b00f94d0 2021-10-08T19:26:08.800 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.800+0000 7ff9a5ffb700 1 -- 172.21.15.157:0/2979706985 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+19229 (secure 0 0 0) 0x7ff9a8052410 con 0x7ff9b00f94d0 2021-10-08T19:26:08.801 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:26:08.801 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":66,"fsid":"906d7a14-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:20:03.138859+0000","modified":"2021-10-08T19:25:34.724596+0000","last_up_change":"2021-10-08T19:24:58.596843+0000","last_in_change":"2021-10-08T19:24:43.105089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:23:27.875376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:25:05.727043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:25:06.517474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:25:07.082305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:25:09.047171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:25:11.108303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"0872c520-e1e2-49e4-b0d2-02dad0732102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6801","nonce":1113941339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1113941339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1113941339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":1113941339}]},"public_addr":"172.21.15.157:6801/1113941339","cluster_addr":"172.21.15.157:6802/1113941339","heartbeat_back_addr":"172.21.15.157:6804/1113941339","heartbeat_front_addr":"172.21.15.157:6803/1113941339","state":["exists","up"]},{"osd":1,"uuid":"5c8904ce-90a6-414e-bedb-2c8cbdd3649b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6805","nonce":336233855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":336233855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":336233855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":336233855}]},"public_addr":"172.21.15.157:6805/336233855","cluster_addr":"172.21.15.157:6806/336233855","heartbeat_back_addr":"172.21.15.157:6808/336233855","heartbeat_front_addr":"172.21.15.157:6807/336233855","state":["exists","up"]},{"osd":2,"uuid":"a1e3e9cc-790a-4b78-ab6d-7f75c11b21b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":2873488643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2873488643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2873488643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":2873488643}]},"public_addr":"172.21.15.157:6809/2873488643","cluster_addr":"172.21.15.157:6810/2873488643","heartbeat_back_addr":"172.21.15.157:6812/2873488643","heartbeat_front_addr":"172.21.15.157:6811/2873488643","state":["exists","up"]},{"osd":3,"uuid":"a8da5733-a379-4817-a7ec-f46eafc1120f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":2430876343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2430876343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2430876343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":2430876343}]},"public_addr":"172.21.15.157:6813/2430876343","cluster_addr":"172.21.15.157:6814/2430876343","heartbeat_back_addr":"172.21.15.157:6816/2430876343","heartbeat_front_addr":"172.21.15.157:6815/2430876343","state":["exists","up"]},{"osd":4,"uuid":"88f55088-575c-4785-9c03-b24432151873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2530339252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":2530339252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6803","nonce":2530339252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2530339252}]},"public_addr":"172.21.15.196:6800/2530339252","cluster_addr":"172.21.15.196:6801/2530339252","heartbeat_back_addr":"172.21.15.196:6803/2530339252","heartbeat_front_addr":"172.21.15.196:6802/2530339252","state":["exists","up"]},{"osd":5,"uuid":"5f3c1a0a-96b1-4c6c-944f-f0252ccd79c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3344395065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":3344395065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":3344395065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3344395065}]},"public_addr":"172.21.15.196:6804/3344395065","cluster_addr":"172.21.15.196:6805/3344395065","heartbeat_back_addr":"172.21.15.196:6807/3344395065","heartbeat_front_addr":"172.21.15.196:6806/3344395065","state":["exists","up"]},{"osd":6,"uuid":"76cb7be3-7318-43cf-a34b-b86d2ef15bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":892194681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":892194681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6811","nonce":892194681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":892194681}]},"public_addr":"172.21.15.196:6808/892194681","cluster_addr":"172.21.15.196:6809/892194681","heartbeat_back_addr":"172.21.15.196:6811/892194681","heartbeat_front_addr":"172.21.15.196:6810/892194681","state":["exists","up"]},{"osd":7,"uuid":"66c7dc80-3bf0-47fe-8ec0-1352aae1a017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1866932410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":1866932410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1866932410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1866932410}]},"public_addr":"172.21.15.196:6812/1866932410","cluster_addr":"172.21.15.196:6813/1866932410","heartbeat_back_addr":"172.21.15.196:6815/1866932410","heartbeat_front_addr":"172.21.15.196:6814/1866932410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:22:48.440918+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:06.827358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:24.350047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:42.428480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:01.573333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:20.350984+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:38.627581+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:57.542353+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:0/3518861281":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/807653046":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/148035507":"2021-10-09T19:25:34.724551+0000","172.21.15.157:6800/3606206634":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/3965610325":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/1473441418":"2021-10-09T19:20:48.876877+0000","172.21.15.157:0/2931446654":"2021-10-09T19:20:48.876877+0000","172.21.15.157:0/772241757":"2021-10-09T19:25:34.724551+0000","172.21.15.157:0/2841195277":"2021-10-09T19:20:26.319723+0000","172.21.15.157:6800/4161241346":"2021-10-09T19:20:48.876877+0000","172.21.15.157:0/1646573385":"2021-10-09T19:20:26.319723+0000","172.21.15.157:0/2844775135":"2021-10-09T19:20:26.319723+0000","172.21.15.157:0/1515093903":"2021-10-09T19:20:48.876877+0000","172.21.15.157:6800/3137430012":"2021-10-09T19:20:26.319723+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:26:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff99c0635b0 msgr2=0x7ff99c065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/2979706985 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff99c0635b0 0x7ff99c065a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009fd0 tx=0x7ff9ac00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f94d0 msgr2=0x7ff9b010abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/2979706985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f94d0 0x7ff9b010abe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800d720 tx=0x7ff9a8004db0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 shutdown_connections 2021-10-08T19:26:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/2979706985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9b00f94d0 0x7ff9b010abe0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/2979706985 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff99c0635b0 0x7ff99c065a60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/2979706985 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9b00f6ba0 0x7ff9b0110b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.805 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 --2- 172.21.15.157:0/2979706985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9b00f76f0 0x7ff9b0111070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.805 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 >> 172.21.15.157:0/2979706985 conn(0x7ff9b006da50 msgr2=0x7ff9b006de20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:08.805 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 shutdown_connections 2021-10-08T19:26:08.805 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:08.802+0000 7ff9b7a65700 1 -- 172.21.15.157:0/2979706985 wait complete. 2021-10-08T19:26:09.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:08 smithi196 ceph-mon[34258]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:09.734 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-10-08T19:26:10.051 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:10.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2979706985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:26:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2979706985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:26:10.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2979706985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:26:10.803 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:10 smithi196 ceph-mon[34258]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:10.883 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:10 smithi157 ceph-mon[32847]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:10.884 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:10 smithi157 ceph-mon[42114]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:11.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:26:10 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:26:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:11.889 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 -- 172.21.15.157:0/634772707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33380f7c60 msgr2=0x7f33380f80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.890 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 --2- 172.21.15.157:0/634772707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33380f7c60 0x7f33380f80d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33280046e0 tx=0x7f3328009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:11.890 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 -- 172.21.15.157:0/634772707 shutdown_connections 2021-10-08T19:26:11.890 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 --2- 172.21.15.157:0/634772707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33380f8610 0x7f3338104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.890 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 --2- 172.21.15.157:0/634772707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33380fc440 0x7f33380fc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.891 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 --2- 172.21.15.157:0/634772707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33380f7c60 0x7f33380f80d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.891 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 -- 172.21.15.157:0/634772707 >> 172.21.15.157:0/634772707 conn(0x7f333806d880 msgr2=0x7f33380f4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:11.891 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 -- 172.21.15.157:0/634772707 shutdown_connections 2021-10-08T19:26:11.891 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 -- 172.21.15.157:0/634772707 wait complete. 2021-10-08T19:26:11.891 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.887+0000 7f333e576700 1 Processor -- start 2021-10-08T19:26:11.892 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333e576700 1 -- start start 2021-10-08T19:26:11.892 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333e576700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33380f7c60 0x7f3338110db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:11.892 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333e576700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33380f8610 0x7f33381112f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:11.892 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333e576700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33380fc440 0x7f333810aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:11.893 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333e576700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333810b460 con 0x7f33380f7c60 2021-10-08T19:26:11.893 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333e576700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333810b5a0 con 0x7f33380fc440 2021-10-08T19:26:11.893 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333e576700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333810b760 con 0x7f33380f8610 2021-10-08T19:26:11.893 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333d574700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33380f7c60 0x7f3338110db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:11.894 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333cd73700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33380f8610 0x7f33381112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:11.894 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333d574700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33380f7c60 0x7f3338110db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40994/0 (socket says 172.21.15.157:40994) 2021-10-08T19:26:11.894 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333d574700 1 -- 172.21.15.157:0/2180386999 learned_addr learned my addr 172.21.15.157:0/2180386999 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:11.894 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333dd75700 1 --2- 172.21.15.157:0/2180386999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33380fc440 0x7f333810aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:11.895 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333d574700 1 -- 172.21.15.157:0/2180386999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33380f8610 msgr2=0x7f33381112f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.895 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333d574700 1 --2- 172.21.15.157:0/2180386999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33380f8610 0x7f33381112f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.895 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333d574700 1 -- 172.21.15.157:0/2180386999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33380fc440 msgr2=0x7f333810aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.895 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333d574700 1 --2- 172.21.15.157:0/2180386999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33380fc440 0x7f333810aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.895 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333d574700 1 -- 172.21.15.157:0/2180386999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330009640 con 0x7f33380f7c60 2021-10-08T19:26:11.896 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333cd73700 1 --2- 172.21.15.157:0/2180386999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33380f8610 0x7f33381112f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:11.896 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333dd75700 1 --2- 172.21.15.157:0/2180386999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33380fc440 0x7f333810aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:11.896 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333d574700 1 --2- 172.21.15.157:0/2180386999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33380f7c60 0x7f3338110db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f333400e840 tx=0x7f333400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:11.896 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f332dffb700 1 -- 172.21.15.157:0/2180386999 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340092e0 con 0x7f33380f7c60 2021-10-08T19:26:11.897 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f332dffb700 1 -- 172.21.15.157:0/2180386999 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f333400f040 con 0x7f33380f7c60 2021-10-08T19:26:11.897 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3328005040 con 0x7f33380f7c60 2021-10-08T19:26:11.897 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.888+0000 7f332dffb700 1 -- 172.21.15.157:0/2180386999 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340146f0 con 0x7f33380f7c60 2021-10-08T19:26:11.897 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.889+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333810bd10 con 0x7f33380f7c60 2021-10-08T19:26:11.899 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.889+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f333806e780 con 0x7f33380f7c60 2021-10-08T19:26:11.899 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.890+0000 7f332dffb700 1 -- 172.21.15.157:0/2180386999 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f333401b030 con 0x7f33380f7c60 2021-10-08T19:26:11.899 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.890+0000 7f332dffb700 1 --2- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33240635a0 0x7f3324065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.890+0000 7f332dffb700 1 -- 172.21.15.157:0/2180386999 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f333407f570 con 0x7f33380f7c60 2021-10-08T19:26:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.890+0000 7f333cd73700 1 --2- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33240635a0 0x7f3324065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.890+0000 7f332dffb700 1 --2- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6801/1113941339 conn(0x7f332406cf10 0x7f332406f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.890+0000 7f332dffb700 1 -- 172.21.15.157:0/2180386999 --> v2:172.21.15.157:6801/1113941339 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f332406f9d0 con 0x7f332406cf10 2021-10-08T19:26:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.890+0000 7f332dffb700 1 -- 172.21.15.157:0/2180386999 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3334081bc0 con 0x7f33380f7c60 2021-10-08T19:26:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.890+0000 7f333dd75700 1 --2- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6801/1113941339 conn(0x7f332406cf10 0x7f332406f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.891+0000 7f333cd73700 1 --2- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33240635a0 0x7f3324065a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3328009da0 tx=0x7f3328009b30 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.891+0000 7f333dd75700 1 --2- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6801/1113941339 conn(0x7f332406cf10 0x7f332406f340 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.891+0000 7f332dffb700 1 -- 172.21.15.157:0/2180386999 <== osd.0 v2:172.21.15.157:6801/1113941339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f332406f9d0 con 0x7f332406cf10 2021-10-08T19:26:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.906+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 --> v2:172.21.15.157:6801/1113941339 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33380f6420 con 0x7f332406cf10 2021-10-08T19:26:11.908 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.906+0000 7f332dffb700 1 -- 172.21.15.157:0/2180386999 <== osd.0 v2:172.21.15.157:6801/1113941339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f33380f6420 con 0x7f332406cf10 2021-10-08T19:26:11.909 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6801/1113941339 conn(0x7f332406cf10 msgr2=0x7f332406f340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.909 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 --2- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6801/1113941339 conn(0x7f332406cf10 0x7f332406f340 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.910 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33240635a0 msgr2=0x7f3324065a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.910 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 --2- 172.21.15.157:0/2180386999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33240635a0 0x7f3324065a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3328009da0 tx=0x7f3328009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:11.910 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33380f7c60 msgr2=0x7f3338110db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.911 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 --2- 172.21.15.157:0/2180386999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33380f7c60 0x7f3338110db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f333400e840 tx=0x7f333400b040 comp rx=0 tx=0).stop 2021-10-08T19:26:11.912 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333dd75700 1 -- 172.21.15.157:0/2180386999 reap_dead start 2021-10-08T19:26:11.912 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 shutdown_connections 2021-10-08T19:26:11.912 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 >> 172.21.15.157:0/2180386999 conn(0x7f333806d880 msgr2=0x7f33380f5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:11.912 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 shutdown_connections 2021-10-08T19:26:11.912 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:11.907+0000 7f333e576700 1 -- 172.21.15.157:0/2180386999 wait complete. 2021-10-08T19:26:11.936 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:11.937 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:11.937 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:26:11.938 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:26:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:11.938 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[32847]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:11.940 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:11.940 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[42114]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:11.941 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:26:11.941 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:26:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:11.942 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:11 smithi157 ceph-mon[42114]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:12.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:11 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:12.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:11 smithi196 ceph-mon[34258]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:12.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:11 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:26:12.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:11 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:26:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:12.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:11 smithi196 ceph-mon[34258]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:12.508 INFO:teuthology.orchestra.run.smithi157.stdout:34359738411 2021-10-08T19:26:12.508 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-10-08T19:26:12.784 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:14.302 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.300+0000 7ff2175b7700 1 -- 172.21.15.157:0/4139787474 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2100fcd30 msgr2=0x7ff2100fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.303 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.300+0000 7ff2175b7700 1 --2- 172.21.15.157:0/4139787474 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2100fcd30 0x7ff2100fd100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0046e0 tx=0x7ff20c009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:14.303 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.300+0000 7ff2175b7700 1 -- 172.21.15.157:0/4139787474 shutdown_connections 2021-10-08T19:26:14.303 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.300+0000 7ff2175b7700 1 --2- 172.21.15.157:0/4139787474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2100f7500 0x7ff210103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.303 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.300+0000 7ff2175b7700 1 --2- 172.21.15.157:0/4139787474 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2100fcd30 0x7ff2100fd100 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.304 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.300+0000 7ff2175b7700 1 --2- 172.21.15.157:0/4139787474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2100fd6d0 0x7ff2100f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.304 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.300+0000 7ff2175b7700 1 -- 172.21.15.157:0/4139787474 >> 172.21.15.157:0/4139787474 conn(0x7ff21006da50 msgr2=0x7ff2100f4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:14.304 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 -- 172.21.15.157:0/4139787474 shutdown_connections 2021-10-08T19:26:14.304 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 -- 172.21.15.157:0/4139787474 wait complete. 2021-10-08T19:26:14.305 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 Processor -- start 2021-10-08T19:26:14.305 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 -- start start 2021-10-08T19:26:14.305 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2100f7500 0x7ff21010ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:14.305 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2100fcd30 0x7ff21010ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:14.305 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2100fd6d0 0x7ff210108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:14.306 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2101090a0 con 0x7ff2100f7500 2021-10-08T19:26:14.306 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210109210 con 0x7ff2100fd6d0 2021-10-08T19:26:14.306 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff2175b7700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2101093d0 con 0x7ff2100fcd30 2021-10-08T19:26:14.306 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff215353700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2100f7500 0x7ff21010ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:14.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff214b52700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2100fcd30 0x7ff21010ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:14.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff215353700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2100f7500 0x7ff21010ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41006/0 (socket says 172.21.15.157:41006) 2021-10-08T19:26:14.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.301+0000 7ff215353700 1 -- 172.21.15.157:0/3443007850 learned_addr learned my addr 172.21.15.157:0/3443007850 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:14.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff215b54700 1 --2- 172.21.15.157:0/3443007850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2100fd6d0 0x7ff210108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:14.308 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff215353700 1 -- 172.21.15.157:0/3443007850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2100fcd30 msgr2=0x7ff21010ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.308 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff215353700 1 --2- 172.21.15.157:0/3443007850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2100fcd30 0x7ff21010ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.308 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff215353700 1 -- 172.21.15.157:0/3443007850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2100fd6d0 msgr2=0x7ff210108ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff215353700 1 --2- 172.21.15.157:0/3443007850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2100fd6d0 0x7ff210108ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff215353700 1 -- 172.21.15.157:0/3443007850 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c005040 con 0x7ff2100f7500 2021-10-08T19:26:14.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff214b52700 1 --2- 172.21.15.157:0/3443007850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2100fcd30 0x7ff21010ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:14.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff215353700 1 --2- 172.21.15.157:0/3443007850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2100f7500 0x7ff21010ea00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009f50 tx=0x7ff20c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:14.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff205ffb700 1 -- 172.21.15.157:0/3443007850 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c01a070 con 0x7ff2100f7500 2021-10-08T19:26:14.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff210109650 con 0x7ff2100f7500 2021-10-08T19:26:14.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff205ffb700 1 -- 172.21.15.157:0/3443007850 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7ff20c007da0 con 0x7ff2100f7500 2021-10-08T19:26:14.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff205ffb700 1 -- 172.21.15.157:0/3443007850 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c01fb80 con 0x7ff2100f7500 2021-10-08T19:26:14.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.302+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2100f9420 con 0x7ff2100f7500 2021-10-08T19:26:14.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.303+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff210109970 con 0x7ff2100f7500 2021-10-08T19:26:14.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.304+0000 7ff205ffb700 1 -- 172.21.15.157:0/3443007850 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7ff20c007920 con 0x7ff2100f7500 2021-10-08T19:26:14.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.304+0000 7ff205ffb700 1 --2- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff1fc0635b0 0x7ff1fc065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:14.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.304+0000 7ff205ffb700 1 -- 172.21.15.157:0/3443007850 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7ff20c0810e0 con 0x7ff2100f7500 2021-10-08T19:26:14.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.304+0000 7ff214b52700 1 --2- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff1fc0635b0 0x7ff1fc065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:14.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.304+0000 7ff205ffb700 1 --2- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6805/336233855 conn(0x7ff1fc06cf20 0x7ff1fc06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:14.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.304+0000 7ff205ffb700 1 -- 172.21.15.157:0/3443007850 --> v2:172.21.15.157:6805/336233855 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1fc06f9e0 con 0x7ff1fc06cf20 2021-10-08T19:26:14.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.304+0000 7ff205ffb700 1 -- 172.21.15.157:0/3443007850 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff20c083730 con 0x7ff2100f7500 2021-10-08T19:26:14.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.304+0000 7ff215b54700 1 --2- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6805/336233855 conn(0x7ff1fc06cf20 0x7ff1fc06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:14.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.304+0000 7ff214b52700 1 --2- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff1fc0635b0 0x7ff1fc065a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff21010a230 tx=0x7ff20000b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:14.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.305+0000 7ff215b54700 1 --2- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6805/336233855 conn(0x7ff1fc06cf20 0x7ff1fc06f350 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:14.315 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.305+0000 7ff205ffb700 1 -- 172.21.15.157:0/3443007850 <== osd.1 v2:172.21.15.157:6805/336233855 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7ff1fc06f9e0 con 0x7ff1fc06cf20 2021-10-08T19:26:14.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.320+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 --> v2:172.21.15.157:6805/336233855 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff210047b50 con 0x7ff1fc06cf20 2021-10-08T19:26:14.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.320+0000 7ff205ffb700 1 -- 172.21.15.157:0/3443007850 <== osd.1 v2:172.21.15.157:6805/336233855 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff210047b50 con 0x7ff1fc06cf20 2021-10-08T19:26:14.322 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.320+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6805/336233855 conn(0x7ff1fc06cf20 msgr2=0x7ff1fc06f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.322 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.320+0000 7ff2175b7700 1 --2- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6805/336233855 conn(0x7ff1fc06cf20 0x7ff1fc06f350 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.323 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.321+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff1fc0635b0 msgr2=0x7ff1fc065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.323 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.321+0000 7ff2175b7700 1 --2- 172.21.15.157:0/3443007850 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff1fc0635b0 0x7ff1fc065a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff21010a230 tx=0x7ff20000b040 comp rx=0 tx=0).stop 2021-10-08T19:26:14.323 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.321+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2100f7500 msgr2=0x7ff21010ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.323 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.321+0000 7ff2175b7700 1 --2- 172.21.15.157:0/3443007850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2100f7500 0x7ff21010ea00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009f50 tx=0x7ff20c009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:14.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.321+0000 7ff215b54700 1 -- 172.21.15.157:0/3443007850 reap_dead start 2021-10-08T19:26:14.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.321+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 shutdown_connections 2021-10-08T19:26:14.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.321+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 >> 172.21.15.157:0/3443007850 conn(0x7ff21006da50 msgr2=0x7ff21006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:14.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.321+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 shutdown_connections 2021-10-08T19:26:14.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:14.321+0000 7ff2175b7700 1 -- 172.21.15.157:0/3443007850 wait complete. 2021-10-08T19:26:14.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:14 smithi157 ceph-mon[42114]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:14.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:26:14 smithi157 conmon[74087]: level=info ts=2021-10-08T19:26:14.456Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000542066s 2021-10-08T19:26:14.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:14 smithi157 ceph-mon[32847]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:14.964 INFO:teuthology.orchestra.run.smithi157.stdout:55834574886 2021-10-08T19:26:14.965 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-10-08T19:26:15.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:14 smithi196 ceph-mon[34258]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:15.242 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:16.897 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.878+0000 7f769b1af700 1 -- 172.21.15.157:0/1424280823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76940fd5d0 msgr2=0x7f76940fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:16.919 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.878+0000 7f769b1af700 1 --2- 172.21.15.157:0/1424280823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76940fd5d0 0x7f76940fd9a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7684004650 tx=0x7f7684009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:16.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.878+0000 7f769b1af700 1 -- 172.21.15.157:0/1424280823 shutdown_connections 2021-10-08T19:26:16.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.878+0000 7f769b1af700 1 --2- 172.21.15.157:0/1424280823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76940f7d60 0x7f76941043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:16.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.878+0000 7f769b1af700 1 --2- 172.21.15.157:0/1424280823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76940fd5d0 0x7f76940fd9a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:16.920 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.878+0000 7f769b1af700 1 --2- 172.21.15.157:0/1424280823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76940fdf70 0x7f76940f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:16.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.878+0000 7f769b1af700 1 -- 172.21.15.157:0/1424280823 >> 172.21.15.157:0/1424280823 conn(0x7f769406f330 msgr2=0x7f769406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:16.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.878+0000 7f769b1af700 1 -- 172.21.15.157:0/1424280823 shutdown_connections 2021-10-08T19:26:16.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.878+0000 7f769b1af700 1 -- 172.21.15.157:0/1424280823 wait complete. 2021-10-08T19:26:16.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769b1af700 1 Processor -- start 2021-10-08T19:26:16.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769b1af700 1 -- start start 2021-10-08T19:26:16.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769b1af700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76940f7d60 0x7f769410ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:16.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769b1af700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76940fd5d0 0x7f769410efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:16.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769b1af700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76940fdf70 0x7f7694108b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:16.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769b1af700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7694109120 con 0x7f76940fd5d0 2021-10-08T19:26:16.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769b1af700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7694109290 con 0x7f76940fdf70 2021-10-08T19:26:16.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769b1af700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7694109450 con 0x7f76940f7d60 2021-10-08T19:26:16.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f7698f4b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76940f7d60 0x7f769410ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:16.924 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f7693fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76940fd5d0 0x7f769410efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:16.924 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f7698f4b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76940f7d60 0x7f769410ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50268/0 (socket says 172.21.15.157:50268) 2021-10-08T19:26:16.924 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f7698f4b700 1 -- 172.21.15.157:0/3490713543 learned_addr learned my addr 172.21.15.157:0/3490713543 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:16.924 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769974c700 1 --2- 172.21.15.157:0/3490713543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76940fdf70 0x7f7694108b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:16.924 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f7698f4b700 1 -- 172.21.15.157:0/3490713543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76940fdf70 msgr2=0x7f7694108b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:16.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f7698f4b700 1 --2- 172.21.15.157:0/3490713543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76940fdf70 0x7f7694108b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:16.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f7698f4b700 1 -- 172.21.15.157:0/3490713543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76940fd5d0 msgr2=0x7f769410efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:16.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f7698f4b700 1 --2- 172.21.15.157:0/3490713543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76940fd5d0 0x7f769410efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:16.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f7698f4b700 1 -- 172.21.15.157:0/3490713543 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c009640 con 0x7f76940f7d60 2021-10-08T19:26:16.928 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.879+0000 7f769974c700 1 --2- 172.21.15.157:0/3490713543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76940fdf70 0x7f7694108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:26:16.928 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.880+0000 7f7698f4b700 1 --2- 172.21.15.157:0/3490713543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76940f7d60 0x7f769410ea80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7684004c80 tx=0x7f7684009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:16.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.880+0000 7f76917fa700 1 -- 172.21.15.157:0/3490713543 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768400e070 con 0x7f76940f7d60 2021-10-08T19:26:16.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.880+0000 7f76917fa700 1 -- 172.21.15.157:0/3490713543 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f7684004160 con 0x7f76940f7d60 2021-10-08T19:26:16.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.880+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7684005040 con 0x7f76940f7d60 2021-10-08T19:26:16.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.880+0000 7f76917fa700 1 -- 172.21.15.157:0/3490713543 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768401a070 con 0x7f76940f7d60 2021-10-08T19:26:16.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.880+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76941099c0 con 0x7f76940f7d60 2021-10-08T19:26:16.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.880+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76940f7100 con 0x7f76940f7d60 2021-10-08T19:26:16.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.881+0000 7f76917fa700 1 -- 172.21.15.157:0/3490713543 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f7684025020 con 0x7f76940f7d60 2021-10-08T19:26:16.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.882+0000 7f76917fa700 1 --2- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6800/1475557172 conn(0x7f76740635b0 0x7f7674065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:16.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.882+0000 7f76917fa700 1 -- 172.21.15.157:0/3490713543 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f7684080e50 con 0x7f76940f7d60 2021-10-08T19:26:16.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.882+0000 7f7693fff700 1 --2- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6800/1475557172 conn(0x7f76740635b0 0x7f7674065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:16.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.882+0000 7f76917fa700 1 --2- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6809/2873488643 conn(0x7f767406cf20 0x7f767406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:16.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.882+0000 7f76917fa700 1 -- 172.21.15.157:0/3490713543 --> v2:172.21.15.157:6809/2873488643 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f767406f9e0 con 0x7f767406cf20 2021-10-08T19:26:16.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.882+0000 7f76917fa700 1 -- 172.21.15.157:0/3490713543 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7684081230 con 0x7f76940f7d60 2021-10-08T19:26:16.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.882+0000 7f769974c700 1 --2- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6809/2873488643 conn(0x7f767406cf20 0x7f767406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:16.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.882+0000 7f7693fff700 1 --2- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6800/1475557172 conn(0x7f76740635b0 0x7f7674065a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f769410a2b0 tx=0x7f767c00b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:16.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.882+0000 7f769974c700 1 --2- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6809/2873488643 conn(0x7f767406cf20 0x7f767406f350 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:16.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.883+0000 7f76917fa700 1 -- 172.21.15.157:0/3490713543 <== osd.2 v2:172.21.15.157:6809/2873488643 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f767406f9e0 con 0x7f767406cf20 2021-10-08T19:26:16.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.898+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 --> v2:172.21.15.157:6809/2873488643 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76941099c0 con 0x7f767406cf20 2021-10-08T19:26:16.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.898+0000 7f76917fa700 1 -- 172.21.15.157:0/3490713543 <== osd.2 v2:172.21.15.157:6809/2873488643 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f76941099c0 con 0x7f767406cf20 2021-10-08T19:26:16.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.898+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6809/2873488643 conn(0x7f767406cf20 msgr2=0x7f767406f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:16.935 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.898+0000 7f769b1af700 1 --2- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6809/2873488643 conn(0x7f767406cf20 0x7f767406f350 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:16.935 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.898+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6800/1475557172 conn(0x7f76740635b0 msgr2=0x7f7674065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:16.935 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.898+0000 7f769b1af700 1 --2- 172.21.15.157:0/3490713543 >> v2:172.21.15.157:6800/1475557172 conn(0x7f76740635b0 0x7f7674065a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f769410a2b0 tx=0x7f767c00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:16.935 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.898+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76940f7d60 msgr2=0x7f769410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:16.935 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.898+0000 7f769b1af700 1 --2- 172.21.15.157:0/3490713543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76940f7d60 0x7f769410ea80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7684004c80 tx=0x7f7684009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:16.936 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.898+0000 7f769974c700 1 -- 172.21.15.157:0/3490713543 reap_dead start 2021-10-08T19:26:16.936 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.899+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 shutdown_connections 2021-10-08T19:26:16.937 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.899+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 >> 172.21.15.157:0/3490713543 conn(0x7f769406f330 msgr2=0x7f76940f6730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:16.937 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.899+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 shutdown_connections 2021-10-08T19:26:16.937 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:16.899+0000 7f769b1af700 1 -- 172.21.15.157:0/3490713543 wait complete. 2021-10-08T19:26:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:16 smithi157 ceph-mon[32847]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:26:17.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:16 smithi157 ceph-mon[42114]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:26:17.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:16 smithi196 ceph-mon[34258]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:26:17.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:26:16 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:26:17.573 INFO:teuthology.orchestra.run.smithi157.stdout:77309411363 2021-10-08T19:26:17.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-10-08T19:26:17.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:17 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:17.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:17 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:17.849 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:18.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:17 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:18 smithi157 ceph-mon[32847]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:19.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:18 smithi157 ceph-mon[42114]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:19.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:18 smithi196 ceph-mon[34258]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.331+0000 7ff3b4470700 1 -- 172.21.15.157:0/2381265864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3ac0fd5d0 msgr2=0x7ff3ac0fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.331+0000 7ff3b4470700 1 --2- 172.21.15.157:0/2381265864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3ac0fd5d0 0x7ff3ac0fd9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80046e0 tx=0x7ff3a8009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.331+0000 7ff3b4470700 1 -- 172.21.15.157:0/2381265864 shutdown_connections 2021-10-08T19:26:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.331+0000 7ff3b4470700 1 --2- 172.21.15.157:0/2381265864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3ac0f7d60 0x7ff3ac1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.331+0000 7ff3b4470700 1 --2- 172.21.15.157:0/2381265864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3ac0fd5d0 0x7ff3ac0fd9a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.331+0000 7ff3b4470700 1 --2- 172.21.15.157:0/2381265864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3ac0fdf70 0x7ff3ac0f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.331+0000 7ff3b4470700 1 -- 172.21.15.157:0/2381265864 >> 172.21.15.157:0/2381265864 conn(0x7ff3ac06f330 msgr2=0x7ff3ac06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.331+0000 7ff3b4470700 1 -- 172.21.15.157:0/2381265864 shutdown_connections 2021-10-08T19:26:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.331+0000 7ff3b4470700 1 -- 172.21.15.157:0/2381265864 wait complete. 2021-10-08T19:26:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b4470700 1 Processor -- start 2021-10-08T19:26:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b4470700 1 -- start start 2021-10-08T19:26:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b4470700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3ac0f7d60 0x7ff3ac109b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b4470700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3ac0fd5d0 0x7ff3ac10a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b4470700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3ac0fdf70 0x7ff3ac114bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b4470700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac10a850 con 0x7ff3ac0fd5d0 2021-10-08T19:26:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b4470700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac10a9c0 con 0x7ff3ac0fdf70 2021-10-08T19:26:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b4470700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac115140 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.344 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b220c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3ac0f7d60 0x7ff3ac109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:19.344 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b220c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3ac0f7d60 0x7ff3ac109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50282/0 (socket says 172.21.15.157:50282) 2021-10-08T19:26:19.344 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b220c700 1 -- 172.21.15.157:0/2432966280 learned_addr learned my addr 172.21.15.157:0/2432966280 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b1a0b700 1 --2- 172.21.15.157:0/2432966280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3ac0fd5d0 0x7ff3ac10a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b2a0d700 1 --2- 172.21.15.157:0/2432966280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3ac0fdf70 0x7ff3ac114bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b220c700 1 -- 172.21.15.157:0/2432966280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3ac0fdf70 msgr2=0x7ff3ac114bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b220c700 1 --2- 172.21.15.157:0/2432966280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3ac0fdf70 0x7ff3ac114bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b220c700 1 -- 172.21.15.157:0/2432966280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3ac0fd5d0 msgr2=0x7ff3ac10a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b220c700 1 --2- 172.21.15.157:0/2432966280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3ac0fd5d0 0x7ff3ac10a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b220c700 1 -- 172.21.15.157:0/2432966280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a4009640 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3b220c700 1 --2- 172.21.15.157:0/2432966280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3ac0f7d60 0x7ff3ac109b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009f50 tx=0x7ff3a8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.332+0000 7ff3a2ffd700 1 -- 172.21.15.157:0/2432966280 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a801a070 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.333+0000 7ff3a2ffd700 1 -- 172.21.15.157:0/2432966280 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7ff3a8007da0 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.350 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.333+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a8005040 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.351 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.333+0000 7ff3a2ffd700 1 -- 172.21.15.157:0/2432966280 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a801ea30 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.351 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.333+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac115600 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.351 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.333+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3ac0f7150 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.352 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.334+0000 7ff3a2ffd700 1 -- 172.21.15.157:0/2432966280 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7ff3a8009530 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.352 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.334+0000 7ff3a2ffd700 1 --2- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff3980635b0 0x7ff398065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:19.353 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.334+0000 7ff3a2ffd700 1 -- 172.21.15.157:0/2432966280 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7ff3a8080c20 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.353 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.334+0000 7ff3b1a0b700 1 --2- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff3980635b0 0x7ff398065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:19.353 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.334+0000 7ff3a2ffd700 1 --2- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6813/2430876343 conn(0x7ff39806cf20 0x7ff39806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:19.354 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.334+0000 7ff3a2ffd700 1 -- 172.21.15.157:0/2432966280 --> v2:172.21.15.157:6813/2430876343 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff39806f9e0 con 0x7ff39806cf20 2021-10-08T19:26:19.354 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.334+0000 7ff3a2ffd700 1 -- 172.21.15.157:0/2432966280 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3a8086280 con 0x7ff3ac0f7d60 2021-10-08T19:26:19.355 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.335+0000 7ff3b2a0d700 1 --2- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6813/2430876343 conn(0x7ff39806cf20 0x7ff39806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:19.355 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.335+0000 7ff3b1a0b700 1 --2- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff3980635b0 0x7ff398065a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac062210 tx=0x7ff39c00b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:19.356 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.335+0000 7ff3b2a0d700 1 --2- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6813/2430876343 conn(0x7ff39806cf20 0x7ff39806f350 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:19.356 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.336+0000 7ff3a2ffd700 1 -- 172.21.15.157:0/2432966280 <== osd.3 v2:172.21.15.157:6813/2430876343 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7ff39806f9e0 con 0x7ff39806cf20 2021-10-08T19:26:19.357 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.350+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 --> v2:172.21.15.157:6813/2430876343 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3ac0f7500 con 0x7ff39806cf20 2021-10-08T19:26:19.358 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.350+0000 7ff3a2ffd700 1 -- 172.21.15.157:0/2432966280 <== osd.3 v2:172.21.15.157:6813/2430876343 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff3ac0f7500 con 0x7ff39806cf20 2021-10-08T19:26:19.359 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6813/2430876343 conn(0x7ff39806cf20 msgr2=0x7ff39806f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:19.360 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 --2- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6813/2430876343 conn(0x7ff39806cf20 0x7ff39806f350 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:19.360 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff3980635b0 msgr2=0x7ff398065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:19.361 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 --2- 172.21.15.157:0/2432966280 >> v2:172.21.15.157:6800/1475557172 conn(0x7ff3980635b0 0x7ff398065a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac062210 tx=0x7ff39c00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:19.361 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3ac0f7d60 msgr2=0x7ff3ac109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:19.362 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 --2- 172.21.15.157:0/2432966280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3ac0f7d60 0x7ff3ac109b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009f50 tx=0x7ff3a8009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:19.362 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b2a0d700 1 -- 172.21.15.157:0/2432966280 reap_dead start 2021-10-08T19:26:19.362 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 shutdown_connections 2021-10-08T19:26:19.363 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 >> 172.21.15.157:0/2432966280 conn(0x7ff3ac06f330 msgr2=0x7ff3ac0f67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:19.363 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 shutdown_connections 2021-10-08T19:26:19.364 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:19.351+0000 7ff3b4470700 1 -- 172.21.15.157:0/2432966280 wait complete. 2021-10-08T19:26:19.981 INFO:teuthology.orchestra.run.smithi157.stdout:107374182433 2021-10-08T19:26:19.981 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-10-08T19:26:20.256 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:20.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:20 smithi157 ceph-mon[32847]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:20.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:20 smithi157 ceph-mon[42114]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:21.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:20 smithi196 ceph-mon[34258]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:21.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.931+0000 7fcedadf5700 1 -- 172.21.15.157:0/2011600442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced40fd6c0 msgr2=0x7fced40fda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:21.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.931+0000 7fcedadf5700 1 --2- 172.21.15.157:0/2011600442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced40fd6c0 0x7fced40fda90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcec4004650 tx=0x7fcec4009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:21.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.931+0000 7fcedadf5700 1 -- 172.21.15.157:0/2011600442 shutdown_connections 2021-10-08T19:26:21.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.931+0000 7fcedadf5700 1 --2- 172.21.15.157:0/2011600442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced40f8150 0x7fced4104450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:21.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.931+0000 7fcedadf5700 1 --2- 172.21.15.157:0/2011600442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced40fd6c0 0x7fced40fda90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:21.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.931+0000 7fcedadf5700 1 --2- 172.21.15.157:0/2011600442 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fced40f77a0 0x7fced40f7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:21.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.931+0000 7fcedadf5700 1 -- 172.21.15.157:0/2011600442 >> 172.21.15.157:0/2011600442 conn(0x7fced406d750 msgr2=0x7fced406db50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:21.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.931+0000 7fcedadf5700 1 -- 172.21.15.157:0/2011600442 shutdown_connections 2021-10-08T19:26:21.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.931+0000 7fcedadf5700 1 -- 172.21.15.157:0/2011600442 wait complete. 2021-10-08T19:26:21.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fcedadf5700 1 Processor -- start 2021-10-08T19:26:21.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fcedadf5700 1 -- start start 2021-10-08T19:26:21.937 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fcedadf5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced40f77a0 0x7fced4107900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:21.937 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fcedadf5700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fced40f8150 0x7fced4107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:21.938 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fcedadf5700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced40fd6c0 0x7fced4108380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:21.938 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fcedadf5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4117010 con 0x7fced40f77a0 2021-10-08T19:26:21.938 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fcedadf5700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4117180 con 0x7fced40fd6c0 2021-10-08T19:26:21.938 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fcedadf5700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced4117340 con 0x7fced40f8150 2021-10-08T19:26:21.939 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fced3fff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fced40f8150 0x7fced4107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:21.939 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fced8b91700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced40f77a0 0x7fced4107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:21.939 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fced3fff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fced40f8150 0x7fced4107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50300/0 (socket says 172.21.15.157:50300) 2021-10-08T19:26:21.939 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fced3fff700 1 -- 172.21.15.157:0/3803196594 learned_addr learned my addr 172.21.15.157:0/3803196594 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:21.940 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fced9392700 1 --2- 172.21.15.157:0/3803196594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced40fd6c0 0x7fced4108380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:21.940 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.932+0000 7fced8b91700 1 -- 172.21.15.157:0/3803196594 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fced40f8150 msgr2=0x7fced4107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:21.940 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fced8b91700 1 --2- 172.21.15.157:0/3803196594 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fced40f8150 0x7fced4107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:21.940 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fced8b91700 1 -- 172.21.15.157:0/3803196594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced40fd6c0 msgr2=0x7fced4108380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:21.940 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fced8b91700 1 --2- 172.21.15.157:0/3803196594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced40fd6c0 0x7fced4108380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:21.941 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fced8b91700 1 -- 172.21.15.157:0/3803196594 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8005040 con 0x7fced40f77a0 2021-10-08T19:26:21.941 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fced9392700 1 --2- 172.21.15.157:0/3803196594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced40fd6c0 0x7fced4108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:21.941 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fced8b91700 1 --2- 172.21.15.157:0/3803196594 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced40f77a0 0x7fced4107900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009f50 tx=0x7fcec4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:21.941 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fced17fa700 1 -- 172.21.15.157:0/3803196594 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400e070 con 0x7fced40f77a0 2021-10-08T19:26:21.941 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fced17fa700 1 -- 172.21.15.157:0/3803196594 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fcec40095b0 con 0x7fced40f77a0 2021-10-08T19:26:21.942 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec4005040 con 0x7fced40f77a0 2021-10-08T19:26:21.942 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fced17fa700 1 -- 172.21.15.157:0/3803196594 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec401a070 con 0x7fced40f77a0 2021-10-08T19:26:21.942 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.933+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced4117940 con 0x7fced40f77a0 2021-10-08T19:26:21.942 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.934+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fced40f6dc0 con 0x7fced40f77a0 2021-10-08T19:26:21.943 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.934+0000 7fced17fa700 1 -- 172.21.15.157:0/3803196594 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fcec4025070 con 0x7fced40f77a0 2021-10-08T19:26:21.943 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.934+0000 7fced17fa700 1 --2- 172.21.15.157:0/3803196594 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcebc0635b0 0x7fcebc065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:21.943 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.935+0000 7fced17fa700 1 -- 172.21.15.157:0/3803196594 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fcec407ffb0 con 0x7fced40f77a0 2021-10-08T19:26:21.943 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.935+0000 7fced3fff700 1 --2- 172.21.15.157:0/3803196594 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcebc0635b0 0x7fcebc065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:21.943 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.935+0000 7fced17fa700 1 --2- 172.21.15.157:0/3803196594 >> v2:172.21.15.196:6800/2530339252 conn(0x7fcebc06cf20 0x7fcebc06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:21.944 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.935+0000 7fced17fa700 1 -- 172.21.15.157:0/3803196594 --> v2:172.21.15.196:6800/2530339252 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcebc06f9e0 con 0x7fcebc06cf20 2021-10-08T19:26:21.944 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.935+0000 7fced17fa700 1 -- 172.21.15.157:0/3803196594 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcec4082600 con 0x7fced40f77a0 2021-10-08T19:26:21.944 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.935+0000 7fced9392700 1 --2- 172.21.15.157:0/3803196594 >> v2:172.21.15.196:6800/2530339252 conn(0x7fcebc06cf20 0x7fcebc06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:21.944 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.935+0000 7fced3fff700 1 --2- 172.21.15.157:0/3803196594 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcebc0635b0 0x7fcebc065a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fced40622e0 tx=0x7fcec800b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:21.945 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.935+0000 7fced9392700 1 --2- 172.21.15.157:0/3803196594 >> v2:172.21.15.196:6800/2530339252 conn(0x7fcebc06cf20 0x7fcebc06f350 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:21.945 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.936+0000 7fced17fa700 1 -- 172.21.15.157:0/3803196594 <== osd.4 v2:172.21.15.196:6800/2530339252 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7fcebc06f9e0 con 0x7fcebc06cf20 2021-10-08T19:26:21.950 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.950+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 --> v2:172.21.15.196:6800/2530339252 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fced40f7170 con 0x7fcebc06cf20 2021-10-08T19:26:21.951 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.951+0000 7fced17fa700 1 -- 172.21.15.157:0/3803196594 <== osd.4 v2:172.21.15.196:6800/2530339252 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fced40f7170 con 0x7fcebc06cf20 2021-10-08T19:26:21.952 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.951+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 >> v2:172.21.15.196:6800/2530339252 conn(0x7fcebc06cf20 msgr2=0x7fcebc06f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:21.952 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.951+0000 7fcedadf5700 1 --2- 172.21.15.157:0/3803196594 >> v2:172.21.15.196:6800/2530339252 conn(0x7fcebc06cf20 0x7fcebc06f350 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:21.953 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.951+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcebc0635b0 msgr2=0x7fcebc065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:21.953 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.951+0000 7fcedadf5700 1 --2- 172.21.15.157:0/3803196594 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcebc0635b0 0x7fcebc065a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fced40622e0 tx=0x7fcec800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:21.953 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.951+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced40f77a0 msgr2=0x7fced4107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:21.953 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.951+0000 7fcedadf5700 1 --2- 172.21.15.157:0/3803196594 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced40f77a0 0x7fced4107900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009f50 tx=0x7fcec4009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:21.953 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.951+0000 7fced9392700 1 -- 172.21.15.157:0/3803196594 reap_dead start 2021-10-08T19:26:21.954 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.952+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 shutdown_connections 2021-10-08T19:26:21.954 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.952+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 >> 172.21.15.157:0/3803196594 conn(0x7fced406d750 msgr2=0x7fced40f6430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:21.954 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.952+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 shutdown_connections 2021-10-08T19:26:21.954 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:21.952+0000 7fcedadf5700 1 -- 172.21.15.157:0/3803196594 wait complete. 2021-10-08T19:26:22.505 INFO:teuthology.orchestra.run.smithi157.stdout:128849018910 2021-10-08T19:26:22.507 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-10-08T19:26:22.780 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:22.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:22 smithi157 ceph-mon[32847]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:22.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:22 smithi157 ceph-mon[42114]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:23.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:22 smithi196 ceph-mon[34258]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:24.317 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.314+0000 7f3ec1aec700 1 -- 172.21.15.157:0/1410381560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ebc0ff090 msgr2=0x7f3ebc0f8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:24.318 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.314+0000 7f3ec1aec700 1 --2- 172.21.15.157:0/1410381560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ebc0ff090 0x7f3ebc0f8740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4004620 tx=0x7f3ea4009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:24.318 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.314+0000 7f3ec1aec700 1 -- 172.21.15.157:0/1410381560 shutdown_connections 2021-10-08T19:26:24.318 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.314+0000 7f3ec1aec700 1 --2- 172.21.15.157:0/1410381560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ebc0f8e70 0x7f3ebc105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:24.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.314+0000 7f3ec1aec700 1 --2- 172.21.15.157:0/1410381560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ebc0fe6f0 0x7f3ebc0feac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:24.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.314+0000 7f3ec1aec700 1 --2- 172.21.15.157:0/1410381560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ebc0ff090 0x7f3ebc0f8740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:24.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.314+0000 7f3ec1aec700 1 -- 172.21.15.157:0/1410381560 >> 172.21.15.157:0/1410381560 conn(0x7f3ebc06f3d0 msgr2=0x7f3ebc0f6800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:24.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 -- 172.21.15.157:0/1410381560 shutdown_connections 2021-10-08T19:26:24.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 -- 172.21.15.157:0/1410381560 wait complete. 2021-10-08T19:26:24.320 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 Processor -- start 2021-10-08T19:26:24.320 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 -- start start 2021-10-08T19:26:24.320 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ebc0f8e70 0x7f3ebc10e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:24.320 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ebc0fe6f0 0x7f3ebc10ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:24.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ebc0ff090 0x7f3ebc108ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:24.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc109090 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc109200 con 0x7f3ebc0ff090 2021-10-08T19:26:24.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ec1aec700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc1093c0 con 0x7f3ebc0f8e70 2021-10-08T19:26:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ebb7fe700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ebc0f8e70 0x7f3ebc10e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3eb3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ebc0fe6f0 0x7f3ebc10ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3eb3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ebc0fe6f0 0x7f3ebc10ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41068/0 (socket says 172.21.15.157:41068) 2021-10-08T19:26:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ebb7fe700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ebc0f8e70 0x7f3ebc10e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50314/0 (socket says 172.21.15.157:50314) 2021-10-08T19:26:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3eb3fff700 1 -- 172.21.15.157:0/2904967961 learned_addr learned my addr 172.21.15.157:0/2904967961 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.315+0000 7f3ebbfff700 1 --2- 172.21.15.157:0/2904967961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ebc0ff090 0x7f3ebc108ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3eb3fff700 1 -- 172.21.15.157:0/2904967961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ebc0f8e70 msgr2=0x7f3ebc10e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3eb3fff700 1 --2- 172.21.15.157:0/2904967961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ebc0f8e70 0x7f3ebc10e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3eb3fff700 1 -- 172.21.15.157:0/2904967961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ebc0ff090 msgr2=0x7f3ebc108ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3eb3fff700 1 --2- 172.21.15.157:0/2904967961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ebc0ff090 0x7f3ebc108ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3eb3fff700 1 -- 172.21.15.157:0/2904967961 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac005040 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3ebb7fe700 1 --2- 172.21.15.157:0/2904967961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ebc0f8e70 0x7f3ebc10e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3eb3fff700 1 --2- 172.21.15.157:0/2904967961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ebc0fe6f0 0x7f3ebc10ef30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009da0 tx=0x7f3ea4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3eb8ff9700 1 -- 172.21.15.157:0/2904967961 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400e070 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3eb8ff9700 1 -- 172.21.15.157:0/2904967961 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f3ea4007920 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3eb8ff9700 1 -- 172.21.15.157:0/2904967961 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea401a070 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea4005040 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.326 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.316+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc1098e0 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.326 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.317+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ebc070cf0 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.328 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.317+0000 7f3eb8ff9700 1 -- 172.21.15.157:0/2904967961 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f3ea4007a90 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.328 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.318+0000 7f3eb8ff9700 1 --2- 172.21.15.157:0/2904967961 >> v2:172.21.15.157:6800/1475557172 conn(0x7f3ea80635b0 0x7f3ea8065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:24.328 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.318+0000 7f3eb8ff9700 1 -- 172.21.15.157:0/2904967961 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f3ea407ffd0 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.328 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.318+0000 7f3ebb7fe700 1 --2- 172.21.15.157:0/2904967961 >> v2:172.21.15.157:6800/1475557172 conn(0x7f3ea80635b0 0x7f3ea8065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:24.329 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.318+0000 7f3eb8ff9700 1 --2- 172.21.15.157:0/2904967961 >> v2:172.21.15.196:6804/3344395065 conn(0x7f3ea806cf20 0x7f3ea806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:24.329 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.318+0000 7f3eb8ff9700 1 -- 172.21.15.157:0/2904967961 --> v2:172.21.15.196:6804/3344395065 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ea806f9e0 con 0x7f3ea806cf20 2021-10-08T19:26:24.329 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.318+0000 7f3eb8ff9700 1 -- 172.21.15.157:0/2904967961 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ea4082620 con 0x7f3ebc0fe6f0 2021-10-08T19:26:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.318+0000 7f3ebbfff700 1 --2- 172.21.15.157:0/2904967961 >> v2:172.21.15.196:6804/3344395065 conn(0x7f3ea806cf20 0x7f3ea806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.318+0000 7f3ebb7fe700 1 --2- 172.21.15.157:0/2904967961 >> v2:172.21.15.157:6800/1475557172 conn(0x7f3ea80635b0 0x7f3ea8065a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009fd0 tx=0x7f3eac00b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.318+0000 7f3ebbfff700 1 --2- 172.21.15.157:0/2904967961 >> v2:172.21.15.196:6804/3344395065 conn(0x7f3ea806cf20 0x7f3ea806f350 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.319+0000 7f3eb8ff9700 1 -- 172.21.15.157:0/2904967961 <== osd.5 v2:172.21.15.196:6804/3344395065 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f3ea806f9e0 con 0x7f3ea806cf20 2021-10-08T19:26:24.334 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 --> v2:172.21.15.196:6804/3344395065 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ebc0710a0 con 0x7f3ea806cf20 2021-10-08T19:26:24.335 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3eb8ff9700 1 -- 172.21.15.157:0/2904967961 <== osd.5 v2:172.21.15.196:6804/3344395065 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3ebc0710a0 con 0x7f3ea806cf20 2021-10-08T19:26:24.336 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 >> v2:172.21.15.196:6804/3344395065 conn(0x7f3ea806cf20 msgr2=0x7f3ea806f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:24.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ec1aec700 1 --2- 172.21.15.157:0/2904967961 >> v2:172.21.15.196:6804/3344395065 conn(0x7f3ea806cf20 0x7f3ea806f350 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:24.337 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 >> v2:172.21.15.157:6800/1475557172 conn(0x7f3ea80635b0 msgr2=0x7f3ea8065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:24.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ec1aec700 1 --2- 172.21.15.157:0/2904967961 >> v2:172.21.15.157:6800/1475557172 conn(0x7f3ea80635b0 0x7f3ea8065a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009fd0 tx=0x7f3eac00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:24.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ebc0fe6f0 msgr2=0x7f3ebc10ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:24.338 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ec1aec700 1 --2- 172.21.15.157:0/2904967961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ebc0fe6f0 0x7f3ebc10ef30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009da0 tx=0x7f3ea4009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:24.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ebbfff700 1 -- 172.21.15.157:0/2904967961 reap_dead start 2021-10-08T19:26:24.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 shutdown_connections 2021-10-08T19:26:24.339 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.334+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 >> 172.21.15.157:0/2904967961 conn(0x7f3ebc06f3d0 msgr2=0x7f3ebc070360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:24.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.335+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 shutdown_connections 2021-10-08T19:26:24.340 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:24.335+0000 7f3ec1aec700 1 -- 172.21.15.157:0/2904967961 wait complete. 2021-10-08T19:26:24.929 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:24 smithi157 ceph-mon[32847]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:24.929 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:24 smithi157 ceph-mon[42114]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:24.930 INFO:teuthology.orchestra.run.smithi157.stdout:158913789977 2021-10-08T19:26:24.932 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-10-08T19:26:25.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:24 smithi196 ceph-mon[34258]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:25.206 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:26.801 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.800+0000 7f21fef76700 1 -- 172.21.15.157:0/1326466012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21f80fe720 msgr2=0x7f21f80feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.802 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.800+0000 7f21fef76700 1 --2- 172.21.15.157:0/1326466012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21f80fe720 0x7f21f80feaf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009ab0 tx=0x7f21ec004c50 comp rx=0 tx=0).stop 2021-10-08T19:26:26.802 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.800+0000 7f21fef76700 1 -- 172.21.15.157:0/1326466012 shutdown_connections 2021-10-08T19:26:26.803 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.800+0000 7f21fef76700 1 --2- 172.21.15.157:0/1326466012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f80f8ea0 0x7f21f8105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.803 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.800+0000 7f21fef76700 1 --2- 172.21.15.157:0/1326466012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21f80fe720 0x7f21f80feaf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.803 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.800+0000 7f21fef76700 1 --2- 172.21.15.157:0/1326466012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f80ff0c0 0x7f21f80f8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.803 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.800+0000 7f21fef76700 1 -- 172.21.15.157:0/1326466012 >> 172.21.15.157:0/1326466012 conn(0x7f21f806f3f0 msgr2=0x7f21f80f6820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:26.804 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.801+0000 7f21fef76700 1 -- 172.21.15.157:0/1326466012 shutdown_connections 2021-10-08T19:26:26.804 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.801+0000 7f21fef76700 1 -- 172.21.15.157:0/1326466012 wait complete. 2021-10-08T19:26:26.804 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.801+0000 7f21fef76700 1 Processor -- start 2021-10-08T19:26:26.804 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.801+0000 7f21fef76700 1 -- start start 2021-10-08T19:26:26.807 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.801+0000 7f21fef76700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f80f8ea0 0x7f21f810ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:26.808 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fef76700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f80fe720 0x7f21f810ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:26.808 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fef76700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21f80ff0c0 0x7f21f8108b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:26.808 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fef76700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f81090e0 con 0x7f21f80f8ea0 2021-10-08T19:26:26.809 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fef76700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8109220 con 0x7f21f80fe720 2021-10-08T19:26:26.809 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fef76700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f81093e0 con 0x7f21f80ff0c0 2021-10-08T19:26:26.810 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fcd12700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f80f8ea0 0x7f21f810ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:26.811 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fd513700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21f80ff0c0 0x7f21f8108b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:26.811 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fcd12700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f80f8ea0 0x7f21f810ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41082/0 (socket says 172.21.15.157:41082) 2021-10-08T19:26:26.812 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fcd12700 1 -- 172.21.15.157:0/94362541 learned_addr learned my addr 172.21.15.157:0/94362541 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:26.812 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21f7fff700 1 --2- 172.21.15.157:0/94362541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f80fe720 0x7f21f810ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fd513700 1 -- 172.21.15.157:0/94362541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f80fe720 msgr2=0x7f21f810ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fd513700 1 --2- 172.21.15.157:0/94362541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f80fe720 0x7f21f810ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fd513700 1 -- 172.21.15.157:0/94362541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f80f8ea0 msgr2=0x7f21f810ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.814 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fd513700 1 --2- 172.21.15.157:0/94362541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f80f8ea0 0x7f21f810ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.814 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fd513700 1 -- 172.21.15.157:0/94362541 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0005040 con 0x7f21f80ff0c0 2021-10-08T19:26:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fcd12700 1 --2- 172.21.15.157:0/94362541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f80f8ea0 0x7f21f810ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fd513700 1 --2- 172.21.15.157:0/94362541 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21f80ff0c0 0x7f21f8108b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21f0007fd0 tx=0x7f21f0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:26.816 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21f57fa700 1 -- 172.21.15.157:0/94362541 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f000e050 con 0x7f21f80ff0c0 2021-10-08T19:26:26.816 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21f57fa700 1 -- 172.21.15.157:0/94362541 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f21f000f040 con 0x7f21f80ff0c0 2021-10-08T19:26:26.816 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21f57fa700 1 -- 172.21.15.157:0/94362541 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0014790 con 0x7f21f80ff0c0 2021-10-08T19:26:26.817 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.802+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec009640 con 0x7f21f80ff0c0 2021-10-08T19:26:26.817 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.803+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f806b5f0 con 0x7f21f80ff0c0 2021-10-08T19:26:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.803+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21f80fce40 con 0x7f21f80ff0c0 2021-10-08T19:26:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.804+0000 7f21f57fa700 1 -- 172.21.15.157:0/94362541 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f21f001b030 con 0x7f21f80ff0c0 2021-10-08T19:26:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.804+0000 7f21f57fa700 1 --2- 172.21.15.157:0/94362541 >> v2:172.21.15.157:6800/1475557172 conn(0x7f21e80635b0 0x7f21e8065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:26.819 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.804+0000 7f21fcd12700 1 --2- 172.21.15.157:0/94362541 >> v2:172.21.15.157:6800/1475557172 conn(0x7f21e80635b0 0x7f21e8065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:26.819 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.804+0000 7f21f57fa700 1 -- 172.21.15.157:0/94362541 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f21f007f490 con 0x7f21f80ff0c0 2021-10-08T19:26:26.820 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.804+0000 7f21f57fa700 1 --2- 172.21.15.157:0/94362541 >> v2:172.21.15.196:6808/892194681 conn(0x7f21e806cf20 0x7f21e806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:26.820 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.804+0000 7f21f57fa700 1 -- 172.21.15.157:0/94362541 --> v2:172.21.15.196:6808/892194681 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21e806f9e0 con 0x7f21e806cf20 2021-10-08T19:26:26.821 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.804+0000 7f21f57fa700 1 -- 172.21.15.157:0/94362541 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21f0081ae0 con 0x7f21f80ff0c0 2021-10-08T19:26:26.822 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.804+0000 7f21fcd12700 1 --2- 172.21.15.157:0/94362541 >> v2:172.21.15.157:6800/1475557172 conn(0x7f21e80635b0 0x7f21e8065a60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00b9a0 tx=0x7f21ec01e040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:26.823 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.804+0000 7f21f7fff700 1 --2- 172.21.15.157:0/94362541 >> v2:172.21.15.196:6808/892194681 conn(0x7f21e806cf20 0x7f21e806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:26.823 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.805+0000 7f21f7fff700 1 --2- 172.21.15.157:0/94362541 >> v2:172.21.15.196:6808/892194681 conn(0x7f21e806cf20 0x7f21e806f350 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:26.824 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.805+0000 7f21f57fa700 1 -- 172.21.15.157:0/94362541 <== osd.6 v2:172.21.15.196:6808/892194681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f21e806f9e0 con 0x7f21e806cf20 2021-10-08T19:26:26.825 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.820+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 --> v2:172.21.15.196:6808/892194681 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f21f8047b50 con 0x7f21e806cf20 2021-10-08T19:26:26.825 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.820+0000 7f21f57fa700 1 -- 172.21.15.157:0/94362541 <== osd.6 v2:172.21.15.196:6808/892194681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f21f8047b50 con 0x7f21e806cf20 2021-10-08T19:26:26.827 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 >> v2:172.21.15.196:6808/892194681 conn(0x7f21e806cf20 msgr2=0x7f21e806f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.828 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 --2- 172.21.15.157:0/94362541 >> v2:172.21.15.196:6808/892194681 conn(0x7f21e806cf20 0x7f21e806f350 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.829 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 >> v2:172.21.15.157:6800/1475557172 conn(0x7f21e80635b0 msgr2=0x7f21e8065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.829 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 --2- 172.21.15.157:0/94362541 >> v2:172.21.15.157:6800/1475557172 conn(0x7f21e80635b0 0x7f21e8065a60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00b9a0 tx=0x7f21ec01e040 comp rx=0 tx=0).stop 2021-10-08T19:26:26.829 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21f80ff0c0 msgr2=0x7f21f8108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.830 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 --2- 172.21.15.157:0/94362541 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21f80ff0c0 0x7f21f8108b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21f0007fd0 tx=0x7f21f0009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:26.830 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fd513700 1 -- 172.21.15.157:0/94362541 reap_dead start 2021-10-08T19:26:26.831 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 shutdown_connections 2021-10-08T19:26:26.831 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 >> 172.21.15.157:0/94362541 conn(0x7f21f806f3f0 msgr2=0x7f21f80fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 shutdown_connections 2021-10-08T19:26:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:26.821+0000 7f21fef76700 1 -- 172.21.15.157:0/94362541 wait complete. 2021-10-08T19:26:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:26 smithi157 ceph-mon[32847]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:27.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:26 smithi157 ceph-mon[42114]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:26 smithi196 ceph-mon[34258]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:27.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:26:26 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:26:27.455 INFO:teuthology.orchestra.run.smithi157.stdout:188978561046 2021-10-08T19:26:27.455 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-10-08T19:26:27.768 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:27 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:27.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:27 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:28.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:27 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:28 smithi157 ceph-mon[32847]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:26:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:28 smithi157 ceph-mon[42114]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:26:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:28 smithi196 ceph-mon[34258]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:26:29.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 -- 172.21.15.157:0/3064557707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4d00f76f0 msgr2=0x7fd4d01053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 --2- 172.21.15.157:0/3064557707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4d00f76f0 0x7fd4d01053c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8009a60 tx=0x7fd4c8004d10 comp rx=0 tx=0).stop 2021-10-08T19:26:29.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 -- 172.21.15.157:0/3064557707 shutdown_connections 2021-10-08T19:26:29.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 --2- 172.21.15.157:0/3064557707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4d00f76f0 0x7fd4d01053c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 --2- 172.21.15.157:0/3064557707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4d00fe660 0x7fd4d00fea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 --2- 172.21.15.157:0/3064557707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4d00f6d40 0x7fd4d00f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 -- 172.21.15.157:0/3064557707 >> 172.21.15.157:0/3064557707 conn(0x7fd4d006cd30 msgr2=0x7fd4d006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:29.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 -- 172.21.15.157:0/3064557707 shutdown_connections 2021-10-08T19:26:29.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 -- 172.21.15.157:0/3064557707 wait complete. 2021-10-08T19:26:29.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 Processor -- start 2021-10-08T19:26:29.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.306+0000 7fd4d5767700 1 -- start start 2021-10-08T19:26:29.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d5767700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4d00f6d40 0x7fd4d00f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:29.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d5767700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4d00f76f0 0x7fd4d00f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:29.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d5767700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4d00fe660 0x7fd4d0116b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:29.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d5767700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d00f8de0 con 0x7fd4d00fe660 2021-10-08T19:26:29.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d5767700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d01170a0 con 0x7fd4d00f6d40 2021-10-08T19:26:29.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d5767700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d0117260 con 0x7fd4d00f76f0 2021-10-08T19:26:29.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d4f66700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4d00fe660 0x7fd4d0116b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:29.315 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4cf7fe700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4d00f76f0 0x7fd4d00f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:29.315 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d4f66700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4d00fe660 0x7fd4d0116b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41100/0 (socket says 172.21.15.157:41100) 2021-10-08T19:26:29.315 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d4f66700 1 -- 172.21.15.157:0/945422739 learned_addr learned my addr 172.21.15.157:0/945422739 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:29.316 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4cffff700 1 --2- 172.21.15.157:0/945422739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4d00f6d40 0x7fd4d00f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:29.316 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d4f66700 1 -- 172.21.15.157:0/945422739 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4d00f76f0 msgr2=0x7fd4d00f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.316 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d4f66700 1 --2- 172.21.15.157:0/945422739 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4d00f76f0 0x7fd4d00f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.317 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d4f66700 1 -- 172.21.15.157:0/945422739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4d00f6d40 msgr2=0x7fd4d00f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.317 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d4f66700 1 --2- 172.21.15.157:0/945422739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4d00f6d40 0x7fd4d00f7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.317 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d4f66700 1 -- 172.21.15.157:0/945422739 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c4005040 con 0x7fd4d00fe660 2021-10-08T19:26:29.317 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d4f66700 1 --2- 172.21.15.157:0/945422739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4d00fe660 0x7fd4d0116b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8005010 tx=0x7fd4c8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:29.318 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4ccff9700 1 -- 172.21.15.157:0/945422739 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c800e030 con 0x7fd4d00fe660 2021-10-08T19:26:29.318 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4ccff9700 1 -- 172.21.15.157:0/945422739 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fd4c8009450 con 0x7fd4d00fe660 2021-10-08T19:26:29.318 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4ccff9700 1 -- 172.21.15.157:0/945422739 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c801cea0 con 0x7fd4d00fe660 2021-10-08T19:26:29.318 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c8009640 con 0x7fd4d00fe660 2021-10-08T19:26:29.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.307+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d0117760 con 0x7fd4d00fe660 2021-10-08T19:26:29.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.308+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4d00fdc40 con 0x7fd4d00fe660 2021-10-08T19:26:29.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.309+0000 7fd4ccff9700 1 -- 172.21.15.157:0/945422739 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fd4c802c070 con 0x7fd4d00fe660 2021-10-08T19:26:29.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.309+0000 7fd4ccff9700 1 --2- 172.21.15.157:0/945422739 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4b80635a0 0x7fd4b8065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:29.319 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.309+0000 7fd4ccff9700 1 -- 172.21.15.157:0/945422739 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fd4c8081f30 con 0x7fd4d00fe660 2021-10-08T19:26:29.320 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.309+0000 7fd4cffff700 1 --2- 172.21.15.157:0/945422739 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4b80635a0 0x7fd4b8065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:29.320 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.309+0000 7fd4ccff9700 1 --2- 172.21.15.157:0/945422739 >> v2:172.21.15.196:6812/1866932410 conn(0x7fd4b806cf90 0x7fd4b806f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:29.320 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.310+0000 7fd4ccff9700 1 -- 172.21.15.157:0/945422739 --> v2:172.21.15.196:6812/1866932410 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4b806fa50 con 0x7fd4b806cf90 2021-10-08T19:26:29.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.310+0000 7fd4ccff9700 1 -- 172.21.15.157:0/945422739 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4c8082310 con 0x7fd4d00fe660 2021-10-08T19:26:29.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.310+0000 7fd4cf7fe700 1 --2- 172.21.15.157:0/945422739 >> v2:172.21.15.196:6812/1866932410 conn(0x7fd4b806cf90 0x7fd4b806f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:29.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.310+0000 7fd4cffff700 1 --2- 172.21.15.157:0/945422739 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4b80635a0 0x7fd4b8065a50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0006fd0 tx=0x7fd4c0008040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:29.321 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.310+0000 7fd4cf7fe700 1 --2- 172.21.15.157:0/945422739 >> v2:172.21.15.196:6812/1866932410 conn(0x7fd4b806cf90 0x7fd4b806f3c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:29.322 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.311+0000 7fd4ccff9700 1 -- 172.21.15.157:0/945422739 <== osd.7 v2:172.21.15.196:6812/1866932410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7fd4b806fa50 con 0x7fd4b806cf90 2021-10-08T19:26:29.325 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.325+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 --> v2:172.21.15.196:6812/1866932410 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4d006e850 con 0x7fd4b806cf90 2021-10-08T19:26:29.326 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4ccff9700 1 -- 172.21.15.157:0/945422739 <== osd.7 v2:172.21.15.196:6812/1866932410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd4d006e850 con 0x7fd4b806cf90 2021-10-08T19:26:29.329 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 >> v2:172.21.15.196:6812/1866932410 conn(0x7fd4b806cf90 msgr2=0x7fd4b806f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.329 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 --2- 172.21.15.157:0/945422739 >> v2:172.21.15.196:6812/1866932410 conn(0x7fd4b806cf90 0x7fd4b806f3c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.329 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4b80635a0 msgr2=0x7fd4b8065a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 --2- 172.21.15.157:0/945422739 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4b80635a0 0x7fd4b8065a50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0006fd0 tx=0x7fd4c0008040 comp rx=0 tx=0).stop 2021-10-08T19:26:29.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4d00fe660 msgr2=0x7fd4d0116b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 --2- 172.21.15.157:0/945422739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4d00fe660 0x7fd4d0116b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8005010 tx=0x7fd4c8004d10 comp rx=0 tx=0).stop 2021-10-08T19:26:29.330 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d4f66700 1 -- 172.21.15.157:0/945422739 reap_dead start 2021-10-08T19:26:29.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 shutdown_connections 2021-10-08T19:26:29.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 >> 172.21.15.157:0/945422739 conn(0x7fd4d006cd30 msgr2=0x7fd4d00fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:29.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 shutdown_connections 2021-10-08T19:26:29.331 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:29.326+0000 7fd4d5767700 1 -- 172.21.15.157:0/945422739 wait complete. 2021-10-08T19:26:29.895 INFO:teuthology.orchestra.run.smithi157.stdout:219043332115 2021-10-08T19:26:29.897 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-10-08T19:26:30.168 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:30 smithi157 ceph-mon[32847]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:31.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:30 smithi157 ceph-mon[42114]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:31.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:30 smithi196 ceph-mon[34258]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:31.865 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.862+0000 7fd4f3b72700 1 -- 172.21.15.157:0/3230030803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0fd600 msgr2=0x7fd4ec0fd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:31.865 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.862+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/3230030803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0fd600 0x7fd4ec0fd9d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8004710 tx=0x7fd4e8009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:31.866 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.862+0000 7fd4f3b72700 1 -- 172.21.15.157:0/3230030803 shutdown_connections 2021-10-08T19:26:31.866 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.862+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/3230030803 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4ec0f7d80 0x7fd4ec104420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:31.866 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.862+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/3230030803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0fd600 0x7fd4ec0fd9d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:31.866 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.862+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/3230030803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4ec0fdfa0 0x7fd4ec0f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:31.866 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.862+0000 7fd4f3b72700 1 -- 172.21.15.157:0/3230030803 >> 172.21.15.157:0/3230030803 conn(0x7fd4ec06e2d0 msgr2=0x7fd4ec0f5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:31.867 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.862+0000 7fd4f3b72700 1 -- 172.21.15.157:0/3230030803 shutdown_connections 2021-10-08T19:26:31.867 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.862+0000 7fd4f3b72700 1 -- 172.21.15.157:0/3230030803 wait complete. 2021-10-08T19:26:31.867 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f3b72700 1 Processor -- start 2021-10-08T19:26:31.867 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f3b72700 1 -- start start 2021-10-08T19:26:31.868 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f3b72700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0f7d80 0x7fd4ec10e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:31.868 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f3b72700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4ec0fd600 0x7fd4ec10ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:31.868 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f3b72700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4ec0fdfa0 0x7fd4ec108a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:31.868 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f3b72700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec109060 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.869 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f3b72700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec1091d0 con 0x7fd4ec0fd600 2021-10-08T19:26:31.869 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f3b72700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec109390 con 0x7fd4ec0fdfa0 2021-10-08T19:26:31.869 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f190e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0f7d80 0x7fd4ec10e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:31.869 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f190e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0f7d80 0x7fd4ec10e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41112/0 (socket says 172.21.15.157:41112) 2021-10-08T19:26:31.870 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f190e700 1 -- 172.21.15.157:0/1739635667 learned_addr learned my addr 172.21.15.157:0/1739635667 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:31.870 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.863+0000 7fd4f210f700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4ec0fdfa0 0x7fd4ec108a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:31.870 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f110d700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4ec0fd600 0x7fd4ec10ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:31.870 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f190e700 1 -- 172.21.15.157:0/1739635667 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4ec0fdfa0 msgr2=0x7fd4ec108a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:31.871 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f190e700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4ec0fdfa0 0x7fd4ec108a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:31.871 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f190e700 1 -- 172.21.15.157:0/1739635667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4ec0fd600 msgr2=0x7fd4ec10ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:31.871 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f190e700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4ec0fd600 0x7fd4ec10ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:31.871 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f190e700 1 -- 172.21.15.157:0/1739635667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4009640 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.872 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f210f700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4ec0fdfa0 0x7fd4ec108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:31.872 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f190e700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0f7d80 0x7fd4ec10e9c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8014470 tx=0x7fd4e8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:31.872 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4e27fc700 1 -- 172.21.15.157:0/1739635667 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e801a070 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.872 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4e27fc700 1 -- 172.21.15.157:0/1739635667 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fd4e8009630 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.872 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e8005040 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.873 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4e27fc700 1 -- 172.21.15.157:0/1739635667 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e801faf0 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.873 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.864+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec1157c0 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.874 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.865+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec047b50 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.874 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.865+0000 7fd4e27fc700 1 -- 172.21.15.157:0/1739635667 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fd4e8025020 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.875 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.866+0000 7fd4e27fc700 1 --2- 172.21.15.157:0/1739635667 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4d80635b0 0x7fd4d8065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:31.875 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.866+0000 7fd4e27fc700 1 -- 172.21.15.157:0/1739635667 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fd4e80809d0 con 0x7fd4ec0f7d80 2021-10-08T19:26:31.875 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.866+0000 7fd4f110d700 1 --2- 172.21.15.157:0/1739635667 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4d80635b0 0x7fd4d8065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:31.875 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.866+0000 7fd4f110d700 1 --2- 172.21.15.157:0/1739635667 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4d80635b0 0x7fd4d8065a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec10a1f0 tx=0x7fd4dc00b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:31.876 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:31.870+0000 7fd4e27fc700 1 -- 172.21.15.157:0/1739635667 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fd4e80535f0 con 0x7fd4ec0f7d80 2021-10-08T19:26:32.038 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.037+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd4ec107c90 con 0x7fd4ec0f7d80 2021-10-08T19:26:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.037+0000 7fd4e27fc700 1 -- 172.21.15.157:0/1739635667 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4e80531e0 con 0x7fd4ec0f7d80 2021-10-08T19:26:32.040 INFO:teuthology.orchestra.run.smithi157.stdout:34359738414 2021-10-08T19:26:32.041 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4d80635b0 msgr2=0x7fd4d8065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:32.041 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/1739635667 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4d80635b0 0x7fd4d8065a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec10a1f0 tx=0x7fd4dc00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:32.041 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0f7d80 msgr2=0x7fd4ec10e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:32.042 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0f7d80 0x7fd4ec10e9c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8014470 tx=0x7fd4e8009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:32.042 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 shutdown_connections 2021-10-08T19:26:32.042 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/1739635667 >> v2:172.21.15.157:6800/1475557172 conn(0x7fd4d80635b0 0x7fd4d8065a60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd4ec0fdfa0 0x7fd4ec108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4ec0f7d80 0x7fd4ec10e9c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 --2- 172.21.15.157:0/1739635667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4ec0fd600 0x7fd4ec10ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 >> 172.21.15.157:0/1739635667 conn(0x7fd4ec06e2d0 msgr2=0x7fd4ec06f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:32.044 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 shutdown_connections 2021-10-08T19:26:32.044 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:32.039+0000 7fd4f3b72700 1 -- 172.21.15.157:0/1739635667 wait complete. 2021-10-08T19:26:32.876 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738411 got 34359738414 for osd.0 2021-10-08T19:26:32.877 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-10-08T19:26:33.063 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:32 smithi157 ceph-mon[32847]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:33.063 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1739635667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:26:33.063 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:32 smithi157 ceph-mon[42114]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:33.064 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1739635667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:26:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:32 smithi196 ceph-mon[34258]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1739635667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:26:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:34.991 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:34 smithi157 ceph-mon[32847]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:34.991 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:34 smithi157 ceph-mon[42114]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:34 smithi196 ceph-mon[34258]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:35.196 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.192+0000 7f152437b700 1 -- 172.21.15.157:0/2540713851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f151c0fd5d0 msgr2=0x7f151c0fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.197 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.192+0000 7f152437b700 1 --2- 172.21.15.157:0/2540713851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f151c0fd5d0 0x7f151c0fd9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f150c004710 tx=0x7f150c009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:35.197 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 -- 172.21.15.157:0/2540713851 shutdown_connections 2021-10-08T19:26:35.197 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 --2- 172.21.15.157:0/2540713851 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f151c0f7d60 0x7f151c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.198 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 --2- 172.21.15.157:0/2540713851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f151c0fd5d0 0x7f151c0fd9a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.198 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 --2- 172.21.15.157:0/2540713851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c0fdf70 0x7f151c0f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.198 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 -- 172.21.15.157:0/2540713851 >> 172.21.15.157:0/2540713851 conn(0x7f151c06f330 msgr2=0x7f151c06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:35.198 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 -- 172.21.15.157:0/2540713851 shutdown_connections 2021-10-08T19:26:35.198 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 -- 172.21.15.157:0/2540713851 wait complete. 2021-10-08T19:26:35.199 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 Processor -- start 2021-10-08T19:26:35.199 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 -- start start 2021-10-08T19:26:35.199 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f151c0f7d60 0x7f151c109b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:35.199 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c0fd5d0 0x7f151c10a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:35.200 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f151c0fdf70 0x7f151c114be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:35.200 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c10a880 con 0x7f151c0fdf70 2021-10-08T19:26:35.200 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c10a9f0 con 0x7f151c0fd5d0 2021-10-08T19:26:35.200 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.193+0000 7f152437b700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c115170 con 0x7f151c0f7d60 2021-10-08T19:26:35.200 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522117700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f151c0f7d60 0x7f151c109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:35.201 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522918700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f151c0fdf70 0x7f151c114be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:35.201 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522117700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f151c0f7d60 0x7f151c109b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50372/0 (socket says 172.21.15.157:50372) 2021-10-08T19:26:35.201 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522117700 1 -- 172.21.15.157:0/3604723318 learned_addr learned my addr 172.21.15.157:0/3604723318 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:35.201 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1521916700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c0fd5d0 0x7f151c10a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:35.202 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522117700 1 -- 172.21.15.157:0/3604723318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c0fd5d0 msgr2=0x7f151c10a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.202 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522117700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c0fd5d0 0x7f151c10a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.202 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522117700 1 -- 172.21.15.157:0/3604723318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f151c0fdf70 msgr2=0x7f151c114be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.202 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522117700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f151c0fdf70 0x7f151c114be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.202 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522117700 1 -- 172.21.15.157:0/3604723318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514009640 con 0x7f151c0f7d60 2021-10-08T19:26:35.203 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522918700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f151c0fdf70 0x7f151c114be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:35.203 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1521916700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c0fd5d0 0x7f151c10a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:26:35.203 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1522117700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f151c0f7d60 0x7f151c109b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f150c0043d0 tx=0x7f150c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:35.203 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1512ffd700 1 -- 172.21.15.157:0/3604723318 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c01a070 con 0x7f151c0f7d60 2021-10-08T19:26:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1512ffd700 1 -- 172.21.15.157:0/3604723318 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f150c009630 con 0x7f151c0f7d60 2021-10-08T19:26:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c005040 con 0x7f151c0f7d60 2021-10-08T19:26:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f1512ffd700 1 -- 172.21.15.157:0/3604723318 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c01fb60 con 0x7f151c0f7d60 2021-10-08T19:26:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.194+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c115770 con 0x7f151c0f7d60 2021-10-08T19:26:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.195+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c047b50 con 0x7f151c0f7d60 2021-10-08T19:26:35.206 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.196+0000 7f1512ffd700 1 -- 172.21.15.157:0/3604723318 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f150c01f420 con 0x7f151c0f7d60 2021-10-08T19:26:35.206 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.196+0000 7f1512ffd700 1 --2- 172.21.15.157:0/3604723318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f15080635b0 0x7f1508065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:35.206 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.196+0000 7f1512ffd700 1 -- 172.21.15.157:0/3604723318 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f150c080ec0 con 0x7f151c0f7d60 2021-10-08T19:26:35.206 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.196+0000 7f1521916700 1 --2- 172.21.15.157:0/3604723318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f15080635b0 0x7f1508065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:35.207 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.196+0000 7f1521916700 1 --2- 172.21.15.157:0/3604723318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f15080635b0 0x7f1508065a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1518009fd0 tx=0x7f151800b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:35.207 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.200+0000 7f1512ffd700 1 -- 172.21.15.157:0/3604723318 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f150c053ae0 con 0x7f151c0f7d60 2021-10-08T19:26:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.374+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f151c062000 con 0x7f151c0f7d60 2021-10-08T19:26:35.376 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.374+0000 7f1512ffd700 1 -- 172.21.15.157:0/3604723318 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f150c0536d0 con 0x7f151c0f7d60 2021-10-08T19:26:35.376 INFO:teuthology.orchestra.run.smithi157.stdout:55834574890 2021-10-08T19:26:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f15080635b0 msgr2=0x7f1508065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 --2- 172.21.15.157:0/3604723318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f15080635b0 0x7f1508065a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1518009fd0 tx=0x7f151800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f151c0f7d60 msgr2=0x7f151c109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f151c0f7d60 0x7f151c109b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f150c0043d0 tx=0x7f150c009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 shutdown_connections 2021-10-08T19:26:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f151c0fdf70 0x7f151c114be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 --2- 172.21.15.157:0/3604723318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f15080635b0 0x7f1508065a60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f151c0f7d60 0x7f151c109b60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 --2- 172.21.15.157:0/3604723318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c0fd5d0 0x7f151c10a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 >> 172.21.15.157:0/3604723318 conn(0x7f151c06f330 msgr2=0x7f151c0f6760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 shutdown_connections 2021-10-08T19:26:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:35.376+0000 7f152437b700 1 -- 172.21.15.157:0/3604723318 wait complete. 2021-10-08T19:26:35.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3604723318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:26:35.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3604723318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:26:36.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3604723318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:26:36.177 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574886 got 55834574890 for osd.1 2021-10-08T19:26:36.178 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-10-08T19:26:36.484 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:37.034 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:37.034 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-10-08T19:26:37.035 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.035 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-10-08T19:26:37.035 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-10-08T19:26:37.035 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.036 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.036 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-10-08T19:26:37.036 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.036 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:37.036 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:37.037 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:37.037 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:37.037 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:37.038 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-10-08T19:26:37.038 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.039 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-10-08T19:26:37.039 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-10-08T19:26:37.039 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.039 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.039 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-10-08T19:26:37.040 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.040 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:37.040 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:37.040 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:37.041 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:37.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:26:36 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:26:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-10-08T19:26:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-10-08T19:26:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-10-08T19:26:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-10-08T19:26:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:26:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:37.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:37.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:37.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:37.909 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2021-10-08T19:26:37.910 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2021-10-08T19:26:37.910 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]': finished 2021-10-08T19:26:37.910 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2021-10-08T19:26:37.911 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[32847]: osdmap e67: 8 total, 8 up, 8 in 2021-10-08T19:26:37.911 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:37.911 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2021-10-08T19:26:37.912 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2021-10-08T19:26:37.912 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]': finished 2021-10-08T19:26:37.912 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2021-10-08T19:26:37.912 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[42114]: osdmap e67: 8 total, 8 up, 8 in 2021-10-08T19:26:37.913 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:37 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:38.118 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.113+0000 7fdfbbfff700 1 -- 172.21.15.157:0/1690577549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0f7380 msgr2=0x7fdfbc103a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.118 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.113+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/1690577549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0f7380 0x7fdfbc103a20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009a60 tx=0x7fdfb4004d10 comp rx=0 tx=0).stop 2021-10-08T19:26:38.119 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.113+0000 7fdfbbfff700 1 -- 172.21.15.157:0/1690577549 shutdown_connections 2021-10-08T19:26:38.119 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.113+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/1690577549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0f7380 0x7fdfbc103a20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.119 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.113+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/1690577549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfbc0fcbb0 0x7fdfbc0fcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.119 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.113+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/1690577549 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfbc0fd550 0x7fdfbc0f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.120 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.113+0000 7fdfbbfff700 1 -- 172.21.15.157:0/1690577549 >> 172.21.15.157:0/1690577549 conn(0x7fdfbc06d810 msgr2=0x7fdfbc0f4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:38.120 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.113+0000 7fdfbbfff700 1 -- 172.21.15.157:0/1690577549 shutdown_connections 2021-10-08T19:26:38.120 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.113+0000 7fdfbbfff700 1 -- 172.21.15.157:0/1690577549 wait complete. 2021-10-08T19:26:38.120 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbbfff700 1 Processor -- start 2021-10-08T19:26:38.121 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbbfff700 1 -- start start 2021-10-08T19:26:38.121 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfbc0f7380 0x7fdfbc10e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:38.121 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbbfff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0fcbb0 0x7fdfbc10ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:38.121 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbbfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfbc0fd550 0x7fdfbc108740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:38.121 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbbfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc108da0 con 0x7fdfbc0f7380 2021-10-08T19:26:38.122 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbbfff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc108f10 con 0x7fdfbc0fd550 2021-10-08T19:26:38.122 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbbfff700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc1090d0 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.122 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbaffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfbc0f7380 0x7fdfbc10e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:38.122 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfb27fc700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0fcbb0 0x7fdfbc10ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:38.123 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfb27fc700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0fcbb0 0x7fdfbc10ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50386/0 (socket says 172.21.15.157:50386) 2021-10-08T19:26:38.123 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbaffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfbc0f7380 0x7fdfbc10e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41136/0 (socket says 172.21.15.157:41136) 2021-10-08T19:26:38.123 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfb27fc700 1 -- 172.21.15.157:0/2046605223 learned_addr learned my addr 172.21.15.157:0/2046605223 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:38.123 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbb7fe700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfbc0fd550 0x7fdfbc108740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:38.123 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfb27fc700 1 -- 172.21.15.157:0/2046605223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfbc0fd550 msgr2=0x7fdfbc108740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.124 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfb27fc700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfbc0fd550 0x7fdfbc108740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.125 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfb27fc700 1 -- 172.21.15.157:0/2046605223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfbc0f7380 msgr2=0x7fdfbc10e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.126 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfb27fc700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfbc0f7380 0x7fdfbc10e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.126 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfb27fc700 1 -- 172.21.15.157:0/2046605223 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac005040 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.126 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbaffd700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfbc0f7380 0x7fdfbc10e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:38.127 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.114+0000 7fdfbb7fe700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfbc0fd550 0x7fdfbc108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:26:38.127 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.115+0000 7fdfb27fc700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0fcbb0 0x7fdfbc10ed20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009470 tx=0x7fdfa4006ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:38.128 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.115+0000 7fdfb3fff700 1 -- 172.21.15.157:0/2046605223 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4009e70 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.128 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.115+0000 7fdfb3fff700 1 -- 172.21.15.157:0/2046605223 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fdfa400e8f0 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.129 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.115+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb4009640 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.129 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.115+0000 7fdfb3fff700 1 -- 172.21.15.157:0/2046605223 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4010840 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.130 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.115+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc0f87f0 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.130 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.116+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc0f6430 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.130 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.116+0000 7fdfb3fff700 1 -- 172.21.15.157:0/2046605223 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fdfa4019030 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.130 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.116+0000 7fdfb3fff700 1 --2- 172.21.15.157:0/2046605223 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdfa80635a0 0x7fdfa8065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:38.130 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.116+0000 7fdfb3fff700 1 -- 172.21.15.157:0/2046605223 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6281+0+0 (secure 0 0 0) 0x7fdfa407f3a0 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.131 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.116+0000 7fdfbaffd700 1 --2- 172.21.15.157:0/2046605223 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdfa80635a0 0x7fdfa8065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:38.132 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:37 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2021-10-08T19:26:38.132 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:37 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2021-10-08T19:26:38.132 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:37 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]': finished 2021-10-08T19:26:38.132 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:37 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2021-10-08T19:26:38.133 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:37 smithi196 ceph-mon[34258]: osdmap e67: 8 total, 8 up, 8 in 2021-10-08T19:26:38.133 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:37 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:38.133 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.117+0000 7fdfbaffd700 1 --2- 172.21.15.157:0/2046605223 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdfa80635a0 0x7fdfa8065a50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdfac007fd0 tx=0x7fdfac00b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:38.134 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.120+0000 7fdfb3fff700 1 -- 172.21.15.157:0/2046605223 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fdfa4051e60 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.289 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.287+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdfbc109e60 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.288+0000 7fdfb3fff700 1 -- 172.21.15.157:0/2046605223 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfa4017070 con 0x7fdfbc0fcbb0 2021-10-08T19:26:38.290 INFO:teuthology.orchestra.run.smithi157.stdout:77309411366 2021-10-08T19:26:38.291 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdfa80635a0 msgr2=0x7fdfa8065a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.291 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/2046605223 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdfa80635a0 0x7fdfa8065a50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdfac007fd0 tx=0x7fdfac00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:38.292 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0fcbb0 msgr2=0x7fdfbc10ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.292 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0fcbb0 0x7fdfbc10ed20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009470 tx=0x7fdfa4006ec0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.292 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 shutdown_connections 2021-10-08T19:26:38.292 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfbc0fd550 0x7fdfbc108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.292 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfbc0f7380 0x7fdfbc10e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/2046605223 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdfa80635a0 0x7fdfa8065a50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 --2- 172.21.15.157:0/2046605223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfbc0fcbb0 0x7fdfbc10ed20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 >> 172.21.15.157:0/2046605223 conn(0x7fdfbc06d810 msgr2=0x7fdfbc0fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 shutdown_connections 2021-10-08T19:26:38.294 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:38.290+0000 7fdfbbfff700 1 -- 172.21.15.157:0/2046605223 wait complete. 2021-10-08T19:26:38.302 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:26:38 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:26:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:38.960 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:38 smithi157 ceph-mon[32847]: osdmap e68: 8 total, 8 up, 8 in 2021-10-08T19:26:38.961 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:38 smithi157 ceph-mon[32847]: pgmap v36: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:38.961 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2046605223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:26:38.961 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:38 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:38.962 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:38 smithi157 ceph-mon[42114]: osdmap e68: 8 total, 8 up, 8 in 2021-10-08T19:26:38.962 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:38 smithi157 ceph-mon[42114]: pgmap v36: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:38.962 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2046605223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:26:38.962 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:38 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:38.963 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411363 got 77309411366 for osd.2 2021-10-08T19:26:38.964 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-10-08T19:26:39.007 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:38 smithi196 ceph-mon[34258]: osdmap e68: 8 total, 8 up, 8 in 2021-10-08T19:26:39.007 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:38 smithi196 ceph-mon[34258]: pgmap v36: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:39.007 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2046605223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:26:39.008 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:38 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:39.240 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:39.801 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:39 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:26:39.801 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:39 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:26:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:39.801 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:39 smithi157 ceph-mon[32847]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2021-10-08T19:26:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:39 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:26:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:39 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:26:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:39 smithi157 ceph-mon[42114]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2021-10-08T19:26:40.008 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:39 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:26:40.008 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:39 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:26:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:40.009 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:39 smithi196 ceph-mon[34258]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2021-10-08T19:26:40.367 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 systemd[1]: Starting Ceph grafana.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:26:40.924 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.921+0000 7f6347904700 1 -- 172.21.15.157:0/1882314438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 msgr2=0x7f63400f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:40.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.921+0000 7f6347904700 1 --2- 172.21.15.157:0/1882314438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 0x7f63400f7650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6330004710 tx=0x7f6330009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:40.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.921+0000 7f6347904700 1 -- 172.21.15.157:0/1882314438 shutdown_connections 2021-10-08T19:26:40.925 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.921+0000 7f6347904700 1 --2- 172.21.15.157:0/1882314438 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63400f7d80 0x7f6340104420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:40.926 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.921+0000 7f6347904700 1 --2- 172.21.15.157:0/1882314438 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63400fd600 0x7f63400fd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:40.926 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.921+0000 7f6347904700 1 --2- 172.21.15.157:0/1882314438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 0x7f63400f7650 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:40.926 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.921+0000 7f6347904700 1 -- 172.21.15.157:0/1882314438 >> 172.21.15.157:0/1882314438 conn(0x7f634006e2d0 msgr2=0x7f63400f5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:40.927 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.921+0000 7f6347904700 1 -- 172.21.15.157:0/1882314438 shutdown_connections 2021-10-08T19:26:40.927 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.921+0000 7f6347904700 1 -- 172.21.15.157:0/1882314438 wait complete. 2021-10-08T19:26:40.927 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6347904700 1 Processor -- start 2021-10-08T19:26:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6347904700 1 -- start start 2021-10-08T19:26:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6347904700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63400f7d80 0x7f63401078f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6347904700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63400fd600 0x7f6340107e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6347904700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 0x7f6340108370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6347904700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6340117000 con 0x7f63400fdfa0 2021-10-08T19:26:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6347904700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6340117170 con 0x7f63400fd600 2021-10-08T19:26:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6347904700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6340117330 con 0x7f63400f7d80 2021-10-08T19:26:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f63456a0700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63400f7d80 0x7f63401078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6345ea1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 0x7f6340108370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6345ea1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 0x7f6340108370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41154/0 (socket says 172.21.15.157:41154) 2021-10-08T19:26:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f63456a0700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63400f7d80 0x7f63401078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50398/0 (socket says 172.21.15.157:50398) 2021-10-08T19:26:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6345ea1700 1 -- 172.21.15.157:0/2283361525 learned_addr learned my addr 172.21.15.157:0/2283361525 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6344e9f700 1 --2- 172.21.15.157:0/2283361525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63400fd600 0x7f6340107e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:40.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f63456a0700 1 -- 172.21.15.157:0/2283361525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63400fd600 msgr2=0x7f6340107e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:40.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f63456a0700 1 --2- 172.21.15.157:0/2283361525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63400fd600 0x7f6340107e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:40.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f63456a0700 1 -- 172.21.15.157:0/2283361525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 msgr2=0x7f6340108370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:40.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f63456a0700 1 --2- 172.21.15.157:0/2283361525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 0x7f6340108370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:40.931 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f63456a0700 1 -- 172.21.15.157:0/2283361525 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6338005040 con 0x7f63400f7d80 2021-10-08T19:26:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f6345ea1700 1 --2- 172.21.15.157:0/2283361525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 0x7f6340108370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.922+0000 7f63456a0700 1 --2- 172.21.15.157:0/2283361525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63400f7d80 0x7f63401078f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f633c00ebc0 tx=0x7f633c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.923+0000 7f6335ffb700 1 -- 172.21.15.157:0/2283361525 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c009710 con 0x7f63400f7d80 2021-10-08T19:26:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.923+0000 7f6335ffb700 1 -- 172.21.15.157:0/2283361525 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f633c00f040 con 0x7f63400f7d80 2021-10-08T19:26:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.923+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6330005040 con 0x7f63400f7d80 2021-10-08T19:26:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.923+0000 7f6335ffb700 1 -- 172.21.15.157:0/2283361525 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00c800 con 0x7f63400f7d80 2021-10-08T19:26:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.923+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63401179c0 con 0x7f63400f7d80 2021-10-08T19:26:40.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.924+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6340047b50 con 0x7f63400f7d80 2021-10-08T19:26:40.934 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.924+0000 7f6335ffb700 1 -- 172.21.15.157:0/2283361525 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f633c0092e0 con 0x7f63400f7d80 2021-10-08T19:26:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.924+0000 7f6335ffb700 1 --2- 172.21.15.157:0/2283361525 >> v2:172.21.15.157:6800/1475557172 conn(0x7f632c0635b0 0x7f632c065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.924+0000 7f6335ffb700 1 -- 172.21.15.157:0/2283361525 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6281+0+0 (secure 0 0 0) 0x7f633c0800f0 con 0x7f63400f7d80 2021-10-08T19:26:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.924+0000 7f6344e9f700 1 --2- 172.21.15.157:0/2283361525 >> v2:172.21.15.157:6800/1475557172 conn(0x7f632c0635b0 0x7f632c065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.925+0000 7f6344e9f700 1 --2- 172.21.15.157:0/2283361525 >> v2:172.21.15.157:6800/1475557172 conn(0x7f632c0635b0 0x7f632c065a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6330009da0 tx=0x7f6330009b30 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:40.928+0000 7f6335ffb700 1 -- 172.21.15.157:0/2283361525 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f633c052ca0 con 0x7f63400f7d80 2021-10-08T19:26:40.944 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:40 smithi196 ceph-mon[34258]: pgmap v37: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:41.068 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:40 smithi157 ceph-mon[32847]: pgmap v37: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:41.068 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:40 smithi157 ceph-mon[42114]: pgmap v37: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:41.101 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.099+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6340062110 con 0x7f63400f7d80 2021-10-08T19:26:41.101 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.099+0000 7f6335ffb700 1 -- 172.21.15.157:0/2283361525 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f633c052890 con 0x7f63400f7d80 2021-10-08T19:26:41.101 INFO:teuthology.orchestra.run.smithi157.stdout:107374182437 2021-10-08T19:26:41.103 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.101+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 >> v2:172.21.15.157:6800/1475557172 conn(0x7f632c0635b0 msgr2=0x7f632c065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:41.103 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.101+0000 7f6347904700 1 --2- 172.21.15.157:0/2283361525 >> v2:172.21.15.157:6800/1475557172 conn(0x7f632c0635b0 0x7f632c065a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6330009da0 tx=0x7f6330009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:41.104 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.101+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63400f7d80 msgr2=0x7f63401078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:41.104 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.101+0000 7f6347904700 1 --2- 172.21.15.157:0/2283361525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63400f7d80 0x7f63401078f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f633c00ebc0 tx=0x7f633c00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:41.104 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.101+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 shutdown_connections 2021-10-08T19:26:41.104 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.102+0000 7f6347904700 1 --2- 172.21.15.157:0/2283361525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63400fdfa0 0x7f6340108370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.105 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.102+0000 7f6347904700 1 --2- 172.21.15.157:0/2283361525 >> v2:172.21.15.157:6800/1475557172 conn(0x7f632c0635b0 0x7f632c065a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.105 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.102+0000 7f6347904700 1 --2- 172.21.15.157:0/2283361525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63400f7d80 0x7f63401078f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.105 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.102+0000 7f6347904700 1 --2- 172.21.15.157:0/2283361525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63400fd600 0x7f6340107e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.105 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.102+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 >> 172.21.15.157:0/2283361525 conn(0x7f634006e2d0 msgr2=0x7f634006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:41.105 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.102+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 shutdown_connections 2021-10-08T19:26:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:41.102+0000 7f6347904700 1 -- 172.21.15.157:0/2283361525 wait complete. 2021-10-08T19:26:41.230 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Starting Grafana" logger=server version=6.7.4 commit=8e44bbc5f5 branch=HEAD compiled=2020-05-26T17:35:38+0000 2021-10-08T19:26:41.230 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-10-08T19:26:41.231 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-10-08T19:26:41.231 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-10-08T19:26:41.231 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-10-08T19:26:41.231 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-10-08T19:26:41.232 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-10-08T19:26:41.233 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-10-08T19:26:41.233 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-10-08T19:26:41.233 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-10-08T19:26:41.234 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-10-08T19:26:41.234 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-10-08T19:26:41.234 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="App mode production" logger=settings 2021-10-08T19:26:41.234 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-10-08T19:26:41.235 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-10-08T19:26:41.235 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-10-08T19:26:41.235 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 conmon[62976]: t=2021-10-08T19:26:40+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-10-08T19:26:41.235 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 bash[62790]: 6148e11c3064af2194466fd69fca7d7210d726997e5de008083e3afa8e86a8d8 2021-10-08T19:26:41.235 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:40 smithi196 systemd[1]: Started Ceph grafana.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:26:41.236 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-10-08T19:26:41.236 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-10-08T19:26:41.236 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-10-08T19:26:41.236 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-10-08T19:26:41.237 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-10-08T19:26:41.515 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-10-08T19:26:41.515 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-10-08T19:26:41.515 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-10-08T19:26:41.734 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182433 got 107374182437 for osd.3 2021-10-08T19:26:41.734 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-10-08T19:26:41.834 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:41 smithi196 ceph-mon[34258]: poll took 35015.096 ms: 1 events 2021-10-08T19:26:41.835 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:41 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:41.835 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2283361525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:26:41.835 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-10-08T19:26:41.836 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-10-08T19:26:41.836 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-10-08T19:26:41.836 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-10-08T19:26:41.836 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-10-08T19:26:41.837 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-10-08T19:26:41.837 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-10-08T19:26:41.957 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:41 smithi157 ceph-mon[32847]: poll took 35015.096 ms: 1 events 2021-10-08T19:26:41.958 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:41 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:41.958 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2283361525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:26:41.958 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:41 smithi157 ceph-mon[42114]: poll took 35015.096 ms: 1 events 2021-10-08T19:26:41.958 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:41 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:41.959 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2283361525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:26:42.088 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:42.116 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-10-08T19:26:42.117 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-10-08T19:26:42.117 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:41 smithi196 conmon[62976]: t=2021-10-08T19:26:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-10-08T19:26:42.117 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-10-08T19:26:42.117 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-10-08T19:26:42.438 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-10-08T19:26:42.438 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-10-08T19:26:42.438 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-10-08T19:26:42.439 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-10-08T19:26:42.439 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-10-08T19:26:42.579 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:42 smithi157 bash[81340]: Trying to pull quay.io/prometheus/node-exporter:v0.18.1... 2021-10-08T19:26:42.747 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:42 smithi196 ceph-mon[34258]: poll took 1028.437 ms: 1 events 2021-10-08T19:26:42.747 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:42 smithi196 ceph-mon[34258]: Sending message to agent on host smithi196 2021-10-08T19:26:42.748 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:42 smithi196 ceph-mon[34258]: Deploying daemon node-exporter.a on smithi157 2021-10-08T19:26:42.748 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:42 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi196 2021-10-08T19:26:42.748 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:42 smithi196 ceph-mon[34258]: pgmap v38: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:26:42.749 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-10-08T19:26:42.749 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-10-08T19:26:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[32847]: poll took 1028.437 ms: 1 events 2021-10-08T19:26:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[32847]: Sending message to agent on host smithi196 2021-10-08T19:26:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[32847]: Deploying daemon node-exporter.a on smithi157 2021-10-08T19:26:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi196 2021-10-08T19:26:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[32847]: pgmap v38: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:26:43.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[42114]: poll took 1028.437 ms: 1 events 2021-10-08T19:26:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[42114]: Sending message to agent on host smithi196 2021-10-08T19:26:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[42114]: Deploying daemon node-exporter.a on smithi157 2021-10-08T19:26:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi196 2021-10-08T19:26:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:42 smithi157 ceph-mon[42114]: pgmap v38: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:26:43.089 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:42 smithi196 conmon[62976]: t=2021-10-08T19:26:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-10-08T19:26:43.343 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-10-08T19:26:43.343 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-10-08T19:26:43.343 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-10-08T19:26:43.344 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-10-08T19:26:43.344 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-10-08T19:26:43.593 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-10-08T19:26:43.594 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-10-08T19:26:43.594 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-10-08T19:26:43.594 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-10-08T19:26:43.595 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-10-08T19:26:43.595 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-10-08T19:26:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/4055601953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd240fdf70 msgr2=0x7fdd240f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/4055601953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd240fdf70 0x7fdd240f7680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd14004650 tx=0x7fdd14009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/4055601953 shutdown_connections 2021-10-08T19:26:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/4055601953 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd240f7d60 0x7fdd241043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/4055601953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd240fd5d0 0x7fdd240fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/4055601953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd240fdf70 0x7fdd240f7680 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/4055601953 >> 172.21.15.157:0/4055601953 conn(0x7fdd2406f330 msgr2=0x7fdd2406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/4055601953 shutdown_connections 2021-10-08T19:26:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/4055601953 wait complete. 2021-10-08T19:26:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 Processor -- start 2021-10-08T19:26:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 -- start start 2021-10-08T19:26:43.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.748+0000 7fdd2b7c7700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd240f7d60 0x7fdd2410d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:43.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd2b7c7700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd240fd5d0 0x7fdd2410de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:43.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd2b7c7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd240fdf70 0x7fdd241079d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:43.754 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd2b7c7700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd24107fa0 con 0x7fdd240fdf70 2021-10-08T19:26:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd2b7c7700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd24108110 con 0x7fdd240f7d60 2021-10-08T19:26:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd2b7c7700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd241082d0 con 0x7fdd240fd5d0 2021-10-08T19:26:43.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd28d62700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd240fd5d0 0x7fdd2410de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:43.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd29d64700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd240fdf70 0x7fdd241079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:43.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd28d62700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd240fd5d0 0x7fdd2410de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50438/0 (socket says 172.21.15.157:50438) 2021-10-08T19:26:43.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd28d62700 1 -- 172.21.15.157:0/3032545862 learned_addr learned my addr 172.21.15.157:0/3032545862 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:43.756 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd29563700 1 --2- 172.21.15.157:0/3032545862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd240f7d60 0x7fdd2410d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:43.757 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd28d62700 1 -- 172.21.15.157:0/3032545862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd240f7d60 msgr2=0x7fdd2410d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:43.757 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd28d62700 1 --2- 172.21.15.157:0/3032545862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd240f7d60 0x7fdd2410d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:43.757 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd28d62700 1 -- 172.21.15.157:0/3032545862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd240fdf70 msgr2=0x7fdd241079d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:43.757 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd28d62700 1 --2- 172.21.15.157:0/3032545862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd240fdf70 0x7fdd241079d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:43.758 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd28d62700 1 -- 172.21.15.157:0/3032545862 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd20005040 con 0x7fdd240fd5d0 2021-10-08T19:26:43.758 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd29d64700 1 --2- 172.21.15.157:0/3032545862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd240fdf70 0x7fdd241079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:43.758 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd28d62700 1 --2- 172.21.15.157:0/3032545862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd240fd5d0 0x7fdd2410de40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd14004d30 tx=0x7fdd14009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:43.758 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd19ffb700 1 -- 172.21.15.157:0/3032545862 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1401a070 con 0x7fdd240fd5d0 2021-10-08T19:26:43.758 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd14005040 con 0x7fdd240fd5d0 2021-10-08T19:26:43.759 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd19ffb700 1 -- 172.21.15.157:0/3032545862 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fdd140095b0 con 0x7fdd240fd5d0 2021-10-08T19:26:43.759 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd19ffb700 1 -- 172.21.15.157:0/3032545862 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1401fba0 con 0x7fdd240fd5d0 2021-10-08T19:26:43.759 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.749+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd24061960 con 0x7fdd240fd5d0 2021-10-08T19:26:43.760 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.750+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd24047b50 con 0x7fdd240fd5d0 2021-10-08T19:26:43.761 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.751+0000 7fdd19ffb700 1 -- 172.21.15.157:0/3032545862 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fdd14025020 con 0x7fdd240fd5d0 2021-10-08T19:26:43.761 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.751+0000 7fdd19ffb700 1 --2- 172.21.15.157:0/3032545862 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdd100635b0 0x7fdd10065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:43.761 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.751+0000 7fdd19ffb700 1 -- 172.21.15.157:0/3032545862 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6281+0+0 (secure 0 0 0) 0x7fdd14080c30 con 0x7fdd240fd5d0 2021-10-08T19:26:43.761 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.751+0000 7fdd29563700 1 --2- 172.21.15.157:0/3032545862 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdd100635b0 0x7fdd10065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:43.762 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.751+0000 7fdd29563700 1 --2- 172.21.15.157:0/3032545862 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdd100635b0 0x7fdd10065a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009fd0 tx=0x7fdd20014040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:43.762 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.755+0000 7fdd19ffb700 1 -- 172.21.15.157:0/3032545862 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fdd140537e0 con 0x7fdd240fd5d0 2021-10-08T19:26:43.828 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:43 smithi157 bash[81340]: Getting image source signatures 2021-10-08T19:26:43.866 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-10-08T19:26:43.867 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-10-08T19:26:43.867 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-10-08T19:26:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.917+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdd24108ee0 con 0x7fdd240fd5d0 2021-10-08T19:26:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.917+0000 7fdd19ffb700 1 -- 172.21.15.157:0/3032545862 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd140533d0 con 0x7fdd240fd5d0 2021-10-08T19:26:43.920 INFO:teuthology.orchestra.run.smithi157.stdout:128849018913 2021-10-08T19:26:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdd100635b0 msgr2=0x7fdd10065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/3032545862 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdd100635b0 0x7fdd10065a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009fd0 tx=0x7fdd20014040 comp rx=0 tx=0).stop 2021-10-08T19:26:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd240fd5d0 msgr2=0x7fdd2410de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/3032545862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd240fd5d0 0x7fdd2410de40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd14004d30 tx=0x7fdd14009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:43.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 shutdown_connections 2021-10-08T19:26:43.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/3032545862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd240fdf70 0x7fdd241079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:43.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/3032545862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd240f7d60 0x7fdd2410d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:43.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/3032545862 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdd100635b0 0x7fdd10065a60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:43.922 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 --2- 172.21.15.157:0/3032545862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd240fd5d0 0x7fdd2410de40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 >> 172.21.15.157:0/3032545862 conn(0x7fdd2406f330 msgr2=0x7fdd240f6770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 shutdown_connections 2021-10-08T19:26:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:43.919+0000 7fdd2b7c7700 1 -- 172.21.15.157:0/3032545862 wait complete. 2021-10-08T19:26:44.147 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-10-08T19:26:44.147 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-10-08T19:26:44.147 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:43 smithi196 conmon[62976]: t=2021-10-08T19:26:43+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-10-08T19:26:44.148 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-10-08T19:26:44.432 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-10-08T19:26:44.433 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-10-08T19:26:44.433 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-10-08T19:26:44.433 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-10-08T19:26:44.434 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-10-08T19:26:44.434 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-10-08T19:26:44.434 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-10-08T19:26:44.543 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018910 got 128849018913 for osd.4 2021-10-08T19:26:44.544 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-10-08T19:26:44.760 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:44 smithi196 ceph-mon[34258]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72 B/s, 1 objects/s recovering 2021-10-08T19:26:44.761 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3032545862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:26:44.761 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-10-08T19:26:44.762 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-10-08T19:26:44.762 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-10-08T19:26:44.762 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-10-08T19:26:44.762 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-10-08T19:26:44.762 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-10-08T19:26:44.819 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:44 smithi157 ceph-mon[32847]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72 B/s, 1 objects/s recovering 2021-10-08T19:26:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3032545862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:26:44.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:44 smithi157 ceph-mon[42114]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72 B/s, 1 objects/s recovering 2021-10-08T19:26:44.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3032545862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:26:44.829 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:44 smithi157 bash[81340]: Copying blob sha256:190160031744b0810999dd6f293478be0b41524654c70782cf09437095430f2f 2021-10-08T19:26:44.829 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:44 smithi157 bash[81340]: Copying blob sha256:3589a6efd9ce96b2f2218a80bacb84f60d5e584d024023617b0f56b87fe798c3 2021-10-08T19:26:44.830 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:44 smithi157 bash[81340]: Copying blob sha256:49a2d53aa1af115e87f7e23a7fe4b7a3e12304d37982fb6528b035d0f68a3b56 2021-10-08T19:26:45.021 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-10-08T19:26:45.021 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-10-08T19:26:45.021 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:44 smithi196 conmon[62976]: t=2021-10-08T19:26:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-10-08T19:26:45.021 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-10-08T19:26:45.279 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-10-08T19:26:45.279 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-10-08T19:26:45.279 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-10-08T19:26:45.280 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-10-08T19:26:45.530 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-10-08T19:26:45.530 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-10-08T19:26:45.531 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-10-08T19:26:45.531 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-10-08T19:26:45.807 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:45 smithi196 ceph-mon[34258]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2021-10-08T19:26:45.808 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:45 smithi196 ceph-mon[34258]: Cluster is now healthy 2021-10-08T19:26:45.808 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-10-08T19:26:45.808 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-10-08T19:26:45.809 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-10-08T19:26:45.809 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-10-08T19:26:45.809 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-10-08T19:26:45.809 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-10-08T19:26:45.966 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:45 smithi157 ceph-mon[32847]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2021-10-08T19:26:45.966 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:45 smithi157 ceph-mon[32847]: Cluster is now healthy 2021-10-08T19:26:45.967 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:45 smithi157 ceph-mon[42114]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2021-10-08T19:26:45.967 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:45 smithi157 ceph-mon[42114]: Cluster is now healthy 2021-10-08T19:26:46.068 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-10-08T19:26:46.069 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:45 smithi196 conmon[62976]: t=2021-10-08T19:26:45+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-10-08T19:26:46.069 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-10-08T19:26:46.069 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-10-08T19:26:46.229 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:26:45 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:26:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:46.324 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-10-08T19:26:46.324 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-10-08T19:26:46.436 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.434+0000 7fa1bcacb700 1 -- 172.21.15.157:0/2701550671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 msgr2=0x7fa1b80f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:46.437 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.434+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/2701550671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 0x7fa1b80f8240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac004710 tx=0x7fa1ac009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:46.437 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.434+0000 7fa1bcacb700 1 -- 172.21.15.157:0/2701550671 shutdown_connections 2021-10-08T19:26:46.437 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.434+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/2701550671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1b80f8780 0x7fa1b8104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:46.438 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.434+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/2701550671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b80fd5e0 0x7fa1b80fd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:46.438 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.434+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/2701550671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 0x7fa1b80f8240 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:46.438 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.434+0000 7fa1bcacb700 1 -- 172.21.15.157:0/2701550671 >> 172.21.15.157:0/2701550671 conn(0x7fa1b8070b90 msgr2=0x7fa1b80f4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:46.438 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.434+0000 7fa1bcacb700 1 -- 172.21.15.157:0/2701550671 shutdown_connections 2021-10-08T19:26:46.438 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1bcacb700 1 -- 172.21.15.157:0/2701550671 wait complete. 2021-10-08T19:26:46.439 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1bcacb700 1 Processor -- start 2021-10-08T19:26:46.439 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1bcacb700 1 -- start start 2021-10-08T19:26:46.439 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1bcacb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 0x7fa1b810e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:46.440 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1bcacb700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b80f8780 0x7fa1b810ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:46.440 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1bcacb700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1b80fd5e0 0x7fa1b8108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:46.440 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1bcacb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8109080 con 0x7fa1b80f7dd0 2021-10-08T19:26:46.441 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1bcacb700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81091f0 con 0x7fa1b80f8780 2021-10-08T19:26:46.441 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1bcacb700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81093b0 con 0x7fa1b80fd5e0 2021-10-08T19:26:46.441 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1b659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 0x7fa1b810e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:46.441 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1b659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 0x7fa1b810e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41198/0 (socket says 172.21.15.157:41198) 2021-10-08T19:26:46.441 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1b5d9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b80f8780 0x7fa1b810ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:46.442 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1b659c700 1 -- 172.21.15.157:0/4123914313 learned_addr learned my addr 172.21.15.157:0/4123914313 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:46.442 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.435+0000 7fa1b6d9d700 1 --2- 172.21.15.157:0/4123914313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1b80fd5e0 0x7fa1b8108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:46.442 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1b5d9b700 1 -- 172.21.15.157:0/4123914313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1b80fd5e0 msgr2=0x7fa1b8108ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:46.443 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1b5d9b700 1 --2- 172.21.15.157:0/4123914313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1b80fd5e0 0x7fa1b8108ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:46.443 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1b5d9b700 1 -- 172.21.15.157:0/4123914313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 msgr2=0x7fa1b810e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:46.443 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1b5d9b700 1 --2- 172.21.15.157:0/4123914313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 0x7fa1b810e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:46.443 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1b5d9b700 1 -- 172.21.15.157:0/4123914313 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0009640 con 0x7fa1b80f8780 2021-10-08T19:26:46.444 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1b659c700 1 --2- 172.21.15.157:0/4123914313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 0x7fa1b810e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:46.444 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1b5d9b700 1 --2- 172.21.15.157:0/4123914313 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b80f8780 0x7fa1b810ef20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac004d40 tx=0x7fa1ac009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:46.444 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1a6ffd700 1 -- 172.21.15.157:0/4123914313 <== mon.2 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac01a070 con 0x7fa1b80f8780 2021-10-08T19:26:46.444 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac005040 con 0x7fa1b80f8780 2021-10-08T19:26:46.444 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1a6ffd700 1 -- 172.21.15.157:0/4123914313 <== mon.2 v2:172.21.15.196:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fa1ac007da0 con 0x7fa1b80f8780 2021-10-08T19:26:46.445 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1a6ffd700 1 -- 172.21.15.157:0/4123914313 <== mon.2 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac01eb50 con 0x7fa1b80f8780 2021-10-08T19:26:46.445 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.436+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b8115850 con 0x7fa1b80f8780 2021-10-08T19:26:46.446 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.437+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b8047b50 con 0x7fa1b80f8780 2021-10-08T19:26:46.446 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.437+0000 7fa1a6ffd700 1 -- 172.21.15.157:0/4123914313 <== mon.2 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fa1ac007920 con 0x7fa1b80f8780 2021-10-08T19:26:46.446 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.438+0000 7fa1a6ffd700 1 --2- 172.21.15.157:0/4123914313 >> v2:172.21.15.157:6800/1475557172 conn(0x7fa1a00635b0 0x7fa1a0065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:46.447 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.438+0000 7fa1b659c700 1 --2- 172.21.15.157:0/4123914313 >> v2:172.21.15.157:6800/1475557172 conn(0x7fa1a00635b0 0x7fa1a0065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:46.447 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.438+0000 7fa1a6ffd700 1 -- 172.21.15.157:0/4123914313 <== mon.2 v2:172.21.15.196:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6281+0+0 (secure 0 0 0) 0x7fa1ac080510 con 0x7fa1b80f8780 2021-10-08T19:26:46.447 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.438+0000 7fa1b659c700 1 --2- 172.21.15.157:0/4123914313 >> v2:172.21.15.157:6800/1475557172 conn(0x7fa1a00635b0 0x7fa1a0065a60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8007a30 tx=0x7fa1a800b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:46.447 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.442+0000 7fa1a6ffd700 1 -- 172.21.15.157:0/4123914313 <== mon.2 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fa1ac053110 con 0x7fa1b80f8780 2021-10-08T19:26:46.612 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.611+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa1b8109fc0 con 0x7fa1b80f8780 2021-10-08T19:26:46.612 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.611+0000 7fa1a6ffd700 1 -- 172.21.15.157:0/4123914313 <== mon.2 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1ac023020 con 0x7fa1b80f8780 2021-10-08T19:26:46.613 INFO:teuthology.orchestra.run.smithi157.stdout:158913789981 2021-10-08T19:26:46.614 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 >> v2:172.21.15.157:6800/1475557172 conn(0x7fa1a00635b0 msgr2=0x7fa1a0065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:46.614 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/4123914313 >> v2:172.21.15.157:6800/1475557172 conn(0x7fa1a00635b0 0x7fa1a0065a60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8007a30 tx=0x7fa1a800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:46.614 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b80f8780 msgr2=0x7fa1b810ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:46.614 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/4123914313 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b80f8780 0x7fa1b810ef20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac004d40 tx=0x7fa1ac009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:46.615 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 shutdown_connections 2021-10-08T19:26:46.615 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/4123914313 >> v2:172.21.15.157:6800/1475557172 conn(0x7fa1a00635b0 0x7fa1a0065a60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:46.615 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/4123914313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1b80fd5e0 0x7fa1b8108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:46.615 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/4123914313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1b80f7dd0 0x7fa1b810e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:46.616 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 --2- 172.21.15.157:0/4123914313 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b80f8780 0x7fa1b810ef20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:46.616 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 >> 172.21.15.157:0/4123914313 conn(0x7fa1b8070b90 msgr2=0x7fa1b80f6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:46.617 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 shutdown_connections 2021-10-08T19:26:46.617 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:46.613+0000 7fa1bcacb700 1 -- 172.21.15.157:0/4123914313 wait complete. 2021-10-08T19:26:46.618 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-10-08T19:26:46.618 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-10-08T19:26:46.618 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-10-08T19:26:46.618 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-10-08T19:26:46.619 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-10-08T19:26:46.619 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-10-08T19:26:46.619 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-10-08T19:26:46.619 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-10-08T19:26:46.904 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:46 smithi196 ceph-mon[34258]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 64 B/s, 1 objects/s recovering 2021-10-08T19:26:46.904 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:46 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:46.904 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:46 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:46.905 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4123914313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:26:46.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:26:46.905 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-10-08T19:26:46.906 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-10-08T19:26:46.906 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-10-08T19:26:46.906 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-10-08T19:26:47.078 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:46 smithi157 bash[81340]: Copying config sha256:e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87 2021-10-08T19:26:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:46 smithi157 ceph-mon[32847]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 64 B/s, 1 objects/s recovering 2021-10-08T19:26:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:46 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:46 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4123914313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:26:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:46 smithi157 ceph-mon[42114]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 64 B/s, 1 objects/s recovering 2021-10-08T19:26:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:46 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:46 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4123914313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:26:47.275 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:46 smithi196 conmon[62976]: t=2021-10-08T19:26:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-10-08T19:26:47.539 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:47 smithi196 conmon[62976]: t=2021-10-08T19:26:47+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-10-08T19:26:47.539 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:47 smithi196 conmon[62976]: t=2021-10-08T19:26:47+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-10-08T19:26:47.539 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:47 smithi196 conmon[62976]: t=2021-10-08T19:26:47+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-10-08T19:26:47.774 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:47 smithi157 bash[81340]: Writing manifest to image destination 2021-10-08T19:26:47.834 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:47 smithi157 bash[81340]: Storing signatures 2021-10-08T19:26:47.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:47 smithi157 ceph-mon[42114]: Received old metadata from agent on host smithi196. Requested up-to-date metadata. 2021-10-08T19:26:47.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:47 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:26:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:47.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:47 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:47.837 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:47 smithi196 ceph-mon[34258]: Received old metadata from agent on host smithi196. Requested up-to-date metadata. 2021-10-08T19:26:47.837 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:47 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:26:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:47.837 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:47 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:47.838 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:47 smithi196 conmon[62976]: t=2021-10-08T19:26:47+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-10-08T19:26:47.838 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:47 smithi196 conmon[62976]: t=2021-10-08T19:26:47+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-10-08T19:26:47.838 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:47 smithi196 conmon[62976]: t=2021-10-08T19:26:47+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-10-08T19:26:47.839 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:47 smithi196 conmon[62976]: t=2021-10-08T19:26:47+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-10-08T19:26:48.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:47 smithi157 ceph-mon[32847]: Received old metadata from agent on host smithi196. Requested up-to-date metadata. 2021-10-08T19:26:48.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:47 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:26:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:48.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:47 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:48.084 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:47 smithi196 conmon[62976]: t=2021-10-08T19:26:47+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-10-08T19:26:48.084 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-10-08T19:26:48.193 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789977 got 158913789981 for osd.5 2021-10-08T19:26:48.193 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-10-08T19:26:48.399 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-10-08T19:26:48.399 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-10-08T19:26:48.399 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-10-08T19:26:48.400 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-10-08T19:26:48.400 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-10-08T19:26:48.400 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-10-08T19:26:48.476 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:48.651 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-10-08T19:26:48.651 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-10-08T19:26:48.652 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-10-08T19:26:48.652 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-10-08T19:26:48.652 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-10-08T19:26:48.927 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:48 smithi196 ceph-mon[34258]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 57 B/s, 1 objects/s recovering 2021-10-08T19:26:48.927 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-10-08T19:26:48.928 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-10-08T19:26:48.928 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-10-08T19:26:48.928 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-10-08T19:26:48.928 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-10-08T19:26:48.989 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:48 smithi157 ceph-mon[32847]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 57 B/s, 1 objects/s recovering 2021-10-08T19:26:48.990 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-10-08T19:26:48.991 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-10-08T19:26:48.991 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-10-08T19:26:48.991 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-10-08T19:26:48.992 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-10-08T19:26:48.992 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-10-08T19:26:48.992 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-10-08T19:26:48.992 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-10-08T19:26:48.992 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-10-08T19:26:48.993 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-10-08T19:26:48.993 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-10-08T19:26:48.993 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-10-08T19:26:48.993 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-10-08T19:26:48.994 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-10-08T19:26:48.994 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-10-08T19:26:48.994 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-10-08T19:26:48.994 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-10-08T19:26:48.995 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-10-08T19:26:48.995 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-10-08T19:26:48.995 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-10-08T19:26:48.995 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-10-08T19:26:48.996 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-10-08T19:26:48.996 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-10-08T19:26:48.997 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-10-08T19:26:48.997 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-10-08T19:26:48.997 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-10-08T19:26:48.997 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-10-08T19:26:48.998 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-10-08T19:26:48.998 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-10-08T19:26:48.998 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - time" source="node_exporter.go:104" 2021-10-08T19:26:48.998 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-10-08T19:26:48.999 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-10-08T19:26:48.999 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-10-08T19:26:48.999 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-10-08T19:26:48.999 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:48 smithi157 conmon[82357]: time="2021-10-08T19:26:48Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-10-08T19:26:49.000 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:48 smithi157 ceph-mon[42114]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 57 B/s, 1 objects/s recovering 2021-10-08T19:26:49.238 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:48 smithi196 conmon[62976]: t=2021-10-08T19:26:48+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-10-08T19:26:49.238 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:49 smithi196 conmon[62976]: t=2021-10-08T19:26:49+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-10-08T19:26:49.238 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:49 smithi196 conmon[62976]: t=2021-10-08T19:26:49+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-10-08T19:26:49.239 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:49 smithi196 conmon[62976]: t=2021-10-08T19:26:49+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-10-08T19:26:49.328 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:49 smithi157 bash[81340]: 53dd159a2fc1c9f15fa3c7f5826729262ea22ee7b50198c86b71fc4a33a45e42 2021-10-08T19:26:49.329 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:26:49 smithi157 systemd[1]: Started Ceph node-exporter.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:26:49.609 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:49 smithi196 conmon[62976]: t=2021-10-08T19:26:49+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-10-08T19:26:49.610 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:49 smithi196 conmon[62976]: t=2021-10-08T19:26:49+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-10-08T19:26:49.866 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:49 smithi196 conmon[62976]: t=2021-10-08T19:26:49+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-10-08T19:26:50.156 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:50 smithi196 ceph-mon[34258]: poll took 7260.115 ms: 1 events 2021-10-08T19:26:50.156 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:50 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:50.157 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:50 smithi196 ceph-mon[34258]: Deploying daemon node-exporter.b on smithi196 2021-10-08T19:26:50.157 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:50 smithi196 ceph-mon[34258]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48 B/s, 1 objects/s recovering 2021-10-08T19:26:50.157 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:49 smithi196 conmon[62976]: t=2021-10-08T19:26:49+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-10-08T19:26:50.158 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:49 smithi196 conmon[62976]: t=2021-10-08T19:26:49+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-10-08T19:26:50.158 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:49 smithi196 conmon[62976]: t=2021-10-08T19:26:49+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-10-08T19:26:50.158 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-10-08T19:26:50.158 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-10-08T19:26:50.159 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-10-08T19:26:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:50 smithi157 ceph-mon[32847]: poll took 7260.115 ms: 1 events 2021-10-08T19:26:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:50 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:50 smithi157 ceph-mon[32847]: Deploying daemon node-exporter.b on smithi196 2021-10-08T19:26:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:50 smithi157 ceph-mon[32847]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48 B/s, 1 objects/s recovering 2021-10-08T19:26:50.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:50 smithi157 ceph-mon[42114]: poll took 7260.115 ms: 1 events 2021-10-08T19:26:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:50 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:50 smithi157 ceph-mon[42114]: Deploying daemon node-exporter.b on smithi196 2021-10-08T19:26:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:50 smithi157 ceph-mon[42114]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48 B/s, 1 objects/s recovering 2021-10-08T19:26:50.420 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:50 smithi196 systemd[1]: Starting Ceph node-exporter.b for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:26:50.420 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-10-08T19:26:50.420 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-10-08T19:26:50.421 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-10-08T19:26:50.421 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-10-08T19:26:50.421 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-10-08T19:26:50.421 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-10-08T19:26:50.494 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 -- 172.21.15.157:0/533470235 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40fe730 msgr2=0x7f58d40feb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:50.495 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/533470235 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40fe730 0x7f58d40feb00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58c4004620 tx=0x7f58c4009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:50.495 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 -- 172.21.15.157:0/533470235 shutdown_connections 2021-10-08T19:26:50.495 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/533470235 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d40f7550 0x7f58d41054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.495 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/533470235 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40fe730 0x7f58d40feb00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.496 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/533470235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d40f6ba0 0x7f58d40f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.496 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 -- 172.21.15.157:0/533470235 >> 172.21.15.157:0/533470235 conn(0x7f58d406da50 msgr2=0x7f58d40f4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:50.496 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 -- 172.21.15.157:0/533470235 shutdown_connections 2021-10-08T19:26:50.496 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 -- 172.21.15.157:0/533470235 wait complete. 2021-10-08T19:26:50.497 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.494+0000 7f58d9d6b700 1 Processor -- start 2021-10-08T19:26:50.499 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d9d6b700 1 -- start start 2021-10-08T19:26:50.500 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d9d6b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d40f6ba0 0x7f58d410ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:50.500 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d9d6b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40f7550 0x7f58d410ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:50.500 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d9d6b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d40fe730 0x7f58d4108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:50.500 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d9d6b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d41090a0 con 0x7f58d40fe730 2021-10-08T19:26:50.500 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d9d6b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d4109210 con 0x7f58d40f6ba0 2021-10-08T19:26:50.501 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d9d6b700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d41093d0 con 0x7f58d40f7550 2021-10-08T19:26:50.501 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d2ffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40f7550 0x7f58d410ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:50.501 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d2ffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40f7550 0x7f58d410ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50460/0 (socket says 172.21.15.157:50460) 2021-10-08T19:26:50.501 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d2ffd700 1 -- 172.21.15.157:0/2668424253 learned_addr learned my addr 172.21.15.157:0/2668424253 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d3fff700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d40fe730 0x7f58d4108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d37fe700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d40f6ba0 0x7f58d410ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d2ffd700 1 -- 172.21.15.157:0/2668424253 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d40f6ba0 msgr2=0x7f58d410ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d2ffd700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d40f6ba0 0x7f58d410ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.503 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d2ffd700 1 -- 172.21.15.157:0/2668424253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d40fe730 msgr2=0x7f58d4108ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:50.503 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d2ffd700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d40fe730 0x7f58d4108ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.503 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d2ffd700 1 -- 172.21.15.157:0/2668424253 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c8005040 con 0x7f58d40f7550 2021-10-08T19:26:50.503 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d3fff700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d40fe730 0x7f58d4108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:50.503 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d37fe700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d40f6ba0 0x7f58d410ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:26:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d2ffd700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40f7550 0x7f58d410ef40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f58c80049e0 tx=0x7f58c8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58bbfff700 1 -- 172.21.15.157:0/2668424253 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8007e50 con 0x7f58d40f7550 2021-10-08T19:26:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58bbfff700 1 -- 172.21.15.157:0/2668424253 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f58c800f040 con 0x7f58d40f7550 2021-10-08T19:26:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.495+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c4005040 con 0x7f58d40f7550 2021-10-08T19:26:50.505 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.496+0000 7f58bbfff700 1 -- 172.21.15.157:0/2668424253 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c80139d0 con 0x7f58d40f7550 2021-10-08T19:26:50.505 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.496+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d4115800 con 0x7f58d40f7550 2021-10-08T19:26:50.505 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.496+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d4047b50 con 0x7f58d40f7550 2021-10-08T19:26:50.505 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.497+0000 7f58bbfff700 1 -- 172.21.15.157:0/2668424253 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f58c800ecb0 con 0x7f58d40f7550 2021-10-08T19:26:50.505 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.497+0000 7f58bbfff700 1 --2- 172.21.15.157:0/2668424253 >> v2:172.21.15.157:6800/1475557172 conn(0x7f58bc0635b0 0x7f58bc065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:50.506 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.497+0000 7f58bbfff700 1 -- 172.21.15.157:0/2668424253 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6281+0+0 (secure 0 0 0) 0x7f58c807fb90 con 0x7f58d40f7550 2021-10-08T19:26:50.506 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.497+0000 7f58d37fe700 1 --2- 172.21.15.157:0/2668424253 >> v2:172.21.15.157:6800/1475557172 conn(0x7f58bc0635b0 0x7f58bc065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:50.506 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.498+0000 7f58d37fe700 1 --2- 172.21.15.157:0/2668424253 >> v2:172.21.15.157:6800/1475557172 conn(0x7f58bc0635b0 0x7f58bc065a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f58c4014510 tx=0x7f58c4017040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.502+0000 7f58bbfff700 1 -- 172.21.15.157:0/2668424253 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f58c8052650 con 0x7f58d40f7550 2021-10-08T19:26:50.660 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.659+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f58d4107ae0 con 0x7f58d40f7550 2021-10-08T19:26:50.660 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.660+0000 7f58bbfff700 1 -- 172.21.15.157:0/2668424253 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58c8052240 con 0x7f58d40f7550 2021-10-08T19:26:50.661 INFO:teuthology.orchestra.run.smithi157.stdout:188978561050 2021-10-08T19:26:50.662 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 >> v2:172.21.15.157:6800/1475557172 conn(0x7f58bc0635b0 msgr2=0x7f58bc065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:50.662 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/2668424253 >> v2:172.21.15.157:6800/1475557172 conn(0x7f58bc0635b0 0x7f58bc065a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f58c4014510 tx=0x7f58c4017040 comp rx=0 tx=0).stop 2021-10-08T19:26:50.662 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40f7550 msgr2=0x7f58d410ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:50.663 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40f7550 0x7f58d410ef40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f58c80049e0 tx=0x7f58c8009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:50.663 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 shutdown_connections 2021-10-08T19:26:50.663 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d40fe730 0x7f58d4108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.663 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d40f6ba0 0x7f58d410ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.663 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/2668424253 >> v2:172.21.15.157:6800/1475557172 conn(0x7f58bc0635b0 0x7f58bc065a60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.664 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 --2- 172.21.15.157:0/2668424253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58d40f7550 0x7f58d410ef40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.664 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.661+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 >> 172.21.15.157:0/2668424253 conn(0x7f58d406da50 msgr2=0x7f58d406ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:50.664 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.662+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 shutdown_connections 2021-10-08T19:26:50.664 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:50.662+0000 7f58d9d6b700 1 -- 172.21.15.157:0/2668424253 wait complete. 2021-10-08T19:26:50.725 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-10-08T19:26:50.726 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-10-08T19:26:50.726 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-10-08T19:26:50.726 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-10-08T19:26:51.021 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-10-08T19:26:51.021 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-10-08T19:26:51.021 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:50 smithi196 conmon[62976]: t=2021-10-08T19:26:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-10-08T19:26:51.021 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-10-08T19:26:51.267 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561046 got 188978561050 for osd.6 2021-10-08T19:26:51.268 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-10-08T19:26:51.283 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:51 smithi196 bash[64526]: Trying to pull quay.io/prometheus/node-exporter:v0.18.1... 2021-10-08T19:26:51.283 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2668424253' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:26:51.284 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:51 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:51.284 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-10-08T19:26:51.284 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-10-08T19:26:51.285 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-10-08T19:26:51.285 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-10-08T19:26:51.285 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-10-08T19:26:51.285 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-10-08T19:26:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2668424253' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:26:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:51 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2668424253' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:26:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:51 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:51.544 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-10-08T19:26:51.545 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-10-08T19:26:51.545 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-10-08T19:26:51.545 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-10-08T19:26:51.546 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-10-08T19:26:51.546 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-10-08T19:26:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:51.828 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-10-08T19:26:51.828 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-10-08T19:26:51.829 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-10-08T19:26:52.081 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-10-08T19:26:52.081 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:51 smithi196 conmon[62976]: t=2021-10-08T19:26:51+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-10-08T19:26:52.082 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-10-08T19:26:52.082 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-10-08T19:26:52.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:52 smithi157 ceph-mon[32847]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48 B/s, 1 objects/s recovering 2021-10-08T19:26:52.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:52 smithi157 ceph-mon[42114]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48 B/s, 1 objects/s recovering 2021-10-08T19:26:52.351 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:52 smithi196 ceph-mon[34258]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48 B/s, 1 objects/s recovering 2021-10-08T19:26:52.351 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:52 smithi196 bash[64526]: Getting image source signatures 2021-10-08T19:26:52.352 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-10-08T19:26:52.352 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-10-08T19:26:52.352 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-10-08T19:26:52.352 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-10-08T19:26:52.353 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-10-08T19:26:52.600 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-10-08T19:26:52.601 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-10-08T19:26:52.601 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-10-08T19:26:52.601 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-10-08T19:26:52.601 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-10-08T19:26:52.602 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-10-08T19:26:52.602 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-10-08T19:26:52.866 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-10-08T19:26:52.867 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-10-08T19:26:52.867 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-10-08T19:26:53.121 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.118+0000 7f8a49589700 1 -- 172.21.15.157:0/1807705140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440fd5d0 msgr2=0x7f8a440fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.122 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.118+0000 7f8a49589700 1 --2- 172.21.15.157:0/1807705140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440fd5d0 0x7f8a440fd9a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a34004710 tx=0x7f8a34009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:53.122 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.118+0000 7f8a49589700 1 -- 172.21.15.157:0/1807705140 shutdown_connections 2021-10-08T19:26:53.123 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.118+0000 7f8a49589700 1 --2- 172.21.15.157:0/1807705140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a440f7d60 0x7f8a441043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.123 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.118+0000 7f8a49589700 1 --2- 172.21.15.157:0/1807705140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440fd5d0 0x7f8a440fd9a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.124 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.118+0000 7f8a49589700 1 --2- 172.21.15.157:0/1807705140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a440fdf70 0x7f8a440f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.124 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.118+0000 7f8a49589700 1 -- 172.21.15.157:0/1807705140 >> 172.21.15.157:0/1807705140 conn(0x7f8a4406f330 msgr2=0x7f8a4406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:53.125 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.118+0000 7f8a49589700 1 -- 172.21.15.157:0/1807705140 shutdown_connections 2021-10-08T19:26:53.126 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.118+0000 7f8a49589700 1 -- 172.21.15.157:0/1807705140 wait complete. 2021-10-08T19:26:53.127 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a49589700 1 Processor -- start 2021-10-08T19:26:53.127 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a49589700 1 -- start start 2021-10-08T19:26:53.127 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a49589700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440f7d60 0x7f8a44107940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:53.128 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a49589700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a440fd5d0 0x7f8a44107e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:53.128 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a49589700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a440fdf70 0x7f8a441083c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:53.129 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a49589700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44117050 con 0x7f8a440f7d60 2021-10-08T19:26:53.129 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a49589700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a441171c0 con 0x7f8a440fdf70 2021-10-08T19:26:53.130 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a49589700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44117380 con 0x7f8a440fd5d0 2021-10-08T19:26:53.131 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a42ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440f7d60 0x7f8a44107940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:53.131 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a427fc700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a440fd5d0 0x7f8a44107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:53.132 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a42ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440f7d60 0x7f8a44107940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41222/0 (socket says 172.21.15.157:41222) 2021-10-08T19:26:53.132 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a42ffd700 1 -- 172.21.15.157:0/1078187197 learned_addr learned my addr 172.21.15.157:0/1078187197 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:53.133 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a427fc700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a440fd5d0 0x7f8a44107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50472/0 (socket says 172.21.15.157:50472) 2021-10-08T19:26:53.133 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a437fe700 1 --2- 172.21.15.157:0/1078187197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a440fdf70 0x7f8a441083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:53.136 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a42ffd700 1 -- 172.21.15.157:0/1078187197 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a440fd5d0 msgr2=0x7f8a44107e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.137 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a42ffd700 1 --2- 172.21.15.157:0/1078187197 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a440fd5d0 0x7f8a44107e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.138 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a42ffd700 1 -- 172.21.15.157:0/1078187197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a440fdf70 msgr2=0x7f8a441083c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.139 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a42ffd700 1 --2- 172.21.15.157:0/1078187197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a440fdf70 0x7f8a441083c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.140 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.119+0000 7f8a42ffd700 1 -- 172.21.15.157:0/1078187197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a38005040 con 0x7f8a440f7d60 2021-10-08T19:26:53.140 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.120+0000 7f8a42ffd700 1 --2- 172.21.15.157:0/1078187197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440f7d60 0x7f8a44107940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009c20 tx=0x7f8a34009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:53.141 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.120+0000 7f8a277fe700 1 -- 172.21.15.157:0/1078187197 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3401a070 con 0x7f8a440f7d60 2021-10-08T19:26:53.141 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.120+0000 7f8a277fe700 1 -- 172.21.15.157:0/1078187197 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f8a340095b0 con 0x7f8a440f7d60 2021-10-08T19:26:53.141 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.120+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a34005040 con 0x7f8a440f7d60 2021-10-08T19:26:53.142 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.120+0000 7f8a277fe700 1 -- 172.21.15.157:0/1078187197 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3401fa50 con 0x7f8a440f7d60 2021-10-08T19:26:53.142 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.120+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a44117980 con 0x7f8a440f7d60 2021-10-08T19:26:53.143 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.121+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a44047b50 con 0x7f8a440f7d60 2021-10-08T19:26:53.143 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.121+0000 7f8a277fe700 1 -- 172.21.15.157:0/1078187197 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f8a34025020 con 0x7f8a440f7d60 2021-10-08T19:26:53.147 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.121+0000 7f8a277fe700 1 --2- 172.21.15.157:0/1078187197 >> v2:172.21.15.157:6800/1475557172 conn(0x7f8a2c0635b0 0x7f8a2c065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:53.147 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.122+0000 7f8a277fe700 1 -- 172.21.15.157:0/1078187197 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6281+0+0 (secure 0 0 0) 0x7f8a34080c00 con 0x7f8a440f7d60 2021-10-08T19:26:53.148 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.122+0000 7f8a427fc700 1 --2- 172.21.15.157:0/1078187197 >> v2:172.21.15.157:6800/1475557172 conn(0x7f8a2c0635b0 0x7f8a2c065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:53.148 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.122+0000 7f8a427fc700 1 --2- 172.21.15.157:0/1078187197 >> v2:172.21.15.157:6800/1475557172 conn(0x7f8a2c0635b0 0x7f8a2c065a60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a44062210 tx=0x7f8a3800b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:53.148 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.126+0000 7f8a277fe700 1 -- 172.21.15.157:0/1078187197 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f8a34086020 con 0x7f8a440f7d60 2021-10-08T19:26:53.149 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-10-08T19:26:53.150 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:52 smithi196 conmon[62976]: t=2021-10-08T19:26:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-10-08T19:26:53.150 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-10-08T19:26:53.150 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-10-08T19:26:53.151 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2021-10-08T19:26:53.151 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-10-08T19:26:53.151 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-10-08T19:26:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.283+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8a44061fe0 con 0x7f8a440f7d60 2021-10-08T19:26:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.284+0000 7f8a277fe700 1 -- 172.21.15.157:0/1078187197 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a340537b0 con 0x7f8a440f7d60 2021-10-08T19:26:53.287 INFO:teuthology.orchestra.run.smithi157.stdout:219043332119 2021-10-08T19:26:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.285+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 >> v2:172.21.15.157:6800/1475557172 conn(0x7f8a2c0635b0 msgr2=0x7f8a2c065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.285+0000 7f8a49589700 1 --2- 172.21.15.157:0/1078187197 >> v2:172.21.15.157:6800/1475557172 conn(0x7f8a2c0635b0 0x7f8a2c065a60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a44062210 tx=0x7f8a3800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.285+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440f7d60 msgr2=0x7f8a44107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.285+0000 7f8a49589700 1 --2- 172.21.15.157:0/1078187197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440f7d60 0x7f8a44107940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009c20 tx=0x7f8a34009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.286+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 shutdown_connections 2021-10-08T19:26:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.286+0000 7f8a49589700 1 --2- 172.21.15.157:0/1078187197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a440fdf70 0x7f8a441083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.286+0000 7f8a49589700 1 --2- 172.21.15.157:0/1078187197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a440f7d60 0x7f8a44107940 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.286+0000 7f8a49589700 1 --2- 172.21.15.157:0/1078187197 >> v2:172.21.15.157:6800/1475557172 conn(0x7f8a2c0635b0 0x7f8a2c065a60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.286+0000 7f8a49589700 1 --2- 172.21.15.157:0/1078187197 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a440fd5d0 0x7f8a44107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.286+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 >> 172.21.15.157:0/1078187197 conn(0x7f8a4406f330 msgr2=0x7f8a440f6770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.286+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 shutdown_connections 2021-10-08T19:26:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:53.286+0000 7f8a49589700 1 -- 172.21.15.157:0/1078187197 wait complete. 2021-10-08T19:26:53.317 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:26:52 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:26:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:53.396 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:53 smithi196 bash[64526]: Copying blob sha256:3589a6efd9ce96b2f2218a80bacb84f60d5e584d024023617b0f56b87fe798c3 2021-10-08T19:26:53.396 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-10-08T19:26:53.397 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-10-08T19:26:53.397 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-10-08T19:26:53.656 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:53 smithi196 bash[64526]: Copying blob sha256:49a2d53aa1af115e87f7e23a7fe4b7a3e12304d37982fb6528b035d0f68a3b56 2021-10-08T19:26:53.656 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:53 smithi196 bash[64526]: Copying blob sha256:190160031744b0810999dd6f293478be0b41524654c70782cf09437095430f2f 2021-10-08T19:26:53.657 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-10-08T19:26:53.657 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-10-08T19:26:53.657 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-10-08T19:26:53.658 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-10-08T19:26:53.658 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-10-08T19:26:53.901 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332115 got 219043332119 for osd.7 2021-10-08T19:26:53.901 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-10-08T19:26:53.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:26:53.933 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:53 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:53.933 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:53 smithi196 ceph-mon[34258]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:53.933 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:53 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:26:53.934 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:53 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:26:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:53.934 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1078187197' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:26:53.934 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:53 smithi196 ceph-mon[34258]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48 B/s, 1 objects/s recovering 2021-10-08T19:26:53.934 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-10-08T19:26:53.935 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-10-08T19:26:53.935 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-10-08T19:26:53.935 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-10-08T19:26:53.935 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-10-08T19:26:53.936 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-10-08T19:26:54.176 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:54.184 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:53 smithi196 conmon[62976]: t=2021-10-08T19:26:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-10-08T19:26:54.184 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-10-08T19:26:54.185 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-10-08T19:26:54.185 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-10-08T19:26:54.185 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-10-08T19:26:54.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:54.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:54.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:26:54.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:26:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:54.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1078187197' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:26:54.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[32847]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48 B/s, 1 objects/s recovering 2021-10-08T19:26:54.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:54.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[42114]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:54.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:26:54.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:26:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:54.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1078187197' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:26:54.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:53 smithi157 ceph-mon[42114]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48 B/s, 1 objects/s recovering 2021-10-08T19:26:54.479 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-10-08T19:26:54.480 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-10-08T19:26:54.480 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-10-08T19:26:54.481 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-10-08T19:26:54.481 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-10-08T19:26:54.481 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-10-08T19:26:54.746 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-10-08T19:26:54.746 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-10-08T19:26:54.755 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-10-08T19:26:54.756 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-10-08T19:26:54.756 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-10-08T19:26:55.031 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-10-08T19:26:55.032 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-10-08T19:26:55.032 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-10-08T19:26:55.033 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-10-08T19:26:55.033 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:54 smithi196 conmon[62976]: t=2021-10-08T19:26:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-10-08T19:26:55.034 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-10-08T19:26:55.349 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-10-08T19:26:55.349 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-10-08T19:26:55.349 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-10-08T19:26:55.350 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-10-08T19:26:55.350 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-10-08T19:26:55.621 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-10-08T19:26:55.624 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-10-08T19:26:55.624 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-10-08T19:26:55.624 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-10-08T19:26:55.625 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-10-08T19:26:55.625 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-10-08T19:26:55.625 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-10-08T19:26:55.625 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-10-08T19:26:55.626 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-10-08T19:26:55.626 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-10-08T19:26:55.626 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing HooksService" logger=server 2021-10-08T19:26:55.626 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-10-08T19:26:55.627 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-10-08T19:26:55.627 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-10-08T19:26:55.627 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-10-08T19:26:55.627 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-10-08T19:26:55.627 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-10-08T19:26:55.628 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-10-08T19:26:55.628 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-10-08T19:26:55.628 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-10-08T19:26:55.628 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing LoginService" logger=server 2021-10-08T19:26:55.633 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing SearchService" logger=server 2021-10-08T19:26:55.633 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing TracingService" logger=server 2021-10-08T19:26:55.633 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-10-08T19:26:55.633 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-10-08T19:26:55.634 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-10-08T19:26:55.634 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-10-08T19:26:55.634 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-10-08T19:26:55.634 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-10-08T19:26:55.635 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-10-08T19:26:55.635 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="Initializing Stream Manager" 2021-10-08T19:26:55.635 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:26:55 smithi196 conmon[62976]: t=2021-10-08T19:26:55+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-10-08T19:26:55.718 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.707+0000 7fec63fff700 1 -- 172.21.15.157:0/1276814554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640fe5c0 msgr2=0x7fec640fe990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:55.719 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.707+0000 7fec63fff700 1 --2- 172.21.15.157:0/1276814554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640fe5c0 0x7fec640fe990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec54004620 tx=0x7fec54009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:55.719 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.707+0000 7fec63fff700 1 -- 172.21.15.157:0/1276814554 shutdown_connections 2021-10-08T19:26:55.720 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.707+0000 7fec63fff700 1 --2- 172.21.15.157:0/1276814554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec640f8dd0 0x7fec64105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:55.720 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.707+0000 7fec63fff700 1 --2- 172.21.15.157:0/1276814554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640fe5c0 0x7fec640fe990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:55.721 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.707+0000 7fec63fff700 1 --2- 172.21.15.157:0/1276814554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec640feed0 0x7fec640f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:55.722 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.707+0000 7fec63fff700 1 -- 172.21.15.157:0/1276814554 >> 172.21.15.157:0/1276814554 conn(0x7fec64070520 msgr2=0x7fec64070920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:55.722 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.707+0000 7fec63fff700 1 -- 172.21.15.157:0/1276814554 shutdown_connections 2021-10-08T19:26:55.723 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.707+0000 7fec63fff700 1 -- 172.21.15.157:0/1276814554 wait complete. 2021-10-08T19:26:55.723 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec63fff700 1 Processor -- start 2021-10-08T19:26:55.723 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec63fff700 1 -- start start 2021-10-08T19:26:55.724 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec63fff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640f8dd0 0x7fec6406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:55.724 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec63fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec640fe5c0 0x7fec6406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:55.725 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec63fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec640feed0 0x7fec64116da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:55.725 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec63fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6406c4f0 con 0x7fec640feed0 2021-10-08T19:26:55.725 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec63fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec641172e0 con 0x7fec640fe5c0 2021-10-08T19:26:55.726 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec63fff700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec64117450 con 0x7fec640f8dd0 2021-10-08T19:26:55.726 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec62ffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640f8dd0 0x7fec6406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:55.727 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec62ffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640f8dd0 0x7fec6406b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50482/0 (socket says 172.21.15.157:50482) 2021-10-08T19:26:55.728 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec62ffd700 1 -- 172.21.15.157:0/1986091061 learned_addr learned my addr 172.21.15.157:0/1986091061 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:55.730 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec637fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec640feed0 0x7fec64116da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:55.731 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.708+0000 7fec627fc700 1 --2- 172.21.15.157:0/1986091061 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec640fe5c0 0x7fec6406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:55.731 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec62ffd700 1 -- 172.21.15.157:0/1986091061 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec640fe5c0 msgr2=0x7fec6406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:55.731 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec62ffd700 1 --2- 172.21.15.157:0/1986091061 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec640fe5c0 0x7fec6406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:55.732 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec62ffd700 1 -- 172.21.15.157:0/1986091061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec640feed0 msgr2=0x7fec64116da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:55.732 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec62ffd700 1 --2- 172.21.15.157:0/1986091061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec640feed0 0x7fec64116da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:55.733 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec62ffd700 1 -- 172.21.15.157:0/1986091061 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58005040 con 0x7fec640f8dd0 2021-10-08T19:26:55.733 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec62ffd700 1 --2- 172.21.15.157:0/1986091061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640f8dd0 0x7fec6406b6c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec54014470 tx=0x7fec54009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:55.733 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec4b7fe700 1 -- 172.21.15.157:0/1986091061 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400e070 con 0x7fec640f8dd0 2021-10-08T19:26:55.734 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec54005040 con 0x7fec640f8dd0 2021-10-08T19:26:55.734 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec4b7fe700 1 -- 172.21.15.157:0/1986091061 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fec54007920 con 0x7fec640f8dd0 2021-10-08T19:26:55.735 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec4b7fe700 1 -- 172.21.15.157:0/1986091061 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5401a070 con 0x7fec640f8dd0 2021-10-08T19:26:55.735 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.709+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec64117a50 con 0x7fec640f8dd0 2021-10-08T19:26:55.735 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.710+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec64072040 con 0x7fec640f8dd0 2021-10-08T19:26:55.736 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.711+0000 7fec4b7fe700 1 -- 172.21.15.157:0/1986091061 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fec54025020 con 0x7fec640f8dd0 2021-10-08T19:26:55.736 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.711+0000 7fec4b7fe700 1 --2- 172.21.15.157:0/1986091061 >> v2:172.21.15.157:6800/1475557172 conn(0x7fec4c0635a0 0x7fec4c065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:55.736 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.711+0000 7fec4b7fe700 1 -- 172.21.15.157:0/1986091061 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6281+0+0 (secure 0 0 0) 0x7fec54080390 con 0x7fec640f8dd0 2021-10-08T19:26:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.711+0000 7fec627fc700 1 --2- 172.21.15.157:0/1986091061 >> v2:172.21.15.157:6800/1475557172 conn(0x7fec4c0635a0 0x7fec4c065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.711+0000 7fec627fc700 1 --2- 172.21.15.157:0/1986091061 >> v2:172.21.15.157:6800/1475557172 conn(0x7fec4c0635a0 0x7fec4c065a50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fec6406d0c0 tx=0x7fec5800b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.715+0000 7fec4b7fe700 1 -- 172.21.15.157:0/1986091061 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fec54052f40 con 0x7fec640f8dd0 2021-10-08T19:26:55.869 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.869+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 --> v2:172.21.15.157:6800/1475557172 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec64047380 con 0x7fec4c0635a0 2021-10-08T19:26:55.880 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.879+0000 7fec4b7fe700 1 -- 172.21.15.157:0/1986091061 <== mgr.24490 v2:172.21.15.157:6800/1475557172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359740 (secure 0 0 0) 0x7fec64047380 con 0x7fec4c0635a0 2021-10-08T19:26:55.885 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:26:55.896 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 >> v2:172.21.15.157:6800/1475557172 conn(0x7fec4c0635a0 msgr2=0x7fec4c065a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:55.896 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 --2- 172.21.15.157:0/1986091061 >> v2:172.21.15.157:6800/1475557172 conn(0x7fec4c0635a0 0x7fec4c065a50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fec6406d0c0 tx=0x7fec5800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:55.897 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640f8dd0 msgr2=0x7fec6406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:55.897 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 --2- 172.21.15.157:0/1986091061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640f8dd0 0x7fec6406b6c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec54014470 tx=0x7fec54009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:55.898 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 shutdown_connections 2021-10-08T19:26:55.898 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 --2- 172.21.15.157:0/1986091061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec640feed0 0x7fec64116da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:55.899 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 --2- 172.21.15.157:0/1986091061 >> v2:172.21.15.157:6800/1475557172 conn(0x7fec4c0635a0 0x7fec4c065a50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:55.899 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 --2- 172.21.15.157:0/1986091061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640f8dd0 0x7fec6406b6c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:55.900 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 --2- 172.21.15.157:0/1986091061 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec640fe5c0 0x7fec6406bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:55.901 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 >> 172.21.15.157:0/1986091061 conn(0x7fec64070520 msgr2=0x7fec640fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:55.901 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 shutdown_connections 2021-10-08T19:26:55.902 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:55.882+0000 7fec63fff700 1 -- 172.21.15.157:0/1986091061 wait complete. 2021-10-08T19:26:55.902 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2021-10-08T19:26:56.366 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:55 smithi196 bash[64526]: Copying config sha256:e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87 2021-10-08T19:26:56.367 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:56 smithi196 bash[64526]: Writing manifest to image destination 2021-10-08T19:26:56.367 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:56 smithi196 bash[64526]: Storing signatures 2021-10-08T19:26:56.592 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2021-10-08T19:26:55.643950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":1054,"num_read_kb":899,"num_write":607,"num_write_kb":2457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1771682,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":620,"ondisk_log_size":620,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":53452,"kb_used_data":7052,"kb_used_omap":0,"kb_used_meta":46336,"kb_avail":749907764,"statfs":{"total":767960285184,"available":767905550336,"internally_reserved":0,"allocated":7221248,"data_stored":3884839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47448064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002826"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640294+0000","last_change":"2021-10-08T19:25:13.234037+0000","last_active":"2021-10-08T19:26:36.640294+0000","last_peered":"2021-10-08T19:26:36.640294+0000","last_clean":"2021-10-08T19:26:36.640294+0000","last_became_active":"2021-10-08T19:25:13.233702+0000","last_became_peered":"2021-10-08T19:25:13.233702+0000","last_unstale":"2021-10-08T19:26:36.640294+0000","last_undegraded":"2021-10-08T19:26:36.640294+0000","last_fullsized":"2021-10-08T19:26:36.640294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.637715+0000","last_change":"2021-10-08T19:25:10.812695+0000","last_active":"2021-10-08T19:26:36.637715+0000","last_peered":"2021-10-08T19:26:36.637715+0000","last_clean":"2021-10-08T19:26:36.637715+0000","last_became_active":"2021-10-08T19:25:10.812427+0000","last_became_peered":"2021-10-08T19:25:10.812427+0000","last_unstale":"2021-10-08T19:26:36.637715+0000","last_undegraded":"2021-10-08T19:26:36.637715+0000","last_fullsized":"2021-10-08T19:26:36.637715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633764+0000","last_change":"2021-10-08T19:25:06.793128+0000","last_active":"2021-10-08T19:26:36.633764+0000","last_peered":"2021-10-08T19:26:36.633764+0000","last_clean":"2021-10-08T19:26:36.633764+0000","last_became_active":"2021-10-08T19:25:06.792869+0000","last_became_peered":"2021-10-08T19:25:06.792869+0000","last_unstale":"2021-10-08T19:26:36.633764+0000","last_undegraded":"2021-10-08T19:26:36.633764+0000","last_fullsized":"2021-10-08T19:26:36.633764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"65'15","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640535+0000","last_change":"2021-10-08T19:25:08.798563+0000","last_active":"2021-10-08T19:26:36.640535+0000","last_peered":"2021-10-08T19:26:36.640535+0000","last_clean":"2021-10-08T19:26:36.640535+0000","last_became_active":"2021-10-08T19:25:08.797470+0000","last_became_peered":"2021-10-08T19:25:08.797470+0000","last_unstale":"2021-10-08T19:26:36.640535+0000","last_undegraded":"2021-10-08T19:26:36.640535+0000","last_fullsized":"2021-10-08T19:26:36.640535+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.637990+0000","last_change":"2021-10-08T19:25:12.810056+0000","last_active":"2021-10-08T19:26:36.637990+0000","last_peered":"2021-10-08T19:26:36.637990+0000","last_clean":"2021-10-08T19:26:36.637990+0000","last_became_active":"2021-10-08T19:25:12.809779+0000","last_became_peered":"2021-10-08T19:25:12.809779+0000","last_unstale":"2021-10-08T19:26:36.637990+0000","last_undegraded":"2021-10-08T19:26:36.637990+0000","last_fullsized":"2021-10-08T19:26:36.637990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.643919+0000","last_change":"2021-10-08T19:25:10.797530+0000","last_active":"2021-10-08T19:26:36.643919+0000","last_peered":"2021-10-08T19:26:36.643919+0000","last_clean":"2021-10-08T19:26:36.643919+0000","last_became_active":"2021-10-08T19:25:10.797285+0000","last_became_peered":"2021-10-08T19:25:10.797285+0000","last_unstale":"2021-10-08T19:26:36.643919+0000","last_undegraded":"2021-10-08T19:26:36.643919+0000","last_fullsized":"2021-10-08T19:26:36.643919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641488+0000","last_change":"2021-10-08T19:25:06.794560+0000","last_active":"2021-10-08T19:26:36.641488+0000","last_peered":"2021-10-08T19:26:36.641488+0000","last_clean":"2021-10-08T19:26:36.641488+0000","last_became_active":"2021-10-08T19:25:06.794255+0000","last_became_peered":"2021-10-08T19:25:06.794255+0000","last_unstale":"2021-10-08T19:26:36.641488+0000","last_undegraded":"2021-10-08T19:26:36.641488+0000","last_fullsized":"2021-10-08T19:26:36.641488+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638048+0000","last_change":"2021-10-08T19:25:08.797795+0000","last_active":"2021-10-08T19:26:36.638048+0000","last_peered":"2021-10-08T19:26:36.638048+0000","last_clean":"2021-10-08T19:26:36.638048+0000","last_became_active":"2021-10-08T19:25:08.797492+0000","last_became_peered":"2021-10-08T19:25:08.797492+0000","last_unstale":"2021-10-08T19:26:36.638048+0000","last_undegraded":"2021-10-08T19:26:36.638048+0000","last_fullsized":"2021-10-08T19:26:36.638048+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635180+0000","last_change":"2021-10-08T19:25:12.808757+0000","last_active":"2021-10-08T19:26:36.635180+0000","last_peered":"2021-10-08T19:26:36.635180+0000","last_clean":"2021-10-08T19:26:36.635180+0000","last_became_active":"2021-10-08T19:25:12.808578+0000","last_became_peered":"2021-10-08T19:25:12.808578+0000","last_unstale":"2021-10-08T19:26:36.635180+0000","last_undegraded":"2021-10-08T19:26:36.635180+0000","last_fullsized":"2021-10-08T19:26:36.635180+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639566+0000","last_change":"2021-10-08T19:25:10.803470+0000","last_active":"2021-10-08T19:26:36.639566+0000","last_peered":"2021-10-08T19:26:36.639566+0000","last_clean":"2021-10-08T19:26:36.639566+0000","last_became_active":"2021-10-08T19:25:10.803195+0000","last_became_peered":"2021-10-08T19:25:10.803195+0000","last_unstale":"2021-10-08T19:26:36.639566+0000","last_undegraded":"2021-10-08T19:26:36.639566+0000","last_fullsized":"2021-10-08T19:26:36.639566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639585+0000","last_change":"2021-10-08T19:25:06.800415+0000","last_active":"2021-10-08T19:26:36.639585+0000","last_peered":"2021-10-08T19:26:36.639585+0000","last_clean":"2021-10-08T19:26:36.639585+0000","last_became_active":"2021-10-08T19:25:06.799849+0000","last_became_peered":"2021-10-08T19:25:06.799849+0000","last_unstale":"2021-10-08T19:26:36.639585+0000","last_undegraded":"2021-10-08T19:26:36.639585+0000","last_fullsized":"2021-10-08T19:26:36.639585+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"65'5","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638735+0000","last_change":"2021-10-08T19:25:08.798935+0000","last_active":"2021-10-08T19:26:36.638735+0000","last_peered":"2021-10-08T19:26:36.638735+0000","last_clean":"2021-10-08T19:26:36.638735+0000","last_became_active":"2021-10-08T19:25:08.798623+0000","last_became_peered":"2021-10-08T19:25:08.798623+0000","last_unstale":"2021-10-08T19:26:36.638735+0000","last_undegraded":"2021-10-08T19:26:36.638735+0000","last_fullsized":"2021-10-08T19:26:36.638735+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633867+0000","last_change":"2021-10-08T19:25:12.811085+0000","last_active":"2021-10-08T19:26:36.633867+0000","last_peered":"2021-10-08T19:26:36.633867+0000","last_clean":"2021-10-08T19:26:36.633867+0000","last_became_active":"2021-10-08T19:25:12.810513+0000","last_became_peered":"2021-10-08T19:25:12.810513+0000","last_unstale":"2021-10-08T19:26:36.633867+0000","last_undegraded":"2021-10-08T19:26:36.633867+0000","last_fullsized":"2021-10-08T19:26:36.633867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635473+0000","last_change":"2021-10-08T19:25:10.808890+0000","last_active":"2021-10-08T19:26:36.635473+0000","last_peered":"2021-10-08T19:26:36.635473+0000","last_clean":"2021-10-08T19:26:36.635473+0000","last_became_active":"2021-10-08T19:25:10.808621+0000","last_became_peered":"2021-10-08T19:25:10.808621+0000","last_unstale":"2021-10-08T19:26:36.635473+0000","last_undegraded":"2021-10-08T19:26:36.635473+0000","last_fullsized":"2021-10-08T19:26:36.635473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638615+0000","last_change":"2021-10-08T19:25:06.798516+0000","last_active":"2021-10-08T19:26:36.638615+0000","last_peered":"2021-10-08T19:26:36.638615+0000","last_clean":"2021-10-08T19:26:36.638615+0000","last_became_active":"2021-10-08T19:25:06.798179+0000","last_became_peered":"2021-10-08T19:25:06.798179+0000","last_unstale":"2021-10-08T19:26:36.638615+0000","last_undegraded":"2021-10-08T19:26:36.638615+0000","last_fullsized":"2021-10-08T19:26:36.638615+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638097+0000","last_change":"2021-10-08T19:25:08.792044+0000","last_active":"2021-10-08T19:26:36.638097+0000","last_peered":"2021-10-08T19:26:36.638097+0000","last_clean":"2021-10-08T19:26:36.638097+0000","last_became_active":"2021-10-08T19:25:08.791781+0000","last_became_peered":"2021-10-08T19:25:08.791781+0000","last_unstale":"2021-10-08T19:26:36.638097+0000","last_undegraded":"2021-10-08T19:26:36.638097+0000","last_fullsized":"2021-10-08T19:26:36.638097+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641850+0000","last_change":"2021-10-08T19:25:13.232350+0000","last_active":"2021-10-08T19:26:36.641850+0000","last_peered":"2021-10-08T19:26:36.641850+0000","last_clean":"2021-10-08T19:26:36.641850+0000","last_became_active":"2021-10-08T19:25:13.231890+0000","last_became_peered":"2021-10-08T19:25:13.231890+0000","last_unstale":"2021-10-08T19:26:36.641850+0000","last_undegraded":"2021-10-08T19:26:36.641850+0000","last_fullsized":"2021-10-08T19:26:36.641850+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638930+0000","last_change":"2021-10-08T19:25:10.809689+0000","last_active":"2021-10-08T19:26:36.638930+0000","last_peered":"2021-10-08T19:26:36.638930+0000","last_clean":"2021-10-08T19:26:36.638930+0000","last_became_active":"2021-10-08T19:25:10.805244+0000","last_became_peered":"2021-10-08T19:25:10.805244+0000","last_unstale":"2021-10-08T19:26:36.638930+0000","last_undegraded":"2021-10-08T19:26:36.638930+0000","last_fullsized":"2021-10-08T19:26:36.638930+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640448+0000","last_change":"2021-10-08T19:25:06.797089+0000","last_active":"2021-10-08T19:26:36.640448+0000","last_peered":"2021-10-08T19:26:36.640448+0000","last_clean":"2021-10-08T19:26:36.640448+0000","last_became_active":"2021-10-08T19:25:06.796824+0000","last_became_peered":"2021-10-08T19:25:06.796824+0000","last_unstale":"2021-10-08T19:26:36.640448+0000","last_undegraded":"2021-10-08T19:26:36.640448+0000","last_fullsized":"2021-10-08T19:26:36.640448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"65'12","reported_seq":62,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:37.735568+0000","last_change":"2021-10-08T19:26:37.735568+0000","last_active":"2021-10-08T19:26:37.735568+0000","last_peered":"2021-10-08T19:26:37.735568+0000","last_clean":"2021-10-08T19:26:37.735568+0000","last_became_active":"2021-10-08T19:26:37.645200+0000","last_became_peered":"2021-10-08T19:26:37.645200+0000","last_unstale":"2021-10-08T19:26:37.735568+0000","last_undegraded":"2021-10-08T19:26:37.735568+0000","last_fullsized":"2021-10-08T19:26:37.735568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640428+0000","last_change":"2021-10-08T19:25:13.232166+0000","last_active":"2021-10-08T19:26:36.640428+0000","last_peered":"2021-10-08T19:26:36.640428+0000","last_clean":"2021-10-08T19:26:36.640428+0000","last_became_active":"2021-10-08T19:25:13.231847+0000","last_became_peered":"2021-10-08T19:25:13.231847+0000","last_unstale":"2021-10-08T19:26:36.640428+0000","last_undegraded":"2021-10-08T19:26:36.640428+0000","last_fullsized":"2021-10-08T19:26:36.640428+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645007+0000","last_change":"2021-10-08T19:25:10.808029+0000","last_active":"2021-10-08T19:26:36.645007+0000","last_peered":"2021-10-08T19:26:36.645007+0000","last_clean":"2021-10-08T19:26:36.645007+0000","last_became_active":"2021-10-08T19:25:10.807755+0000","last_became_peered":"2021-10-08T19:25:10.807755+0000","last_unstale":"2021-10-08T19:26:36.645007+0000","last_undegraded":"2021-10-08T19:26:36.645007+0000","last_fullsized":"2021-10-08T19:26:36.645007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642455+0000","last_change":"2021-10-08T19:25:06.795910+0000","last_active":"2021-10-08T19:26:36.642455+0000","last_peered":"2021-10-08T19:26:36.642455+0000","last_clean":"2021-10-08T19:26:36.642455+0000","last_became_active":"2021-10-08T19:25:06.795604+0000","last_became_peered":"2021-10-08T19:25:06.795604+0000","last_unstale":"2021-10-08T19:26:36.642455+0000","last_undegraded":"2021-10-08T19:26:36.642455+0000","last_fullsized":"2021-10-08T19:26:36.642455+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"65'15","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636399+0000","last_change":"2021-10-08T19:25:08.800863+0000","last_active":"2021-10-08T19:26:36.636399+0000","last_peered":"2021-10-08T19:26:36.636399+0000","last_clean":"2021-10-08T19:26:36.636399+0000","last_became_active":"2021-10-08T19:25:08.800613+0000","last_became_peered":"2021-10-08T19:25:08.800613+0000","last_unstale":"2021-10-08T19:26:36.636399+0000","last_undegraded":"2021-10-08T19:26:36.636399+0000","last_fullsized":"2021-10-08T19:26:36.636399+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644901+0000","last_change":"2021-10-08T19:25:12.810864+0000","last_active":"2021-10-08T19:26:36.644901+0000","last_peered":"2021-10-08T19:26:36.644901+0000","last_clean":"2021-10-08T19:26:36.644901+0000","last_became_active":"2021-10-08T19:25:12.810357+0000","last_became_peered":"2021-10-08T19:25:12.810357+0000","last_unstale":"2021-10-08T19:26:36.644901+0000","last_undegraded":"2021-10-08T19:26:36.644901+0000","last_fullsized":"2021-10-08T19:26:36.644901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.634029+0000","last_change":"2021-10-08T19:25:10.800055+0000","last_active":"2021-10-08T19:26:36.634029+0000","last_peered":"2021-10-08T19:26:36.634029+0000","last_clean":"2021-10-08T19:26:36.634029+0000","last_became_active":"2021-10-08T19:25:10.799732+0000","last_became_peered":"2021-10-08T19:25:10.799732+0000","last_unstale":"2021-10-08T19:26:36.634029+0000","last_undegraded":"2021-10-08T19:26:36.634029+0000","last_fullsized":"2021-10-08T19:26:36.634029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640199+0000","last_change":"2021-10-08T19:25:06.795274+0000","last_active":"2021-10-08T19:26:36.640199+0000","last_peered":"2021-10-08T19:26:36.640199+0000","last_clean":"2021-10-08T19:26:36.640199+0000","last_became_active":"2021-10-08T19:25:06.794991+0000","last_became_peered":"2021-10-08T19:25:06.794991+0000","last_unstale":"2021-10-08T19:26:36.640199+0000","last_undegraded":"2021-10-08T19:26:36.640199+0000","last_fullsized":"2021-10-08T19:26:36.640199+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"65'11","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642628+0000","last_change":"2021-10-08T19:25:08.800038+0000","last_active":"2021-10-08T19:26:36.642628+0000","last_peered":"2021-10-08T19:26:36.642628+0000","last_clean":"2021-10-08T19:26:36.642628+0000","last_became_active":"2021-10-08T19:25:08.799677+0000","last_became_peered":"2021-10-08T19:25:08.799677+0000","last_unstale":"2021-10-08T19:26:36.642628+0000","last_undegraded":"2021-10-08T19:26:36.642628+0000","last_fullsized":"2021-10-08T19:26:36.642628+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"65'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639333+0000","last_change":"2021-10-08T19:25:12.806228+0000","last_active":"2021-10-08T19:26:36.639333+0000","last_peered":"2021-10-08T19:26:36.639333+0000","last_clean":"2021-10-08T19:26:36.639333+0000","last_became_active":"2021-10-08T19:25:12.805954+0000","last_became_peered":"2021-10-08T19:25:12.805954+0000","last_unstale":"2021-10-08T19:26:36.639333+0000","last_undegraded":"2021-10-08T19:26:36.639333+0000","last_fullsized":"2021-10-08T19:26:36.639333+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"65'11","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:45.498724+0000","last_change":"2021-10-08T19:25:10.811115+0000","last_active":"2021-10-08T19:26:45.498724+0000","last_peered":"2021-10-08T19:26:45.498724+0000","last_clean":"2021-10-08T19:26:45.498724+0000","last_became_active":"2021-10-08T19:25:10.809828+0000","last_became_peered":"2021-10-08T19:25:10.809828+0000","last_unstale":"2021-10-08T19:26:45.498724+0000","last_undegraded":"2021-10-08T19:26:45.498724+0000","last_fullsized":"2021-10-08T19:26:45.498724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635049+0000","last_change":"2021-10-08T19:25:06.798405+0000","last_active":"2021-10-08T19:26:36.635049+0000","last_peered":"2021-10-08T19:26:36.635049+0000","last_clean":"2021-10-08T19:26:36.635049+0000","last_became_active":"2021-10-08T19:25:06.798113+0000","last_became_peered":"2021-10-08T19:25:06.798113+0000","last_unstale":"2021-10-08T19:26:36.635049+0000","last_undegraded":"2021-10-08T19:26:36.635049+0000","last_fullsized":"2021-10-08T19:26:36.635049+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"65'10","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633958+0000","last_change":"2021-10-08T19:25:09.297700+0000","last_active":"2021-10-08T19:26:36.633958+0000","last_peered":"2021-10-08T19:26:36.633958+0000","last_clean":"2021-10-08T19:26:36.633958+0000","last_became_active":"2021-10-08T19:25:09.297395+0000","last_became_peered":"2021-10-08T19:25:09.297395+0000","last_unstale":"2021-10-08T19:26:36.633958+0000","last_undegraded":"2021-10-08T19:26:36.633958+0000","last_fullsized":"2021-10-08T19:26:36.633958+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640585+0000","last_change":"2021-10-08T19:25:13.234270+0000","last_active":"2021-10-08T19:26:36.640585+0000","last_peered":"2021-10-08T19:26:36.640585+0000","last_clean":"2021-10-08T19:26:36.640585+0000","last_became_active":"2021-10-08T19:25:13.233880+0000","last_became_peered":"2021-10-08T19:25:13.233880+0000","last_unstale":"2021-10-08T19:26:36.640585+0000","last_undegraded":"2021-10-08T19:26:36.640585+0000","last_fullsized":"2021-10-08T19:26:36.640585+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639600+0000","last_change":"2021-10-08T19:25:10.802684+0000","last_active":"2021-10-08T19:26:36.639600+0000","last_peered":"2021-10-08T19:26:36.639600+0000","last_clean":"2021-10-08T19:26:36.639600+0000","last_became_active":"2021-10-08T19:25:10.802371+0000","last_became_peered":"2021-10-08T19:25:10.802371+0000","last_unstale":"2021-10-08T19:26:36.639600+0000","last_undegraded":"2021-10-08T19:26:36.639600+0000","last_fullsized":"2021-10-08T19:26:36.639600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"57'1","reported_seq":31,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642784+0000","last_change":"2021-10-08T19:25:06.801424+0000","last_active":"2021-10-08T19:26:36.642784+0000","last_peered":"2021-10-08T19:26:36.642784+0000","last_clean":"2021-10-08T19:26:36.642784+0000","last_became_active":"2021-10-08T19:25:06.801103+0000","last_became_peered":"2021-10-08T19:25:06.801103+0000","last_unstale":"2021-10-08T19:26:36.642784+0000","last_undegraded":"2021-10-08T19:26:36.642784+0000","last_fullsized":"2021-10-08T19:26:36.642784+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"65'11","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640428+0000","last_change":"2021-10-08T19:25:09.297862+0000","last_active":"2021-10-08T19:26:36.640428+0000","last_peered":"2021-10-08T19:26:36.640428+0000","last_clean":"2021-10-08T19:26:36.640428+0000","last_became_active":"2021-10-08T19:25:09.297573+0000","last_became_peered":"2021-10-08T19:25:09.297573+0000","last_unstale":"2021-10-08T19:26:36.640428+0000","last_undegraded":"2021-10-08T19:26:36.640428+0000","last_fullsized":"2021-10-08T19:26:36.640428+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638367+0000","last_change":"2021-10-08T19:25:12.802665+0000","last_active":"2021-10-08T19:26:36.638367+0000","last_peered":"2021-10-08T19:26:36.638367+0000","last_clean":"2021-10-08T19:26:36.638367+0000","last_became_active":"2021-10-08T19:25:12.802363+0000","last_became_peered":"2021-10-08T19:25:12.802363+0000","last_unstale":"2021-10-08T19:26:36.638367+0000","last_undegraded":"2021-10-08T19:26:36.638367+0000","last_fullsized":"2021-10-08T19:26:36.638367+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642664+0000","last_change":"2021-10-08T19:25:10.810656+0000","last_active":"2021-10-08T19:26:36.642664+0000","last_peered":"2021-10-08T19:26:36.642664+0000","last_clean":"2021-10-08T19:26:36.642664+0000","last_became_active":"2021-10-08T19:25:10.809891+0000","last_became_peered":"2021-10-08T19:25:10.809891+0000","last_unstale":"2021-10-08T19:26:36.642664+0000","last_undegraded":"2021-10-08T19:26:36.642664+0000","last_fullsized":"2021-10-08T19:26:36.642664+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635987+0000","last_change":"2021-10-08T19:25:06.796997+0000","last_active":"2021-10-08T19:26:36.635987+0000","last_peered":"2021-10-08T19:26:36.635987+0000","last_clean":"2021-10-08T19:26:36.635987+0000","last_became_active":"2021-10-08T19:25:06.796724+0000","last_became_peered":"2021-10-08T19:25:06.796724+0000","last_unstale":"2021-10-08T19:26:36.635987+0000","last_undegraded":"2021-10-08T19:26:36.635987+0000","last_fullsized":"2021-10-08T19:26:36.635987+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"65'4","reported_seq":39,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:37.908430+0000","last_change":"2021-10-08T19:26:37.908430+0000","last_active":"2021-10-08T19:26:37.908430+0000","last_peered":"2021-10-08T19:26:37.908430+0000","last_clean":"2021-10-08T19:26:37.908430+0000","last_became_active":"2021-10-08T19:26:37.645534+0000","last_became_peered":"2021-10-08T19:26:37.645534+0000","last_unstale":"2021-10-08T19:26:37.908430+0000","last_undegraded":"2021-10-08T19:26:37.908430+0000","last_fullsized":"2021-10-08T19:26:37.908430+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640074+0000","last_change":"2021-10-08T19:25:12.805312+0000","last_active":"2021-10-08T19:26:36.640074+0000","last_peered":"2021-10-08T19:26:36.640074+0000","last_clean":"2021-10-08T19:26:36.640074+0000","last_became_active":"2021-10-08T19:25:12.804831+0000","last_became_peered":"2021-10-08T19:25:12.804831+0000","last_unstale":"2021-10-08T19:26:36.640074+0000","last_undegraded":"2021-10-08T19:26:36.640074+0000","last_fullsized":"2021-10-08T19:26:36.640074+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644390+0000","last_change":"2021-10-08T19:25:10.800440+0000","last_active":"2021-10-08T19:26:36.644390+0000","last_peered":"2021-10-08T19:26:36.644390+0000","last_clean":"2021-10-08T19:26:36.644390+0000","last_became_active":"2021-10-08T19:25:10.800110+0000","last_became_peered":"2021-10-08T19:25:10.800110+0000","last_unstale":"2021-10-08T19:26:36.644390+0000","last_undegraded":"2021-10-08T19:26:36.644390+0000","last_fullsized":"2021-10-08T19:26:36.644390+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645049+0000","last_change":"2021-10-08T19:25:06.797592+0000","last_active":"2021-10-08T19:26:36.645049+0000","last_peered":"2021-10-08T19:26:36.645049+0000","last_clean":"2021-10-08T19:26:36.645049+0000","last_became_active":"2021-10-08T19:25:06.797301+0000","last_became_peered":"2021-10-08T19:25:06.797301+0000","last_unstale":"2021-10-08T19:26:36.645049+0000","last_undegraded":"2021-10-08T19:26:36.645049+0000","last_fullsized":"2021-10-08T19:26:36.645049+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"65'11","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638874+0000","last_change":"2021-10-08T19:25:08.798732+0000","last_active":"2021-10-08T19:26:36.638874+0000","last_peered":"2021-10-08T19:26:36.638874+0000","last_clean":"2021-10-08T19:26:36.638874+0000","last_became_active":"2021-10-08T19:25:08.798495+0000","last_became_peered":"2021-10-08T19:25:08.798495+0000","last_unstale":"2021-10-08T19:26:36.638874+0000","last_undegraded":"2021-10-08T19:26:36.638874+0000","last_fullsized":"2021-10-08T19:26:36.638874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"65'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633060+0000","last_change":"2021-10-08T19:25:12.811278+0000","last_active":"2021-10-08T19:26:36.633060+0000","last_peered":"2021-10-08T19:26:36.633060+0000","last_clean":"2021-10-08T19:26:36.633060+0000","last_became_active":"2021-10-08T19:25:12.810536+0000","last_became_peered":"2021-10-08T19:25:12.810536+0000","last_unstale":"2021-10-08T19:26:36.633060+0000","last_undegraded":"2021-10-08T19:26:36.633060+0000","last_fullsized":"2021-10-08T19:26:36.633060+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640497+0000","last_change":"2021-10-08T19:25:10.804442+0000","last_active":"2021-10-08T19:26:36.640497+0000","last_peered":"2021-10-08T19:26:36.640497+0000","last_clean":"2021-10-08T19:26:36.640497+0000","last_became_active":"2021-10-08T19:25:10.804162+0000","last_became_peered":"2021-10-08T19:25:10.804162+0000","last_unstale":"2021-10-08T19:26:36.640497+0000","last_undegraded":"2021-10-08T19:26:36.640497+0000","last_fullsized":"2021-10-08T19:26:36.640497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642377+0000","last_change":"2021-10-08T19:25:06.794000+0000","last_active":"2021-10-08T19:26:36.642377+0000","last_peered":"2021-10-08T19:26:36.642377+0000","last_clean":"2021-10-08T19:26:36.642377+0000","last_became_active":"2021-10-08T19:25:06.793694+0000","last_became_peered":"2021-10-08T19:25:06.793694+0000","last_unstale":"2021-10-08T19:26:36.642377+0000","last_undegraded":"2021-10-08T19:26:36.642377+0000","last_fullsized":"2021-10-08T19:26:36.642377+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644341+0000","last_change":"2021-10-08T19:25:08.800849+0000","last_active":"2021-10-08T19:26:36.644341+0000","last_peered":"2021-10-08T19:26:36.644341+0000","last_clean":"2021-10-08T19:26:36.644341+0000","last_became_active":"2021-10-08T19:25:08.800562+0000","last_became_peered":"2021-10-08T19:25:08.800562+0000","last_unstale":"2021-10-08T19:26:36.644341+0000","last_undegraded":"2021-10-08T19:26:36.644341+0000","last_fullsized":"2021-10-08T19:26:36.644341+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640651+0000","last_change":"2021-10-08T19:25:12.803810+0000","last_active":"2021-10-08T19:26:36.640651+0000","last_peered":"2021-10-08T19:26:36.640651+0000","last_clean":"2021-10-08T19:26:36.640651+0000","last_became_active":"2021-10-08T19:25:12.803518+0000","last_became_peered":"2021-10-08T19:25:12.803518+0000","last_unstale":"2021-10-08T19:26:36.640651+0000","last_undegraded":"2021-10-08T19:26:36.640651+0000","last_fullsized":"2021-10-08T19:26:36.640651+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"65'11","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:45.498641+0000","last_change":"2021-10-08T19:25:10.802213+0000","last_active":"2021-10-08T19:26:45.498641+0000","last_peered":"2021-10-08T19:26:45.498641+0000","last_clean":"2021-10-08T19:26:45.498641+0000","last_became_active":"2021-10-08T19:25:10.801895+0000","last_became_peered":"2021-10-08T19:25:10.801895+0000","last_unstale":"2021-10-08T19:26:45.498641+0000","last_undegraded":"2021-10-08T19:26:45.498641+0000","last_fullsized":"2021-10-08T19:26:45.498641+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633894+0000","last_change":"2021-10-08T19:25:06.798407+0000","last_active":"2021-10-08T19:26:36.633894+0000","last_peered":"2021-10-08T19:26:36.633894+0000","last_clean":"2021-10-08T19:26:36.633894+0000","last_became_active":"2021-10-08T19:25:06.798064+0000","last_became_peered":"2021-10-08T19:25:06.798064+0000","last_unstale":"2021-10-08T19:26:36.633894+0000","last_undegraded":"2021-10-08T19:26:36.633894+0000","last_fullsized":"2021-10-08T19:26:36.633894+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635911+0000","last_change":"2021-10-08T19:25:09.298297+0000","last_active":"2021-10-08T19:26:36.635911+0000","last_peered":"2021-10-08T19:26:36.635911+0000","last_clean":"2021-10-08T19:26:36.635911+0000","last_became_active":"2021-10-08T19:25:09.297984+0000","last_became_peered":"2021-10-08T19:25:09.297984+0000","last_unstale":"2021-10-08T19:26:36.635911+0000","last_undegraded":"2021-10-08T19:26:36.635911+0000","last_fullsized":"2021-10-08T19:26:36.635911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633576+0000","last_change":"2021-10-08T19:25:12.808216+0000","last_active":"2021-10-08T19:26:36.633576+0000","last_peered":"2021-10-08T19:26:36.633576+0000","last_clean":"2021-10-08T19:26:36.633576+0000","last_became_active":"2021-10-08T19:25:12.807902+0000","last_became_peered":"2021-10-08T19:25:12.807902+0000","last_unstale":"2021-10-08T19:26:36.633576+0000","last_undegraded":"2021-10-08T19:26:36.633576+0000","last_fullsized":"2021-10-08T19:26:36.633576+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"65'11","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:45.498662+0000","last_change":"2021-10-08T19:25:10.802900+0000","last_active":"2021-10-08T19:26:45.498662+0000","last_peered":"2021-10-08T19:26:45.498662+0000","last_clean":"2021-10-08T19:26:45.498662+0000","last_became_active":"2021-10-08T19:25:10.802372+0000","last_became_peered":"2021-10-08T19:25:10.802372+0000","last_unstale":"2021-10-08T19:26:45.498662+0000","last_undegraded":"2021-10-08T19:26:45.498662+0000","last_fullsized":"2021-10-08T19:26:45.498662+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635325+0000","last_change":"2021-10-08T19:25:06.799834+0000","last_active":"2021-10-08T19:26:36.635325+0000","last_peered":"2021-10-08T19:26:36.635325+0000","last_clean":"2021-10-08T19:26:36.635325+0000","last_became_active":"2021-10-08T19:25:06.799207+0000","last_became_peered":"2021-10-08T19:25:06.799207+0000","last_unstale":"2021-10-08T19:26:36.635325+0000","last_undegraded":"2021-10-08T19:26:36.635325+0000","last_fullsized":"2021-10-08T19:26:36.635325+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"65'10","reported_seq":54,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:37.652230+0000","last_change":"2021-10-08T19:26:37.652230+0000","last_active":"2021-10-08T19:26:37.652230+0000","last_peered":"2021-10-08T19:26:37.652230+0000","last_clean":"2021-10-08T19:26:37.652230+0000","last_became_active":"2021-10-08T19:26:37.645057+0000","last_became_peered":"2021-10-08T19:26:37.645057+0000","last_unstale":"2021-10-08T19:26:37.652230+0000","last_undegraded":"2021-10-08T19:26:37.652230+0000","last_fullsized":"2021-10-08T19:26:37.652230+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.637973+0000","last_change":"2021-10-08T19:25:13.234205+0000","last_active":"2021-10-08T19:26:36.637973+0000","last_peered":"2021-10-08T19:26:36.637973+0000","last_clean":"2021-10-08T19:26:36.637973+0000","last_became_active":"2021-10-08T19:25:13.233903+0000","last_became_peered":"2021-10-08T19:25:13.233903+0000","last_unstale":"2021-10-08T19:26:36.637973+0000","last_undegraded":"2021-10-08T19:26:36.637973+0000","last_fullsized":"2021-10-08T19:26:36.637973+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635909+0000","last_change":"2021-10-08T19:25:10.806684+0000","last_active":"2021-10-08T19:26:36.635909+0000","last_peered":"2021-10-08T19:26:36.635909+0000","last_clean":"2021-10-08T19:26:36.635909+0000","last_became_active":"2021-10-08T19:25:10.806062+0000","last_became_peered":"2021-10-08T19:25:10.806062+0000","last_unstale":"2021-10-08T19:26:36.635909+0000","last_undegraded":"2021-10-08T19:26:36.635909+0000","last_fullsized":"2021-10-08T19:26:36.635909+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642764+0000","last_change":"2021-10-08T19:25:06.793531+0000","last_active":"2021-10-08T19:26:36.642764+0000","last_peered":"2021-10-08T19:26:36.642764+0000","last_clean":"2021-10-08T19:26:36.642764+0000","last_became_active":"2021-10-08T19:25:06.793114+0000","last_became_peered":"2021-10-08T19:25:06.793114+0000","last_unstale":"2021-10-08T19:26:36.642764+0000","last_undegraded":"2021-10-08T19:26:36.642764+0000","last_fullsized":"2021-10-08T19:26:36.642764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"65'6","reported_seq":27,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641761+0000","last_change":"2021-10-08T19:25:09.296456+0000","last_active":"2021-10-08T19:26:36.641761+0000","last_peered":"2021-10-08T19:26:36.641761+0000","last_clean":"2021-10-08T19:26:36.641761+0000","last_became_active":"2021-10-08T19:25:09.296158+0000","last_became_peered":"2021-10-08T19:25:09.296158+0000","last_unstale":"2021-10-08T19:26:36.641761+0000","last_undegraded":"2021-10-08T19:26:36.641761+0000","last_fullsized":"2021-10-08T19:26:36.641761+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636547+0000","last_change":"2021-10-08T19:25:12.804275+0000","last_active":"2021-10-08T19:26:36.636547+0000","last_peered":"2021-10-08T19:26:36.636547+0000","last_clean":"2021-10-08T19:26:36.636547+0000","last_became_active":"2021-10-08T19:25:12.803989+0000","last_became_peered":"2021-10-08T19:25:12.803989+0000","last_unstale":"2021-10-08T19:26:36.636547+0000","last_undegraded":"2021-10-08T19:26:36.636547+0000","last_fullsized":"2021-10-08T19:26:36.636547+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641924+0000","last_change":"2021-10-08T19:25:10.804197+0000","last_active":"2021-10-08T19:26:36.641924+0000","last_peered":"2021-10-08T19:26:36.641924+0000","last_clean":"2021-10-08T19:26:36.641924+0000","last_became_active":"2021-10-08T19:25:10.803875+0000","last_became_peered":"2021-10-08T19:25:10.803875+0000","last_unstale":"2021-10-08T19:26:36.641924+0000","last_undegraded":"2021-10-08T19:26:36.641924+0000","last_fullsized":"2021-10-08T19:26:36.641924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.634902+0000","last_change":"2021-10-08T19:25:06.797360+0000","last_active":"2021-10-08T19:26:36.634902+0000","last_peered":"2021-10-08T19:26:36.634902+0000","last_clean":"2021-10-08T19:26:36.634902+0000","last_became_active":"2021-10-08T19:25:06.797035+0000","last_became_peered":"2021-10-08T19:25:06.797035+0000","last_unstale":"2021-10-08T19:26:36.634902+0000","last_undegraded":"2021-10-08T19:26:36.634902+0000","last_fullsized":"2021-10-08T19:26:36.634902+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633755+0000","last_change":"2021-10-08T19:25:09.297341+0000","last_active":"2021-10-08T19:26:36.633755+0000","last_peered":"2021-10-08T19:26:36.633755+0000","last_clean":"2021-10-08T19:26:36.633755+0000","last_became_active":"2021-10-08T19:25:09.296957+0000","last_became_peered":"2021-10-08T19:25:09.296957+0000","last_unstale":"2021-10-08T19:26:36.633755+0000","last_undegraded":"2021-10-08T19:26:36.633755+0000","last_fullsized":"2021-10-08T19:26:36.633755+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640539+0000","last_change":"2021-10-08T19:25:12.808610+0000","last_active":"2021-10-08T19:26:36.640539+0000","last_peered":"2021-10-08T19:26:36.640539+0000","last_clean":"2021-10-08T19:26:36.640539+0000","last_became_active":"2021-10-08T19:25:12.808312+0000","last_became_peered":"2021-10-08T19:25:12.808312+0000","last_unstale":"2021-10-08T19:26:36.640539+0000","last_undegraded":"2021-10-08T19:26:36.640539+0000","last_fullsized":"2021-10-08T19:26:36.640539+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"57'2","reported_seq":42,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640494+0000","last_change":"2021-10-08T19:25:06.793211+0000","last_active":"2021-10-08T19:26:36.640494+0000","last_peered":"2021-10-08T19:26:36.640494+0000","last_clean":"2021-10-08T19:26:36.640494+0000","last_became_active":"2021-10-08T19:25:06.792968+0000","last_became_peered":"2021-10-08T19:25:06.792968+0000","last_unstale":"2021-10-08T19:26:36.640494+0000","last_undegraded":"2021-10-08T19:26:36.640494+0000","last_fullsized":"2021-10-08T19:26:36.640494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"65'12","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638293+0000","last_change":"2021-10-08T19:25:08.796024+0000","last_active":"2021-10-08T19:26:36.638293+0000","last_peered":"2021-10-08T19:26:36.638293+0000","last_clean":"2021-10-08T19:26:36.638293+0000","last_became_active":"2021-10-08T19:25:08.795819+0000","last_became_peered":"2021-10-08T19:25:08.795819+0000","last_unstale":"2021-10-08T19:26:36.638293+0000","last_undegraded":"2021-10-08T19:26:36.638293+0000","last_fullsized":"2021-10-08T19:26:36.638293+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.634826+0000","last_change":"2021-10-08T19:25:10.801286+0000","last_active":"2021-10-08T19:26:36.634826+0000","last_peered":"2021-10-08T19:26:36.634826+0000","last_clean":"2021-10-08T19:26:36.634826+0000","last_became_active":"2021-10-08T19:25:10.801024+0000","last_became_peered":"2021-10-08T19:25:10.801024+0000","last_unstale":"2021-10-08T19:26:36.634826+0000","last_undegraded":"2021-10-08T19:26:36.634826+0000","last_fullsized":"2021-10-08T19:26:36.634826+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633151+0000","last_change":"2021-10-08T19:25:12.810893+0000","last_active":"2021-10-08T19:26:36.633151+0000","last_peered":"2021-10-08T19:26:36.633151+0000","last_clean":"2021-10-08T19:26:36.633151+0000","last_became_active":"2021-10-08T19:25:12.809997+0000","last_became_peered":"2021-10-08T19:25:12.809997+0000","last_unstale":"2021-10-08T19:26:36.633151+0000","last_undegraded":"2021-10-08T19:26:36.633151+0000","last_fullsized":"2021-10-08T19:26:36.633151+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644425+0000","last_change":"2021-10-08T19:25:06.799449+0000","last_active":"2021-10-08T19:26:36.644425+0000","last_peered":"2021-10-08T19:26:36.644425+0000","last_clean":"2021-10-08T19:26:36.644425+0000","last_became_active":"2021-10-08T19:25:06.799117+0000","last_became_peered":"2021-10-08T19:25:06.799117+0000","last_unstale":"2021-10-08T19:26:36.644425+0000","last_undegraded":"2021-10-08T19:26:36.644425+0000","last_fullsized":"2021-10-08T19:26:36.644425+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"65'10","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644431+0000","last_change":"2021-10-08T19:25:08.797732+0000","last_active":"2021-10-08T19:26:36.644431+0000","last_peered":"2021-10-08T19:26:36.644431+0000","last_clean":"2021-10-08T19:26:36.644431+0000","last_became_active":"2021-10-08T19:25:08.797441+0000","last_became_peered":"2021-10-08T19:25:08.797441+0000","last_unstale":"2021-10-08T19:26:36.644431+0000","last_undegraded":"2021-10-08T19:26:36.644431+0000","last_fullsized":"2021-10-08T19:26:36.644431+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"65'11","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:45.498606+0000","last_change":"2021-10-08T19:25:10.800528+0000","last_active":"2021-10-08T19:26:45.498606+0000","last_peered":"2021-10-08T19:26:45.498606+0000","last_clean":"2021-10-08T19:26:45.498606+0000","last_became_active":"2021-10-08T19:25:10.800192+0000","last_became_peered":"2021-10-08T19:25:10.800192+0000","last_unstale":"2021-10-08T19:26:45.498606+0000","last_undegraded":"2021-10-08T19:26:45.498606+0000","last_fullsized":"2021-10-08T19:26:45.498606+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641246+0000","last_change":"2021-10-08T19:25:12.803348+0000","last_active":"2021-10-08T19:26:36.641246+0000","last_peered":"2021-10-08T19:26:36.641246+0000","last_clean":"2021-10-08T19:26:36.641246+0000","last_became_active":"2021-10-08T19:25:12.802997+0000","last_became_peered":"2021-10-08T19:25:12.802997+0000","last_unstale":"2021-10-08T19:26:36.641246+0000","last_undegraded":"2021-10-08T19:26:36.641246+0000","last_fullsized":"2021-10-08T19:26:36.641246+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635380+0000","last_change":"2021-10-08T19:25:06.795288+0000","last_active":"2021-10-08T19:26:36.635380+0000","last_peered":"2021-10-08T19:26:36.635380+0000","last_clean":"2021-10-08T19:26:36.635380+0000","last_became_active":"2021-10-08T19:25:06.794978+0000","last_became_peered":"2021-10-08T19:25:06.794978+0000","last_unstale":"2021-10-08T19:26:36.635380+0000","last_undegraded":"2021-10-08T19:26:36.635380+0000","last_fullsized":"2021-10-08T19:26:36.635380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"65'30","reported_seq":90,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:45.498607+0000","last_change":"2021-10-08T19:25:08.800279+0000","last_active":"2021-10-08T19:26:45.498607+0000","last_peered":"2021-10-08T19:26:45.498607+0000","last_clean":"2021-10-08T19:26:45.498607+0000","last_became_active":"2021-10-08T19:25:08.800000+0000","last_became_peered":"2021-10-08T19:25:08.800000+0000","last_unstale":"2021-10-08T19:26:45.498607+0000","last_undegraded":"2021-10-08T19:26:45.498607+0000","last_fullsized":"2021-10-08T19:26:45.498607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633973+0000","last_change":"2021-10-08T19:25:10.803863+0000","last_active":"2021-10-08T19:26:36.633973+0000","last_peered":"2021-10-08T19:26:36.633973+0000","last_clean":"2021-10-08T19:26:36.633973+0000","last_became_active":"2021-10-08T19:25:10.803528+0000","last_became_peered":"2021-10-08T19:25:10.803528+0000","last_unstale":"2021-10-08T19:26:36.633973+0000","last_undegraded":"2021-10-08T19:26:36.633973+0000","last_fullsized":"2021-10-08T19:26:36.633973+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639773+0000","last_change":"2021-10-08T19:25:13.232071+0000","last_active":"2021-10-08T19:26:36.639773+0000","last_peered":"2021-10-08T19:26:36.639773+0000","last_clean":"2021-10-08T19:26:36.639773+0000","last_became_active":"2021-10-08T19:25:13.231793+0000","last_became_peered":"2021-10-08T19:25:13.231793+0000","last_unstale":"2021-10-08T19:26:36.639773+0000","last_undegraded":"2021-10-08T19:26:36.639773+0000","last_fullsized":"2021-10-08T19:26:36.639773+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"65'5","reported_seq":119,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:49.825695+0000","last_change":"2021-10-08T19:25:07.792337+0000","last_active":"2021-10-08T19:26:49.825695+0000","last_peered":"2021-10-08T19:26:49.825695+0000","last_clean":"2021-10-08T19:26:49.825695+0000","last_became_active":"2021-10-08T19:25:07.792044+0000","last_became_peered":"2021-10-08T19:25:07.792044+0000","last_unstale":"2021-10-08T19:26:49.825695+0000","last_undegraded":"2021-10-08T19:26:49.825695+0000","last_fullsized":"2021-10-08T19:26:49.825695+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_clean_scrub_stamp":"2021-10-08T19:25:06.778978+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":92,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.634994+0000","last_change":"2021-10-08T19:25:06.795341+0000","last_active":"2021-10-08T19:26:36.634994+0000","last_peered":"2021-10-08T19:26:36.634994+0000","last_clean":"2021-10-08T19:26:36.634994+0000","last_became_active":"2021-10-08T19:25:06.795071+0000","last_became_peered":"2021-10-08T19:25:06.795071+0000","last_unstale":"2021-10-08T19:26:36.634994+0000","last_undegraded":"2021-10-08T19:26:36.634994+0000","last_fullsized":"2021-10-08T19:26:36.634994+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"65'13","reported_seq":45,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645079+0000","last_change":"2021-10-08T19:25:08.803387+0000","last_active":"2021-10-08T19:26:36.645079+0000","last_peered":"2021-10-08T19:26:36.645079+0000","last_clean":"2021-10-08T19:26:36.645079+0000","last_became_active":"2021-10-08T19:25:08.803077+0000","last_became_peered":"2021-10-08T19:25:08.803077+0000","last_unstale":"2021-10-08T19:26:36.645079+0000","last_undegraded":"2021-10-08T19:26:36.645079+0000","last_fullsized":"2021-10-08T19:26:36.645079+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636838+0000","last_change":"2021-10-08T19:25:10.807447+0000","last_active":"2021-10-08T19:26:36.636838+0000","last_peered":"2021-10-08T19:26:36.636838+0000","last_clean":"2021-10-08T19:26:36.636838+0000","last_became_active":"2021-10-08T19:25:10.807152+0000","last_became_peered":"2021-10-08T19:25:10.807152+0000","last_unstale":"2021-10-08T19:26:36.636838+0000","last_undegraded":"2021-10-08T19:26:36.636838+0000","last_fullsized":"2021-10-08T19:26:36.636838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636194+0000","last_change":"2021-10-08T19:25:12.808276+0000","last_active":"2021-10-08T19:26:36.636194+0000","last_peered":"2021-10-08T19:26:36.636194+0000","last_clean":"2021-10-08T19:26:36.636194+0000","last_became_active":"2021-10-08T19:25:12.807968+0000","last_became_peered":"2021-10-08T19:25:12.807968+0000","last_unstale":"2021-10-08T19:26:36.636194+0000","last_undegraded":"2021-10-08T19:26:36.636194+0000","last_fullsized":"2021-10-08T19:26:36.636194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642306+0000","last_change":"2021-10-08T19:25:07.794182+0000","last_active":"2021-10-08T19:26:36.642306+0000","last_peered":"2021-10-08T19:26:36.642306+0000","last_clean":"2021-10-08T19:26:36.642306+0000","last_became_active":"2021-10-08T19:25:07.793367+0000","last_became_peered":"2021-10-08T19:25:07.793367+0000","last_unstale":"2021-10-08T19:26:36.642306+0000","last_undegraded":"2021-10-08T19:26:36.642306+0000","last_fullsized":"2021-10-08T19:26:36.642306+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_clean_scrub_stamp":"2021-10-08T19:25:06.778978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"57'1","reported_seq":42,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:37.730654+0000","last_change":"2021-10-08T19:26:37.730654+0000","last_active":"2021-10-08T19:26:37.730654+0000","last_peered":"2021-10-08T19:26:37.730654+0000","last_clean":"2021-10-08T19:26:37.730654+0000","last_became_active":"2021-10-08T19:26:37.642282+0000","last_became_peered":"2021-10-08T19:26:37.642282+0000","last_unstale":"2021-10-08T19:26:37.730654+0000","last_undegraded":"2021-10-08T19:26:37.730654+0000","last_fullsized":"2021-10-08T19:26:37.730654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"66'128","reported_seq":268,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638182+0000","last_change":"2021-10-08T19:25:02.612588+0000","last_active":"2021-10-08T19:26:36.638182+0000","last_peered":"2021-10-08T19:26:36.638182+0000","last_clean":"2021-10-08T19:26:36.638182+0000","last_became_active":"2021-10-08T19:25:02.612168+0000","last_became_peered":"2021-10-08T19:25:02.612168+0000","last_unstale":"2021-10-08T19:26:36.638182+0000","last_undegraded":"2021-10-08T19:26:36.638182+0000","last_fullsized":"2021-10-08T19:26:36.638182+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:27.938485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:27.938485+0000","last_clean_scrub_stamp":"2021-10-08T19:23:27.938485+0000","log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"65'14","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642690+0000","last_change":"2021-10-08T19:25:09.297809+0000","last_active":"2021-10-08T19:26:36.642690+0000","last_peered":"2021-10-08T19:26:36.642690+0000","last_clean":"2021-10-08T19:26:36.642690+0000","last_became_active":"2021-10-08T19:25:09.297507+0000","last_became_peered":"2021-10-08T19:25:09.297507+0000","last_unstale":"2021-10-08T19:26:36.642690+0000","last_undegraded":"2021-10-08T19:26:36.642690+0000","last_fullsized":"2021-10-08T19:26:36.642690+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639216+0000","last_change":"2021-10-08T19:25:10.800205+0000","last_active":"2021-10-08T19:26:36.639216+0000","last_peered":"2021-10-08T19:26:36.639216+0000","last_clean":"2021-10-08T19:26:36.639216+0000","last_became_active":"2021-10-08T19:25:10.799914+0000","last_became_peered":"2021-10-08T19:25:10.799914+0000","last_unstale":"2021-10-08T19:26:36.639216+0000","last_undegraded":"2021-10-08T19:26:36.639216+0000","last_fullsized":"2021-10-08T19:26:36.639216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644201+0000","last_change":"2021-10-08T19:25:12.814098+0000","last_active":"2021-10-08T19:26:36.644201+0000","last_peered":"2021-10-08T19:26:36.644201+0000","last_clean":"2021-10-08T19:26:36.644201+0000","last_became_active":"2021-10-08T19:25:12.813784+0000","last_became_peered":"2021-10-08T19:25:12.813784+0000","last_unstale":"2021-10-08T19:26:36.644201+0000","last_undegraded":"2021-10-08T19:26:36.644201+0000","last_fullsized":"2021-10-08T19:26:36.644201+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633347+0000","last_change":"2021-10-08T19:25:07.796350+0000","last_active":"2021-10-08T19:26:36.633347+0000","last_peered":"2021-10-08T19:26:36.633347+0000","last_clean":"2021-10-08T19:26:36.633347+0000","last_became_active":"2021-10-08T19:25:07.796040+0000","last_became_peered":"2021-10-08T19:25:07.796040+0000","last_unstale":"2021-10-08T19:26:36.633347+0000","last_undegraded":"2021-10-08T19:26:36.633347+0000","last_fullsized":"2021-10-08T19:26:36.633347+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_clean_scrub_stamp":"2021-10-08T19:25:06.778978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638120+0000","last_change":"2021-10-08T19:25:06.798704+0000","last_active":"2021-10-08T19:26:36.638120+0000","last_peered":"2021-10-08T19:26:36.638120+0000","last_clean":"2021-10-08T19:26:36.638120+0000","last_became_active":"2021-10-08T19:25:06.798174+0000","last_became_peered":"2021-10-08T19:25:06.798174+0000","last_unstale":"2021-10-08T19:26:36.638120+0000","last_undegraded":"2021-10-08T19:26:36.638120+0000","last_fullsized":"2021-10-08T19:26:36.638120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"65'12","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633670+0000","last_change":"2021-10-08T19:25:08.799978+0000","last_active":"2021-10-08T19:26:36.633670+0000","last_peered":"2021-10-08T19:26:36.633670+0000","last_clean":"2021-10-08T19:26:36.633670+0000","last_became_active":"2021-10-08T19:25:08.799673+0000","last_became_peered":"2021-10-08T19:25:08.799673+0000","last_unstale":"2021-10-08T19:26:36.633670+0000","last_undegraded":"2021-10-08T19:26:36.633670+0000","last_fullsized":"2021-10-08T19:26:36.633670+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636156+0000","last_change":"2021-10-08T19:25:10.807943+0000","last_active":"2021-10-08T19:26:36.636156+0000","last_peered":"2021-10-08T19:26:36.636156+0000","last_clean":"2021-10-08T19:26:36.636156+0000","last_became_active":"2021-10-08T19:25:10.807055+0000","last_became_peered":"2021-10-08T19:25:10.807055+0000","last_unstale":"2021-10-08T19:26:36.636156+0000","last_undegraded":"2021-10-08T19:26:36.636156+0000","last_fullsized":"2021-10-08T19:26:36.636156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.643875+0000","last_change":"2021-10-08T19:25:13.232381+0000","last_active":"2021-10-08T19:26:36.643875+0000","last_peered":"2021-10-08T19:26:36.643875+0000","last_clean":"2021-10-08T19:26:36.643875+0000","last_became_active":"2021-10-08T19:25:13.232027+0000","last_became_peered":"2021-10-08T19:25:13.232027+0000","last_unstale":"2021-10-08T19:26:36.643875+0000","last_undegraded":"2021-10-08T19:26:36.643875+0000","last_fullsized":"2021-10-08T19:26:36.643875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639818+0000","last_change":"2021-10-08T19:25:06.800598+0000","last_active":"2021-10-08T19:26:36.639818+0000","last_peered":"2021-10-08T19:26:36.639818+0000","last_clean":"2021-10-08T19:26:36.639818+0000","last_became_active":"2021-10-08T19:25:06.800130+0000","last_became_peered":"2021-10-08T19:25:06.800130+0000","last_unstale":"2021-10-08T19:26:36.639818+0000","last_undegraded":"2021-10-08T19:26:36.639818+0000","last_fullsized":"2021-10-08T19:26:36.639818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"65'19","reported_seq":54,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633825+0000","last_change":"2021-10-08T19:25:09.297231+0000","last_active":"2021-10-08T19:26:36.633825+0000","last_peered":"2021-10-08T19:26:36.633825+0000","last_clean":"2021-10-08T19:26:36.633825+0000","last_became_active":"2021-10-08T19:25:09.296955+0000","last_became_peered":"2021-10-08T19:25:09.296955+0000","last_unstale":"2021-10-08T19:26:36.633825+0000","last_undegraded":"2021-10-08T19:26:36.633825+0000","last_fullsized":"2021-10-08T19:26:36.633825+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642352+0000","last_change":"2021-10-08T19:25:10.805897+0000","last_active":"2021-10-08T19:26:36.642352+0000","last_peered":"2021-10-08T19:26:36.642352+0000","last_clean":"2021-10-08T19:26:36.642352+0000","last_became_active":"2021-10-08T19:25:10.805618+0000","last_became_peered":"2021-10-08T19:25:10.805618+0000","last_unstale":"2021-10-08T19:26:36.642352+0000","last_undegraded":"2021-10-08T19:26:36.642352+0000","last_fullsized":"2021-10-08T19:26:36.642352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638453+0000","last_change":"2021-10-08T19:25:12.802846+0000","last_active":"2021-10-08T19:26:36.638453+0000","last_peered":"2021-10-08T19:26:36.638453+0000","last_clean":"2021-10-08T19:26:36.638453+0000","last_became_active":"2021-10-08T19:25:12.802543+0000","last_became_peered":"2021-10-08T19:25:12.802543+0000","last_unstale":"2021-10-08T19:26:36.638453+0000","last_undegraded":"2021-10-08T19:26:36.638453+0000","last_fullsized":"2021-10-08T19:26:36.638453+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645299+0000","last_change":"2021-10-08T19:25:06.796937+0000","last_active":"2021-10-08T19:26:36.645299+0000","last_peered":"2021-10-08T19:26:36.645299+0000","last_clean":"2021-10-08T19:26:36.645299+0000","last_became_active":"2021-10-08T19:25:06.796647+0000","last_became_peered":"2021-10-08T19:25:06.796647+0000","last_unstale":"2021-10-08T19:26:36.645299+0000","last_undegraded":"2021-10-08T19:26:36.645299+0000","last_fullsized":"2021-10-08T19:26:36.645299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"65'18","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640004+0000","last_change":"2021-10-08T19:25:09.297025+0000","last_active":"2021-10-08T19:26:36.640004+0000","last_peered":"2021-10-08T19:26:36.640004+0000","last_clean":"2021-10-08T19:26:36.640004+0000","last_became_active":"2021-10-08T19:25:09.296839+0000","last_became_peered":"2021-10-08T19:25:09.296839+0000","last_unstale":"2021-10-08T19:26:36.640004+0000","last_undegraded":"2021-10-08T19:26:36.640004+0000","last_fullsized":"2021-10-08T19:26:36.640004+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638388+0000","last_change":"2021-10-08T19:25:10.804742+0000","last_active":"2021-10-08T19:26:36.638388+0000","last_peered":"2021-10-08T19:26:36.638388+0000","last_clean":"2021-10-08T19:26:36.638388+0000","last_became_active":"2021-10-08T19:25:10.804578+0000","last_became_peered":"2021-10-08T19:25:10.804578+0000","last_unstale":"2021-10-08T19:26:36.638388+0000","last_undegraded":"2021-10-08T19:26:36.638388+0000","last_fullsized":"2021-10-08T19:26:36.638388+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638747+0000","last_change":"2021-10-08T19:25:13.234327+0000","last_active":"2021-10-08T19:26:36.638747+0000","last_peered":"2021-10-08T19:26:36.638747+0000","last_clean":"2021-10-08T19:26:36.638747+0000","last_became_active":"2021-10-08T19:25:13.234036+0000","last_became_peered":"2021-10-08T19:25:13.234036+0000","last_unstale":"2021-10-08T19:26:36.638747+0000","last_undegraded":"2021-10-08T19:26:36.638747+0000","last_fullsized":"2021-10-08T19:26:36.638747+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642716+0000","last_change":"2021-10-08T19:25:06.794814+0000","last_active":"2021-10-08T19:26:36.642716+0000","last_peered":"2021-10-08T19:26:36.642716+0000","last_clean":"2021-10-08T19:26:36.642716+0000","last_became_active":"2021-10-08T19:25:06.794554+0000","last_became_peered":"2021-10-08T19:25:06.794554+0000","last_unstale":"2021-10-08T19:26:36.642716+0000","last_undegraded":"2021-10-08T19:26:36.642716+0000","last_fullsized":"2021-10-08T19:26:36.642716+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"65'14","reported_seq":39,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638100+0000","last_change":"2021-10-08T19:25:08.793890+0000","last_active":"2021-10-08T19:26:36.638100+0000","last_peered":"2021-10-08T19:26:36.638100+0000","last_clean":"2021-10-08T19:26:36.638100+0000","last_became_active":"2021-10-08T19:25:08.793662+0000","last_became_peered":"2021-10-08T19:25:08.793662+0000","last_unstale":"2021-10-08T19:26:36.638100+0000","last_undegraded":"2021-10-08T19:26:36.638100+0000","last_fullsized":"2021-10-08T19:26:36.638100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"65'11","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:45.498624+0000","last_change":"2021-10-08T19:25:10.804314+0000","last_active":"2021-10-08T19:26:45.498624+0000","last_peered":"2021-10-08T19:26:45.498624+0000","last_clean":"2021-10-08T19:26:45.498624+0000","last_became_active":"2021-10-08T19:25:10.803885+0000","last_became_peered":"2021-10-08T19:25:10.803885+0000","last_unstale":"2021-10-08T19:26:45.498624+0000","last_undegraded":"2021-10-08T19:26:45.498624+0000","last_fullsized":"2021-10-08T19:26:45.498624+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640974+0000","last_change":"2021-10-08T19:25:13.232344+0000","last_active":"2021-10-08T19:26:36.640974+0000","last_peered":"2021-10-08T19:26:36.640974+0000","last_clean":"2021-10-08T19:26:36.640974+0000","last_became_active":"2021-10-08T19:25:13.231902+0000","last_became_peered":"2021-10-08T19:25:13.231902+0000","last_unstale":"2021-10-08T19:26:36.640974+0000","last_undegraded":"2021-10-08T19:26:36.640974+0000","last_fullsized":"2021-10-08T19:26:36.640974+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636089+0000","last_change":"2021-10-08T19:25:10.808038+0000","last_active":"2021-10-08T19:26:36.636089+0000","last_peered":"2021-10-08T19:26:36.636089+0000","last_clean":"2021-10-08T19:26:36.636089+0000","last_became_active":"2021-10-08T19:25:10.807344+0000","last_became_peered":"2021-10-08T19:25:10.807344+0000","last_unstale":"2021-10-08T19:26:36.636089+0000","last_undegraded":"2021-10-08T19:26:36.636089+0000","last_fullsized":"2021-10-08T19:26:36.636089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638299+0000","last_change":"2021-10-08T19:25:06.802367+0000","last_active":"2021-10-08T19:26:36.638299+0000","last_peered":"2021-10-08T19:26:36.638299+0000","last_clean":"2021-10-08T19:26:36.638299+0000","last_became_active":"2021-10-08T19:25:06.802093+0000","last_became_peered":"2021-10-08T19:25:06.802093+0000","last_unstale":"2021-10-08T19:26:36.638299+0000","last_undegraded":"2021-10-08T19:26:36.638299+0000","last_fullsized":"2021-10-08T19:26:36.638299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"65'11","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640460+0000","last_change":"2021-10-08T19:25:08.797858+0000","last_active":"2021-10-08T19:26:36.640460+0000","last_peered":"2021-10-08T19:26:36.640460+0000","last_clean":"2021-10-08T19:26:36.640460+0000","last_became_active":"2021-10-08T19:25:08.797585+0000","last_became_peered":"2021-10-08T19:25:08.797585+0000","last_unstale":"2021-10-08T19:26:36.640460+0000","last_undegraded":"2021-10-08T19:26:36.640460+0000","last_fullsized":"2021-10-08T19:26:36.640460+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635692+0000","last_change":"2021-10-08T19:25:12.809342+0000","last_active":"2021-10-08T19:26:36.635692+0000","last_peered":"2021-10-08T19:26:36.635692+0000","last_clean":"2021-10-08T19:26:36.635692+0000","last_became_active":"2021-10-08T19:25:12.809056+0000","last_became_peered":"2021-10-08T19:25:12.809056+0000","last_unstale":"2021-10-08T19:26:36.635692+0000","last_undegraded":"2021-10-08T19:26:36.635692+0000","last_fullsized":"2021-10-08T19:26:36.635692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"65'11","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:45.498659+0000","last_change":"2021-10-08T19:25:10.810482+0000","last_active":"2021-10-08T19:26:45.498659+0000","last_peered":"2021-10-08T19:26:45.498659+0000","last_clean":"2021-10-08T19:26:45.498659+0000","last_became_active":"2021-10-08T19:25:10.810238+0000","last_became_peered":"2021-10-08T19:25:10.810238+0000","last_unstale":"2021-10-08T19:26:45.498659+0000","last_undegraded":"2021-10-08T19:26:45.498659+0000","last_fullsized":"2021-10-08T19:26:45.498659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.643998+0000","last_change":"2021-10-08T19:25:06.796604+0000","last_active":"2021-10-08T19:26:36.643998+0000","last_peered":"2021-10-08T19:26:36.643998+0000","last_clean":"2021-10-08T19:26:36.643998+0000","last_became_active":"2021-10-08T19:25:06.796390+0000","last_became_peered":"2021-10-08T19:25:06.796390+0000","last_unstale":"2021-10-08T19:26:36.643998+0000","last_undegraded":"2021-10-08T19:26:36.643998+0000","last_fullsized":"2021-10-08T19:26:36.643998+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"65'15","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645193+0000","last_change":"2021-10-08T19:25:08.798857+0000","last_active":"2021-10-08T19:26:36.645193+0000","last_peered":"2021-10-08T19:26:36.645193+0000","last_clean":"2021-10-08T19:26:36.645193+0000","last_became_active":"2021-10-08T19:25:08.798579+0000","last_became_peered":"2021-10-08T19:25:08.798579+0000","last_unstale":"2021-10-08T19:26:36.645193+0000","last_undegraded":"2021-10-08T19:26:36.645193+0000","last_fullsized":"2021-10-08T19:26:36.645193+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640259+0000","last_change":"2021-10-08T19:25:12.810115+0000","last_active":"2021-10-08T19:26:36.640259+0000","last_peered":"2021-10-08T19:26:36.640259+0000","last_clean":"2021-10-08T19:26:36.640259+0000","last_became_active":"2021-10-08T19:25:12.809800+0000","last_became_peered":"2021-10-08T19:25:12.809800+0000","last_unstale":"2021-10-08T19:26:36.640259+0000","last_undegraded":"2021-10-08T19:26:36.640259+0000","last_fullsized":"2021-10-08T19:26:36.640259+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"65'11","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:45.498606+0000","last_change":"2021-10-08T19:25:10.802128+0000","last_active":"2021-10-08T19:26:45.498606+0000","last_peered":"2021-10-08T19:26:45.498606+0000","last_clean":"2021-10-08T19:26:45.498606+0000","last_became_active":"2021-10-08T19:25:10.801783+0000","last_became_peered":"2021-10-08T19:25:10.801783+0000","last_unstale":"2021-10-08T19:26:45.498606+0000","last_undegraded":"2021-10-08T19:26:45.498606+0000","last_fullsized":"2021-10-08T19:26:45.498606+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644305+0000","last_change":"2021-10-08T19:25:06.797719+0000","last_active":"2021-10-08T19:26:36.644305+0000","last_peered":"2021-10-08T19:26:36.644305+0000","last_clean":"2021-10-08T19:26:36.644305+0000","last_became_active":"2021-10-08T19:25:06.797462+0000","last_became_peered":"2021-10-08T19:25:06.797462+0000","last_unstale":"2021-10-08T19:26:36.644305+0000","last_undegraded":"2021-10-08T19:26:36.644305+0000","last_fullsized":"2021-10-08T19:26:36.644305+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"65'10","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638788+0000","last_change":"2021-10-08T19:25:08.793170+0000","last_active":"2021-10-08T19:26:36.638788+0000","last_peered":"2021-10-08T19:26:36.638788+0000","last_clean":"2021-10-08T19:26:36.638788+0000","last_became_active":"2021-10-08T19:25:08.792867+0000","last_became_peered":"2021-10-08T19:25:08.792867+0000","last_unstale":"2021-10-08T19:26:36.638788+0000","last_undegraded":"2021-10-08T19:26:36.638788+0000","last_fullsized":"2021-10-08T19:26:36.638788+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636885+0000","last_change":"2021-10-08T19:25:12.808091+0000","last_active":"2021-10-08T19:26:36.636885+0000","last_peered":"2021-10-08T19:26:36.636885+0000","last_clean":"2021-10-08T19:26:36.636885+0000","last_became_active":"2021-10-08T19:25:12.807756+0000","last_became_peered":"2021-10-08T19:25:12.807756+0000","last_unstale":"2021-10-08T19:26:36.636885+0000","last_undegraded":"2021-10-08T19:26:36.636885+0000","last_fullsized":"2021-10-08T19:26:36.636885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644284+0000","last_change":"2021-10-08T19:25:10.802949+0000","last_active":"2021-10-08T19:26:36.644284+0000","last_peered":"2021-10-08T19:26:36.644284+0000","last_clean":"2021-10-08T19:26:36.644284+0000","last_became_active":"2021-10-08T19:25:10.802627+0000","last_became_peered":"2021-10-08T19:25:10.802627+0000","last_unstale":"2021-10-08T19:26:36.644284+0000","last_undegraded":"2021-10-08T19:26:36.644284+0000","last_fullsized":"2021-10-08T19:26:36.644284+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638468+0000","last_change":"2021-10-08T19:25:06.798829+0000","last_active":"2021-10-08T19:26:36.638468+0000","last_peered":"2021-10-08T19:26:36.638468+0000","last_clean":"2021-10-08T19:26:36.638468+0000","last_became_active":"2021-10-08T19:25:06.798562+0000","last_became_peered":"2021-10-08T19:25:06.798562+0000","last_unstale":"2021-10-08T19:26:36.638468+0000","last_undegraded":"2021-10-08T19:26:36.638468+0000","last_fullsized":"2021-10-08T19:26:36.638468+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"65'17","reported_seq":46,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639430+0000","last_change":"2021-10-08T19:25:08.799362+0000","last_active":"2021-10-08T19:26:36.639430+0000","last_peered":"2021-10-08T19:26:36.639430+0000","last_clean":"2021-10-08T19:26:36.639430+0000","last_became_active":"2021-10-08T19:25:08.799053+0000","last_became_peered":"2021-10-08T19:25:08.799053+0000","last_unstale":"2021-10-08T19:26:36.639430+0000","last_undegraded":"2021-10-08T19:26:36.639430+0000","last_fullsized":"2021-10-08T19:26:36.639430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638047+0000","last_change":"2021-10-08T19:25:12.808233+0000","last_active":"2021-10-08T19:26:36.638047+0000","last_peered":"2021-10-08T19:26:36.638047+0000","last_clean":"2021-10-08T19:26:36.638047+0000","last_became_active":"2021-10-08T19:25:12.807997+0000","last_became_peered":"2021-10-08T19:25:12.807997+0000","last_unstale":"2021-10-08T19:26:36.638047+0000","last_undegraded":"2021-10-08T19:26:36.638047+0000","last_fullsized":"2021-10-08T19:26:36.638047+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636063+0000","last_change":"2021-10-08T19:25:10.809663+0000","last_active":"2021-10-08T19:26:36.636063+0000","last_peered":"2021-10-08T19:26:36.636063+0000","last_clean":"2021-10-08T19:26:36.636063+0000","last_became_active":"2021-10-08T19:25:10.809442+0000","last_became_peered":"2021-10-08T19:25:10.809442+0000","last_unstale":"2021-10-08T19:26:36.636063+0000","last_undegraded":"2021-10-08T19:26:36.636063+0000","last_fullsized":"2021-10-08T19:26:36.636063+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636336+0000","last_change":"2021-10-08T19:25:06.794320+0000","last_active":"2021-10-08T19:26:36.636336+0000","last_peered":"2021-10-08T19:26:36.636336+0000","last_clean":"2021-10-08T19:26:36.636336+0000","last_became_active":"2021-10-08T19:25:06.794025+0000","last_became_peered":"2021-10-08T19:25:06.794025+0000","last_unstale":"2021-10-08T19:26:36.636336+0000","last_undegraded":"2021-10-08T19:26:36.636336+0000","last_fullsized":"2021-10-08T19:26:36.636336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"65'19","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642285+0000","last_change":"2021-10-08T19:25:09.297649+0000","last_active":"2021-10-08T19:26:36.642285+0000","last_peered":"2021-10-08T19:26:36.642285+0000","last_clean":"2021-10-08T19:26:36.642285+0000","last_became_active":"2021-10-08T19:25:09.297357+0000","last_became_peered":"2021-10-08T19:25:09.297357+0000","last_unstale":"2021-10-08T19:26:36.642285+0000","last_undegraded":"2021-10-08T19:26:36.642285+0000","last_fullsized":"2021-10-08T19:26:36.642285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633109+0000","last_change":"2021-10-08T19:25:12.805291+0000","last_active":"2021-10-08T19:26:36.633109+0000","last_peered":"2021-10-08T19:26:36.633109+0000","last_clean":"2021-10-08T19:26:36.633109+0000","last_became_active":"2021-10-08T19:25:12.804969+0000","last_became_peered":"2021-10-08T19:25:12.804969+0000","last_unstale":"2021-10-08T19:26:36.633109+0000","last_undegraded":"2021-10-08T19:26:36.633109+0000","last_fullsized":"2021-10-08T19:26:36.633109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635221+0000","last_change":"2021-10-08T19:25:10.805439+0000","last_active":"2021-10-08T19:26:36.635221+0000","last_peered":"2021-10-08T19:26:36.635221+0000","last_clean":"2021-10-08T19:26:36.635221+0000","last_became_active":"2021-10-08T19:25:10.805133+0000","last_became_peered":"2021-10-08T19:25:10.805133+0000","last_unstale":"2021-10-08T19:26:36.635221+0000","last_undegraded":"2021-10-08T19:26:36.635221+0000","last_fullsized":"2021-10-08T19:26:36.635221+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645088+0000","last_change":"2021-10-08T19:25:06.795325+0000","last_active":"2021-10-08T19:26:36.645088+0000","last_peered":"2021-10-08T19:26:36.645088+0000","last_clean":"2021-10-08T19:26:36.645088+0000","last_became_active":"2021-10-08T19:25:06.795050+0000","last_became_peered":"2021-10-08T19:25:06.795050+0000","last_unstale":"2021-10-08T19:26:36.645088+0000","last_undegraded":"2021-10-08T19:26:36.645088+0000","last_fullsized":"2021-10-08T19:26:36.645088+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633941+0000","last_change":"2021-10-08T19:25:08.799996+0000","last_active":"2021-10-08T19:26:36.633941+0000","last_peered":"2021-10-08T19:26:36.633941+0000","last_clean":"2021-10-08T19:26:36.633941+0000","last_became_active":"2021-10-08T19:25:08.799698+0000","last_became_peered":"2021-10-08T19:25:08.799698+0000","last_unstale":"2021-10-08T19:26:36.633941+0000","last_undegraded":"2021-10-08T19:26:36.633941+0000","last_fullsized":"2021-10-08T19:26:36.633941+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635159+0000","last_change":"2021-10-08T19:25:13.232312+0000","last_active":"2021-10-08T19:26:36.635159+0000","last_peered":"2021-10-08T19:26:36.635159+0000","last_clean":"2021-10-08T19:26:36.635159+0000","last_became_active":"2021-10-08T19:25:13.232000+0000","last_became_peered":"2021-10-08T19:25:13.232000+0000","last_unstale":"2021-10-08T19:26:36.635159+0000","last_undegraded":"2021-10-08T19:26:36.635159+0000","last_fullsized":"2021-10-08T19:26:36.635159+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636918+0000","last_change":"2021-10-08T19:25:06.799739+0000","last_active":"2021-10-08T19:26:36.636918+0000","last_peered":"2021-10-08T19:26:36.636918+0000","last_clean":"2021-10-08T19:26:36.636918+0000","last_became_active":"2021-10-08T19:25:06.799444+0000","last_became_peered":"2021-10-08T19:25:06.799444+0000","last_unstale":"2021-10-08T19:26:36.636918+0000","last_undegraded":"2021-10-08T19:26:36.636918+0000","last_fullsized":"2021-10-08T19:26:36.636918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'15","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635170+0000","last_change":"2021-10-08T19:25:09.296223+0000","last_active":"2021-10-08T19:26:36.635170+0000","last_peered":"2021-10-08T19:26:36.635170+0000","last_clean":"2021-10-08T19:26:36.635170+0000","last_became_active":"2021-10-08T19:25:09.295960+0000","last_became_peered":"2021-10-08T19:25:09.295960+0000","last_unstale":"2021-10-08T19:26:36.635170+0000","last_undegraded":"2021-10-08T19:26:36.635170+0000","last_fullsized":"2021-10-08T19:26:36.635170+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"65'11","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:45.498698+0000","last_change":"2021-10-08T19:25:10.803515+0000","last_active":"2021-10-08T19:26:45.498698+0000","last_peered":"2021-10-08T19:26:45.498698+0000","last_clean":"2021-10-08T19:26:45.498698+0000","last_became_active":"2021-10-08T19:25:10.803212+0000","last_became_peered":"2021-10-08T19:25:10.803212+0000","last_unstale":"2021-10-08T19:26:45.498698+0000","last_undegraded":"2021-10-08T19:26:45.498698+0000","last_fullsized":"2021-10-08T19:26:45.498698+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":92,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":51,"seq":219043332120,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6752,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738400,"statfs":{"total":95995035648,"available":95988121600,"internally_reserved":0,"allocated":1269760,"data_stored":854233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":5.8220000000000001,"5min":5.8220000000000001,"15min":5.8220000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.298,"5min":3.298,"15min":3.298},"last":0.498}]},{"osd":3,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.441}]},{"osd":5,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.33900000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.375},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.38100000000000001}]}]},{"osd":6,"up_from":44,"seq":188978561051,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6740,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738412,"statfs":{"total":95995035648,"available":95988133888,"internally_reserved":0,"allocated":1257472,"data_stored":854814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.497,"15min":0.505},"min":{"1min":0.33500000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.498,"15min":0.502},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61799999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58499999999999996}]},{"osd":1,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51900000000000002,"15min":0.52700000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64900000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.59799999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69299999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64700000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.43099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.30099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79700000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.62}]},{"osd":5,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88600000000000001,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.497}]},{"osd":7,"last update":"Fri Oct 8 19:26:03 2021","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7028,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93738124,"statfs":{"total":95995035648,"available":95987838976,"internally_reserved":0,"allocated":700416,"data_stored":264140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:10 2021","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33200000000000002,"15min":0.33000000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.318,"5min":0.35399999999999998,"15min":0.35699999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.47699999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.435}]},{"osd":2,"last update":"Fri Oct 8 19:26:30 2021","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.37,"15min":0.372},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47099999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.24399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.42999999999999999,"15min":0.44400000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56200000000000006,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Oct 8 19:26:10 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71999999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:26:26 2021","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Oct 8 19:26:41 2021","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71299999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:26:00 2021","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67100000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7460,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93737692,"statfs":{"total":95995035648,"available":95987396608,"internally_reserved":0,"allocated":1273856,"data_stored":853943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:26:14 2021","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.33300000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.66300000000000003,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.373},{"interface":"front","average":{"1min":0.37,"5min":0.38500000000000001,"15min":0.35899999999999999},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56100000000000005,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.28999999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:26:35 2021","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.252,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.38500000000000001,"15min":0.38300000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52500000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.435,"15min":0.435},"min":{"1min":0.309,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56200000000000006,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.74199999999999999,"5min":1.79,"15min":1.79},"last":0.34300000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:26:10 2021","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.022,"5min":1.603,"15min":1.603},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Oct 8 19:26:27 2021","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.68999999999999995,"15min":0.70999999999999996},"min":{"1min":0.38900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79400000000000004,"5min":3.915,"15min":3.915},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.68600000000000005,"15min":0.71399999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81100000000000005,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:26:42 2021","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":1.268,"15min":1.268},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.67700000000000005,"15min":0.69599999999999995},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":2.851,"15min":2.851},"last":0.42299999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:26:00 2021","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.60099999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411370,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6684,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":6016,"kb_avail":93738468,"statfs":{"total":95995035648,"available":95988191232,"internally_reserved":0,"allocated":675840,"data_stored":265157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6160384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:27 2021","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34699999999999998,"15min":0.34999999999999998},"min":{"1min":0.216,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.5,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.23599999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.42599999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.36499999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:27 2021","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.37,"15min":0.375},"min":{"1min":0.23300000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.39000000000000001,"15min":0.39500000000000002},"min":{"1min":0.24399999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.495,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:26:49 2021","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.41199999999999998,"15min":0.42699999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.443,"15min":0.44500000000000001},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52900000000000003,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.38}]},{"osd":4,"last update":"Fri Oct 8 19:26:09 2021","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:26:26 2021","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.372,"15min":0.372},"max":{"1min":0.754,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:26:44 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58599999999999997,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.624}]},{"osd":7,"last update":"Fri Oct 8 19:26:02 2021","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57299999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182440,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6316,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738836,"statfs":{"total":95995035648,"available":95988568064,"internally_reserved":0,"allocated":692224,"data_stored":264048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36299999999999999,"15min":0.37},"min":{"1min":0.23499999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.44500000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.39200000000000002,"15min":0.40999999999999998},"min":{"1min":0.245,"5min":0.189,"15min":0.189},"max":{"1min":0.46100000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.30099999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.39300000000000002,"15min":0.40899999999999997},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48899999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.40899999999999997,"15min":0.42699999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48799999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.432,"15min":0.45200000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.47799999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.41099999999999998,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51300000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:26:04 2021","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.308,"15min":0.308},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51900000000000002,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.77100000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:26:27 2021","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.45000000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:26:43 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75900000000000001,"5min":0.871,"15min":0.871},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72899999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.47799999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:26:01 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.442}]}]},{"osd":4,"up_from":30,"seq":128849018916,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6308,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738844,"statfs":{"total":95995035648,"available":95988576256,"internally_reserved":0,"allocated":684032,"data_stored":264074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:07 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:07 2021","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51500000000000001,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.748,"5min":0.75,"15min":0.75},"last":0.435}]},{"osd":2,"last update":"Fri Oct 8 19:26:07 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.5,"15min":0.504},"min":{"1min":0.33400000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70099999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:26:07 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.37},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:26:43 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.44900000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42199999999999999,"15min":0.41399999999999998},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:26:02 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.40000000000000002}]}]},{"osd":5,"up_from":37,"seq":158913789983,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6164,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738988,"statfs":{"total":95995035648,"available":95988723712,"internally_reserved":0,"allocated":667648,"data_stored":264430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:23 2021","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.498},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47799999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.495,"15min":0.505},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65600000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.435}]},{"osd":3,"last update":"Fri Oct 8 19:26:23 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.373,"5min":0.311,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.39300000000000002},"min":{"1min":0.33800000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33100000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:26:43 2021","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.42399999999999999,"15min":0.41799999999999998},"min":{"1min":0.318,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40600000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:25:59 2021","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.39200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:26:56.604 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:26:56.881 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:57.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:56 smithi157 ceph-mon[32847]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:57.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:56 smithi157 ceph-mon[42114]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:57.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:56 smithi196 ceph-mon[34258]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:57.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:26:56 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:26:58.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:57 smithi157 ceph-mon[32847]: from='client.24685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:26:58.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:57 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:58.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:57 smithi157 ceph-mon[42114]: from='client.24685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:26:58.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:57 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:58.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:57 smithi196 ceph-mon[34258]: from='client.24685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:26:58.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:57 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:58.118 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-10-08T19:26:58.118 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-10-08T19:26:58.118 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-10-08T19:26:58.118 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-10-08T19:26:58.119 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-10-08T19:26:58.119 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-10-08T19:26:58.119 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-10-08T19:26:58.119 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-10-08T19:26:58.120 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-10-08T19:26:58.120 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-10-08T19:26:58.120 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-10-08T19:26:58.120 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-10-08T19:26:58.121 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-10-08T19:26:58.121 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-10-08T19:26:58.121 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-10-08T19:26:58.121 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-10-08T19:26:58.122 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-10-08T19:26:58.122 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-10-08T19:26:58.122 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-10-08T19:26:58.122 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-10-08T19:26:58.122 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-10-08T19:26:58.123 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-10-08T19:26:58.123 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-10-08T19:26:58.123 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-10-08T19:26:58.123 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-10-08T19:26:58.124 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-10-08T19:26:58.124 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-10-08T19:26:58.124 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-10-08T19:26:58.124 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-10-08T19:26:58.124 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - time" source="node_exporter.go:104" 2021-10-08T19:26:58.125 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-10-08T19:26:58.125 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-10-08T19:26:58.125 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-10-08T19:26:58.126 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-10-08T19:26:58.126 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 conmon[65377]: time="2021-10-08T19:26:57Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-10-08T19:26:58.126 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 bash[64526]: 0812c964c43b5e47271d45b954ade4341947708e7efb1a857f1a39c864c6c544 2021-10-08T19:26:58.126 INFO:journalctl@ceph.node-exporter.b.smithi196.stdout:Oct 08 19:26:57 smithi196 systemd[1]: Started Ceph node-exporter.b for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:26:58.409 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.406+0000 7faec359e700 1 -- 172.21.15.157:0/1361155275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faec40f7c80 msgr2=0x7faec41042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:58.410 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.406+0000 7faec359e700 1 --2- 172.21.15.157:0/1361155275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faec40f7c80 0x7faec41042b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faebc009ab0 tx=0x7faebc004c50 comp rx=0 tx=0).stop 2021-10-08T19:26:58.410 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 -- 172.21.15.157:0/1361155275 shutdown_connections 2021-10-08T19:26:58.410 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 --2- 172.21.15.157:0/1361155275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faec40f7c80 0x7faec41042b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:58.411 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 --2- 172.21.15.157:0/1361155275 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faec40fd4b0 0x7faec40fd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:58.411 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 --2- 172.21.15.157:0/1361155275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faec40fde50 0x7faec40f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:58.411 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 -- 172.21.15.157:0/1361155275 >> 172.21.15.157:0/1361155275 conn(0x7faec406e310 msgr2=0x7faec406e710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:58.412 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 -- 172.21.15.157:0/1361155275 shutdown_connections 2021-10-08T19:26:58.412 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 -- 172.21.15.157:0/1361155275 wait complete. 2021-10-08T19:26:58.412 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 Processor -- start 2021-10-08T19:26:58.413 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 -- start start 2021-10-08T19:26:58.413 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faec40f7c80 0x7faec410e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:58.413 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faec40fd4b0 0x7faec410ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:58.413 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faec40fde50 0x7faec41085b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:58.413 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec4108b30 con 0x7faec40fd4b0 2021-10-08T19:26:58.414 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec4108ca0 con 0x7faec40fde50 2021-10-08T19:26:58.414 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec359e700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec4108e60 con 0x7faec40f7c80 2021-10-08T19:26:58.415 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec259c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faec40f7c80 0x7faec410e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:58.415 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec259c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faec40f7c80 0x7faec410e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50498/0 (socket says 172.21.15.157:50498) 2021-10-08T19:26:58.415 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.407+0000 7faec259c700 1 -- 172.21.15.157:0/3318655830 learned_addr learned my addr 172.21.15.157:0/3318655830 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:26:58.415 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec1d9b700 1 --2- 172.21.15.157:0/3318655830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faec40fd4b0 0x7faec410ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:58.416 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec2d9d700 1 --2- 172.21.15.157:0/3318655830 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faec40fde50 0x7faec41085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:58.416 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec259c700 1 -- 172.21.15.157:0/3318655830 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faec40fde50 msgr2=0x7faec41085b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:58.416 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec259c700 1 --2- 172.21.15.157:0/3318655830 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faec40fde50 0x7faec41085b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:58.416 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec259c700 1 -- 172.21.15.157:0/3318655830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faec40fd4b0 msgr2=0x7faec410ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:58.416 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec259c700 1 --2- 172.21.15.157:0/3318655830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faec40fd4b0 0x7faec410ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:58.417 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec259c700 1 -- 172.21.15.157:0/3318655830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8005040 con 0x7faec40f7c80 2021-10-08T19:26:58.417 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec259c700 1 --2- 172.21.15.157:0/3318655830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faec40f7c80 0x7faec410e6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faeb4002780 tx=0x7faeb4009e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:58.417 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faeb2ffd700 1 -- 172.21.15.157:0/3318655830 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40092e0 con 0x7faec40f7c80 2021-10-08T19:26:58.417 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faeb2ffd700 1 -- 172.21.15.157:0/3318655830 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7faeb400f040 con 0x7faec40f7c80 2021-10-08T19:26:58.418 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faeb2ffd700 1 -- 172.21.15.157:0/3318655830 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4013810 con 0x7faec40f7c80 2021-10-08T19:26:58.418 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc009640 con 0x7faec40f7c80 2021-10-08T19:26:58.418 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.408+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec4115540 con 0x7faec40f7c80 2021-10-08T19:26:58.418 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.409+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec406fe30 con 0x7faec40f7c80 2021-10-08T19:26:58.420 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.410+0000 7faeb2ffd700 1 -- 172.21.15.157:0/3318655830 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7faeb401a030 con 0x7faec40f7c80 2021-10-08T19:26:58.420 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.410+0000 7faeb2ffd700 1 --2- 172.21.15.157:0/3318655830 >> v2:172.21.15.157:6800/1475557172 conn(0x7faeac0635a0 0x7faeac065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:58.420 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.410+0000 7faeb2ffd700 1 -- 172.21.15.157:0/3318655830 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6281+0+0 (secure 0 0 0) 0x7faeb407f620 con 0x7faec40f7c80 2021-10-08T19:26:58.421 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.410+0000 7faec1d9b700 1 --2- 172.21.15.157:0/3318655830 >> v2:172.21.15.157:6800/1475557172 conn(0x7faeac0635a0 0x7faeac065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:58.421 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.411+0000 7faec1d9b700 1 --2- 172.21.15.157:0/3318655830 >> v2:172.21.15.157:6800/1475557172 conn(0x7faeac0635a0 0x7faeac065a50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faec4109fb0 tx=0x7faeb800b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:58.421 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.414+0000 7faeb2ffd700 1 -- 172.21.15.157:0/3318655830 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7faeb40522b0 con 0x7faec40f7c80 2021-10-08T19:26:58.588 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.588+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 --> v2:172.21.15.157:6800/1475557172 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faec4109d60 con 0x7faeac0635a0 2021-10-08T19:26:58.600 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.598+0000 7faeb2ffd700 1 -- 172.21.15.157:0/3318655830 <== mgr.24490 v2:172.21.15.157:6800/1475557172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359660 (secure 0 0 0) 0x7faec4109d60 con 0x7faeac0635a0 2021-10-08T19:26:58.605 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:26:58.608 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 >> v2:172.21.15.157:6800/1475557172 conn(0x7faeac0635a0 msgr2=0x7faeac065a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:58.608 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 --2- 172.21.15.157:0/3318655830 >> v2:172.21.15.157:6800/1475557172 conn(0x7faeac0635a0 0x7faeac065a50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faec4109fb0 tx=0x7faeb800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:58.608 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faec40f7c80 msgr2=0x7faec410e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:58.608 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 --2- 172.21.15.157:0/3318655830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faec40f7c80 0x7faec410e6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faeb4002780 tx=0x7faeb4009e00 comp rx=0 tx=0).stop 2021-10-08T19:26:58.609 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 shutdown_connections 2021-10-08T19:26:58.609 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 --2- 172.21.15.157:0/3318655830 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faec40fde50 0x7faec41085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:58.609 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 --2- 172.21.15.157:0/3318655830 >> v2:172.21.15.157:6800/1475557172 conn(0x7faeac0635a0 0x7faeac065a50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:58.609 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 --2- 172.21.15.157:0/3318655830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faec40f7c80 0x7faec410e6d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:58.610 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 --2- 172.21.15.157:0/3318655830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faec40fd4b0 0x7faec410ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:58.610 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 >> 172.21.15.157:0/3318655830 conn(0x7faec406e310 msgr2=0x7faec4061960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:58.610 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 shutdown_connections 2021-10-08T19:26:58.610 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:26:58.601+0000 7faec359e700 1 -- 172.21.15.157:0/3318655830 wait complete. 2021-10-08T19:26:58.611 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2021-10-08T19:26:58.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[32847]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:58.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[32847]: poll took 7637.254 ms: 1 events 2021-10-08T19:26:58.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:58.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[32847]: Sending message to agent on host smithi157 2021-10-08T19:26:58.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[32847]: Sending message to agent on host smithi196 2021-10-08T19:26:58.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[32847]: Deploying daemon prometheus.a on smithi196 2021-10-08T19:26:58.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[42114]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:58.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[42114]: poll took 7637.254 ms: 1 events 2021-10-08T19:26:58.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:58.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[42114]: Sending message to agent on host smithi157 2021-10-08T19:26:58.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[42114]: Sending message to agent on host smithi196 2021-10-08T19:26:58.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:58 smithi157 ceph-mon[42114]: Deploying daemon prometheus.a on smithi196 2021-10-08T19:26:59.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:58 smithi196 ceph-mon[34258]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:59.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:58 smithi196 ceph-mon[34258]: poll took 7637.254 ms: 1 events 2021-10-08T19:26:59.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:58 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:26:59.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:58 smithi196 ceph-mon[34258]: Sending message to agent on host smithi157 2021-10-08T19:26:59.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:58 smithi196 ceph-mon[34258]: Sending message to agent on host smithi196 2021-10-08T19:26:59.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:58 smithi196 ceph-mon[34258]: Deploying daemon prometheus.a on smithi196 2021-10-08T19:26:59.667 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2021-10-08T19:26:57.644263+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":1059,"num_read_kb":904,"num_write":607,"num_write_kb":2457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1771682,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":620,"ondisk_log_size":620,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":53452,"kb_used_data":7052,"kb_used_omap":0,"kb_used_meta":46336,"kb_avail":749907764,"statfs":{"total":767960285184,"available":767905550336,"internally_reserved":0,"allocated":7221248,"data_stored":3884839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47448064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002603"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640294+0000","last_change":"2021-10-08T19:25:13.234037+0000","last_active":"2021-10-08T19:26:36.640294+0000","last_peered":"2021-10-08T19:26:36.640294+0000","last_clean":"2021-10-08T19:26:36.640294+0000","last_became_active":"2021-10-08T19:25:13.233702+0000","last_became_peered":"2021-10-08T19:25:13.233702+0000","last_unstale":"2021-10-08T19:26:36.640294+0000","last_undegraded":"2021-10-08T19:26:36.640294+0000","last_fullsized":"2021-10-08T19:26:36.640294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.637715+0000","last_change":"2021-10-08T19:25:10.812695+0000","last_active":"2021-10-08T19:26:36.637715+0000","last_peered":"2021-10-08T19:26:36.637715+0000","last_clean":"2021-10-08T19:26:36.637715+0000","last_became_active":"2021-10-08T19:25:10.812427+0000","last_became_peered":"2021-10-08T19:25:10.812427+0000","last_unstale":"2021-10-08T19:26:36.637715+0000","last_undegraded":"2021-10-08T19:26:36.637715+0000","last_fullsized":"2021-10-08T19:26:36.637715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633764+0000","last_change":"2021-10-08T19:25:06.793128+0000","last_active":"2021-10-08T19:26:36.633764+0000","last_peered":"2021-10-08T19:26:36.633764+0000","last_clean":"2021-10-08T19:26:36.633764+0000","last_became_active":"2021-10-08T19:25:06.792869+0000","last_became_peered":"2021-10-08T19:25:06.792869+0000","last_unstale":"2021-10-08T19:26:36.633764+0000","last_undegraded":"2021-10-08T19:26:36.633764+0000","last_fullsized":"2021-10-08T19:26:36.633764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"65'15","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640535+0000","last_change":"2021-10-08T19:25:08.798563+0000","last_active":"2021-10-08T19:26:36.640535+0000","last_peered":"2021-10-08T19:26:36.640535+0000","last_clean":"2021-10-08T19:26:36.640535+0000","last_became_active":"2021-10-08T19:25:08.797470+0000","last_became_peered":"2021-10-08T19:25:08.797470+0000","last_unstale":"2021-10-08T19:26:36.640535+0000","last_undegraded":"2021-10-08T19:26:36.640535+0000","last_fullsized":"2021-10-08T19:26:36.640535+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.637990+0000","last_change":"2021-10-08T19:25:12.810056+0000","last_active":"2021-10-08T19:26:36.637990+0000","last_peered":"2021-10-08T19:26:36.637990+0000","last_clean":"2021-10-08T19:26:36.637990+0000","last_became_active":"2021-10-08T19:25:12.809779+0000","last_became_peered":"2021-10-08T19:25:12.809779+0000","last_unstale":"2021-10-08T19:26:36.637990+0000","last_undegraded":"2021-10-08T19:26:36.637990+0000","last_fullsized":"2021-10-08T19:26:36.637990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.643919+0000","last_change":"2021-10-08T19:25:10.797530+0000","last_active":"2021-10-08T19:26:36.643919+0000","last_peered":"2021-10-08T19:26:36.643919+0000","last_clean":"2021-10-08T19:26:36.643919+0000","last_became_active":"2021-10-08T19:25:10.797285+0000","last_became_peered":"2021-10-08T19:25:10.797285+0000","last_unstale":"2021-10-08T19:26:36.643919+0000","last_undegraded":"2021-10-08T19:26:36.643919+0000","last_fullsized":"2021-10-08T19:26:36.643919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641488+0000","last_change":"2021-10-08T19:25:06.794560+0000","last_active":"2021-10-08T19:26:36.641488+0000","last_peered":"2021-10-08T19:26:36.641488+0000","last_clean":"2021-10-08T19:26:36.641488+0000","last_became_active":"2021-10-08T19:25:06.794255+0000","last_became_peered":"2021-10-08T19:25:06.794255+0000","last_unstale":"2021-10-08T19:26:36.641488+0000","last_undegraded":"2021-10-08T19:26:36.641488+0000","last_fullsized":"2021-10-08T19:26:36.641488+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638048+0000","last_change":"2021-10-08T19:25:08.797795+0000","last_active":"2021-10-08T19:26:36.638048+0000","last_peered":"2021-10-08T19:26:36.638048+0000","last_clean":"2021-10-08T19:26:36.638048+0000","last_became_active":"2021-10-08T19:25:08.797492+0000","last_became_peered":"2021-10-08T19:25:08.797492+0000","last_unstale":"2021-10-08T19:26:36.638048+0000","last_undegraded":"2021-10-08T19:26:36.638048+0000","last_fullsized":"2021-10-08T19:26:36.638048+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635180+0000","last_change":"2021-10-08T19:25:12.808757+0000","last_active":"2021-10-08T19:26:36.635180+0000","last_peered":"2021-10-08T19:26:36.635180+0000","last_clean":"2021-10-08T19:26:36.635180+0000","last_became_active":"2021-10-08T19:25:12.808578+0000","last_became_peered":"2021-10-08T19:25:12.808578+0000","last_unstale":"2021-10-08T19:26:36.635180+0000","last_undegraded":"2021-10-08T19:26:36.635180+0000","last_fullsized":"2021-10-08T19:26:36.635180+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639566+0000","last_change":"2021-10-08T19:25:10.803470+0000","last_active":"2021-10-08T19:26:36.639566+0000","last_peered":"2021-10-08T19:26:36.639566+0000","last_clean":"2021-10-08T19:26:36.639566+0000","last_became_active":"2021-10-08T19:25:10.803195+0000","last_became_peered":"2021-10-08T19:25:10.803195+0000","last_unstale":"2021-10-08T19:26:36.639566+0000","last_undegraded":"2021-10-08T19:26:36.639566+0000","last_fullsized":"2021-10-08T19:26:36.639566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639585+0000","last_change":"2021-10-08T19:25:06.800415+0000","last_active":"2021-10-08T19:26:36.639585+0000","last_peered":"2021-10-08T19:26:36.639585+0000","last_clean":"2021-10-08T19:26:36.639585+0000","last_became_active":"2021-10-08T19:25:06.799849+0000","last_became_peered":"2021-10-08T19:25:06.799849+0000","last_unstale":"2021-10-08T19:26:36.639585+0000","last_undegraded":"2021-10-08T19:26:36.639585+0000","last_fullsized":"2021-10-08T19:26:36.639585+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"65'5","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638735+0000","last_change":"2021-10-08T19:25:08.798935+0000","last_active":"2021-10-08T19:26:36.638735+0000","last_peered":"2021-10-08T19:26:36.638735+0000","last_clean":"2021-10-08T19:26:36.638735+0000","last_became_active":"2021-10-08T19:25:08.798623+0000","last_became_peered":"2021-10-08T19:25:08.798623+0000","last_unstale":"2021-10-08T19:26:36.638735+0000","last_undegraded":"2021-10-08T19:26:36.638735+0000","last_fullsized":"2021-10-08T19:26:36.638735+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633867+0000","last_change":"2021-10-08T19:25:12.811085+0000","last_active":"2021-10-08T19:26:36.633867+0000","last_peered":"2021-10-08T19:26:36.633867+0000","last_clean":"2021-10-08T19:26:36.633867+0000","last_became_active":"2021-10-08T19:25:12.810513+0000","last_became_peered":"2021-10-08T19:25:12.810513+0000","last_unstale":"2021-10-08T19:26:36.633867+0000","last_undegraded":"2021-10-08T19:26:36.633867+0000","last_fullsized":"2021-10-08T19:26:36.633867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635473+0000","last_change":"2021-10-08T19:25:10.808890+0000","last_active":"2021-10-08T19:26:36.635473+0000","last_peered":"2021-10-08T19:26:36.635473+0000","last_clean":"2021-10-08T19:26:36.635473+0000","last_became_active":"2021-10-08T19:25:10.808621+0000","last_became_peered":"2021-10-08T19:25:10.808621+0000","last_unstale":"2021-10-08T19:26:36.635473+0000","last_undegraded":"2021-10-08T19:26:36.635473+0000","last_fullsized":"2021-10-08T19:26:36.635473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638615+0000","last_change":"2021-10-08T19:25:06.798516+0000","last_active":"2021-10-08T19:26:36.638615+0000","last_peered":"2021-10-08T19:26:36.638615+0000","last_clean":"2021-10-08T19:26:36.638615+0000","last_became_active":"2021-10-08T19:25:06.798179+0000","last_became_peered":"2021-10-08T19:25:06.798179+0000","last_unstale":"2021-10-08T19:26:36.638615+0000","last_undegraded":"2021-10-08T19:26:36.638615+0000","last_fullsized":"2021-10-08T19:26:36.638615+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638097+0000","last_change":"2021-10-08T19:25:08.792044+0000","last_active":"2021-10-08T19:26:36.638097+0000","last_peered":"2021-10-08T19:26:36.638097+0000","last_clean":"2021-10-08T19:26:36.638097+0000","last_became_active":"2021-10-08T19:25:08.791781+0000","last_became_peered":"2021-10-08T19:25:08.791781+0000","last_unstale":"2021-10-08T19:26:36.638097+0000","last_undegraded":"2021-10-08T19:26:36.638097+0000","last_fullsized":"2021-10-08T19:26:36.638097+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641850+0000","last_change":"2021-10-08T19:25:13.232350+0000","last_active":"2021-10-08T19:26:36.641850+0000","last_peered":"2021-10-08T19:26:36.641850+0000","last_clean":"2021-10-08T19:26:36.641850+0000","last_became_active":"2021-10-08T19:25:13.231890+0000","last_became_peered":"2021-10-08T19:25:13.231890+0000","last_unstale":"2021-10-08T19:26:36.641850+0000","last_undegraded":"2021-10-08T19:26:36.641850+0000","last_fullsized":"2021-10-08T19:26:36.641850+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638930+0000","last_change":"2021-10-08T19:25:10.809689+0000","last_active":"2021-10-08T19:26:36.638930+0000","last_peered":"2021-10-08T19:26:36.638930+0000","last_clean":"2021-10-08T19:26:36.638930+0000","last_became_active":"2021-10-08T19:25:10.805244+0000","last_became_peered":"2021-10-08T19:25:10.805244+0000","last_unstale":"2021-10-08T19:26:36.638930+0000","last_undegraded":"2021-10-08T19:26:36.638930+0000","last_fullsized":"2021-10-08T19:26:36.638930+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640448+0000","last_change":"2021-10-08T19:25:06.797089+0000","last_active":"2021-10-08T19:26:36.640448+0000","last_peered":"2021-10-08T19:26:36.640448+0000","last_clean":"2021-10-08T19:26:36.640448+0000","last_became_active":"2021-10-08T19:25:06.796824+0000","last_became_peered":"2021-10-08T19:25:06.796824+0000","last_unstale":"2021-10-08T19:26:36.640448+0000","last_undegraded":"2021-10-08T19:26:36.640448+0000","last_fullsized":"2021-10-08T19:26:36.640448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"65'12","reported_seq":62,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:37.735568+0000","last_change":"2021-10-08T19:26:37.735568+0000","last_active":"2021-10-08T19:26:37.735568+0000","last_peered":"2021-10-08T19:26:37.735568+0000","last_clean":"2021-10-08T19:26:37.735568+0000","last_became_active":"2021-10-08T19:26:37.645200+0000","last_became_peered":"2021-10-08T19:26:37.645200+0000","last_unstale":"2021-10-08T19:26:37.735568+0000","last_undegraded":"2021-10-08T19:26:37.735568+0000","last_fullsized":"2021-10-08T19:26:37.735568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640428+0000","last_change":"2021-10-08T19:25:13.232166+0000","last_active":"2021-10-08T19:26:36.640428+0000","last_peered":"2021-10-08T19:26:36.640428+0000","last_clean":"2021-10-08T19:26:36.640428+0000","last_became_active":"2021-10-08T19:25:13.231847+0000","last_became_peered":"2021-10-08T19:25:13.231847+0000","last_unstale":"2021-10-08T19:26:36.640428+0000","last_undegraded":"2021-10-08T19:26:36.640428+0000","last_fullsized":"2021-10-08T19:26:36.640428+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645007+0000","last_change":"2021-10-08T19:25:10.808029+0000","last_active":"2021-10-08T19:26:36.645007+0000","last_peered":"2021-10-08T19:26:36.645007+0000","last_clean":"2021-10-08T19:26:36.645007+0000","last_became_active":"2021-10-08T19:25:10.807755+0000","last_became_peered":"2021-10-08T19:25:10.807755+0000","last_unstale":"2021-10-08T19:26:36.645007+0000","last_undegraded":"2021-10-08T19:26:36.645007+0000","last_fullsized":"2021-10-08T19:26:36.645007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642455+0000","last_change":"2021-10-08T19:25:06.795910+0000","last_active":"2021-10-08T19:26:36.642455+0000","last_peered":"2021-10-08T19:26:36.642455+0000","last_clean":"2021-10-08T19:26:36.642455+0000","last_became_active":"2021-10-08T19:25:06.795604+0000","last_became_peered":"2021-10-08T19:25:06.795604+0000","last_unstale":"2021-10-08T19:26:36.642455+0000","last_undegraded":"2021-10-08T19:26:36.642455+0000","last_fullsized":"2021-10-08T19:26:36.642455+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"65'15","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636399+0000","last_change":"2021-10-08T19:25:08.800863+0000","last_active":"2021-10-08T19:26:36.636399+0000","last_peered":"2021-10-08T19:26:36.636399+0000","last_clean":"2021-10-08T19:26:36.636399+0000","last_became_active":"2021-10-08T19:25:08.800613+0000","last_became_peered":"2021-10-08T19:25:08.800613+0000","last_unstale":"2021-10-08T19:26:36.636399+0000","last_undegraded":"2021-10-08T19:26:36.636399+0000","last_fullsized":"2021-10-08T19:26:36.636399+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644901+0000","last_change":"2021-10-08T19:25:12.810864+0000","last_active":"2021-10-08T19:26:36.644901+0000","last_peered":"2021-10-08T19:26:36.644901+0000","last_clean":"2021-10-08T19:26:36.644901+0000","last_became_active":"2021-10-08T19:25:12.810357+0000","last_became_peered":"2021-10-08T19:25:12.810357+0000","last_unstale":"2021-10-08T19:26:36.644901+0000","last_undegraded":"2021-10-08T19:26:36.644901+0000","last_fullsized":"2021-10-08T19:26:36.644901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.634029+0000","last_change":"2021-10-08T19:25:10.800055+0000","last_active":"2021-10-08T19:26:36.634029+0000","last_peered":"2021-10-08T19:26:36.634029+0000","last_clean":"2021-10-08T19:26:36.634029+0000","last_became_active":"2021-10-08T19:25:10.799732+0000","last_became_peered":"2021-10-08T19:25:10.799732+0000","last_unstale":"2021-10-08T19:26:36.634029+0000","last_undegraded":"2021-10-08T19:26:36.634029+0000","last_fullsized":"2021-10-08T19:26:36.634029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640199+0000","last_change":"2021-10-08T19:25:06.795274+0000","last_active":"2021-10-08T19:26:36.640199+0000","last_peered":"2021-10-08T19:26:36.640199+0000","last_clean":"2021-10-08T19:26:36.640199+0000","last_became_active":"2021-10-08T19:25:06.794991+0000","last_became_peered":"2021-10-08T19:25:06.794991+0000","last_unstale":"2021-10-08T19:26:36.640199+0000","last_undegraded":"2021-10-08T19:26:36.640199+0000","last_fullsized":"2021-10-08T19:26:36.640199+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"65'11","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642628+0000","last_change":"2021-10-08T19:25:08.800038+0000","last_active":"2021-10-08T19:26:36.642628+0000","last_peered":"2021-10-08T19:26:36.642628+0000","last_clean":"2021-10-08T19:26:36.642628+0000","last_became_active":"2021-10-08T19:25:08.799677+0000","last_became_peered":"2021-10-08T19:25:08.799677+0000","last_unstale":"2021-10-08T19:26:36.642628+0000","last_undegraded":"2021-10-08T19:26:36.642628+0000","last_fullsized":"2021-10-08T19:26:36.642628+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"65'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639333+0000","last_change":"2021-10-08T19:25:12.806228+0000","last_active":"2021-10-08T19:26:36.639333+0000","last_peered":"2021-10-08T19:26:36.639333+0000","last_clean":"2021-10-08T19:26:36.639333+0000","last_became_active":"2021-10-08T19:25:12.805954+0000","last_became_peered":"2021-10-08T19:25:12.805954+0000","last_unstale":"2021-10-08T19:26:36.639333+0000","last_undegraded":"2021-10-08T19:26:36.639333+0000","last_fullsized":"2021-10-08T19:26:36.639333+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"65'11","reported_seq":52,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:50.499416+0000","last_change":"2021-10-08T19:25:10.811115+0000","last_active":"2021-10-08T19:26:50.499416+0000","last_peered":"2021-10-08T19:26:50.499416+0000","last_clean":"2021-10-08T19:26:50.499416+0000","last_became_active":"2021-10-08T19:25:10.809828+0000","last_became_peered":"2021-10-08T19:25:10.809828+0000","last_unstale":"2021-10-08T19:26:50.499416+0000","last_undegraded":"2021-10-08T19:26:50.499416+0000","last_fullsized":"2021-10-08T19:26:50.499416+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635049+0000","last_change":"2021-10-08T19:25:06.798405+0000","last_active":"2021-10-08T19:26:36.635049+0000","last_peered":"2021-10-08T19:26:36.635049+0000","last_clean":"2021-10-08T19:26:36.635049+0000","last_became_active":"2021-10-08T19:25:06.798113+0000","last_became_peered":"2021-10-08T19:25:06.798113+0000","last_unstale":"2021-10-08T19:26:36.635049+0000","last_undegraded":"2021-10-08T19:26:36.635049+0000","last_fullsized":"2021-10-08T19:26:36.635049+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"65'10","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633958+0000","last_change":"2021-10-08T19:25:09.297700+0000","last_active":"2021-10-08T19:26:36.633958+0000","last_peered":"2021-10-08T19:26:36.633958+0000","last_clean":"2021-10-08T19:26:36.633958+0000","last_became_active":"2021-10-08T19:25:09.297395+0000","last_became_peered":"2021-10-08T19:25:09.297395+0000","last_unstale":"2021-10-08T19:26:36.633958+0000","last_undegraded":"2021-10-08T19:26:36.633958+0000","last_fullsized":"2021-10-08T19:26:36.633958+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640585+0000","last_change":"2021-10-08T19:25:13.234270+0000","last_active":"2021-10-08T19:26:36.640585+0000","last_peered":"2021-10-08T19:26:36.640585+0000","last_clean":"2021-10-08T19:26:36.640585+0000","last_became_active":"2021-10-08T19:25:13.233880+0000","last_became_peered":"2021-10-08T19:25:13.233880+0000","last_unstale":"2021-10-08T19:26:36.640585+0000","last_undegraded":"2021-10-08T19:26:36.640585+0000","last_fullsized":"2021-10-08T19:26:36.640585+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639600+0000","last_change":"2021-10-08T19:25:10.802684+0000","last_active":"2021-10-08T19:26:36.639600+0000","last_peered":"2021-10-08T19:26:36.639600+0000","last_clean":"2021-10-08T19:26:36.639600+0000","last_became_active":"2021-10-08T19:25:10.802371+0000","last_became_peered":"2021-10-08T19:25:10.802371+0000","last_unstale":"2021-10-08T19:26:36.639600+0000","last_undegraded":"2021-10-08T19:26:36.639600+0000","last_fullsized":"2021-10-08T19:26:36.639600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"57'1","reported_seq":31,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642784+0000","last_change":"2021-10-08T19:25:06.801424+0000","last_active":"2021-10-08T19:26:36.642784+0000","last_peered":"2021-10-08T19:26:36.642784+0000","last_clean":"2021-10-08T19:26:36.642784+0000","last_became_active":"2021-10-08T19:25:06.801103+0000","last_became_peered":"2021-10-08T19:25:06.801103+0000","last_unstale":"2021-10-08T19:26:36.642784+0000","last_undegraded":"2021-10-08T19:26:36.642784+0000","last_fullsized":"2021-10-08T19:26:36.642784+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"65'11","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640428+0000","last_change":"2021-10-08T19:25:09.297862+0000","last_active":"2021-10-08T19:26:36.640428+0000","last_peered":"2021-10-08T19:26:36.640428+0000","last_clean":"2021-10-08T19:26:36.640428+0000","last_became_active":"2021-10-08T19:25:09.297573+0000","last_became_peered":"2021-10-08T19:25:09.297573+0000","last_unstale":"2021-10-08T19:26:36.640428+0000","last_undegraded":"2021-10-08T19:26:36.640428+0000","last_fullsized":"2021-10-08T19:26:36.640428+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638367+0000","last_change":"2021-10-08T19:25:12.802665+0000","last_active":"2021-10-08T19:26:36.638367+0000","last_peered":"2021-10-08T19:26:36.638367+0000","last_clean":"2021-10-08T19:26:36.638367+0000","last_became_active":"2021-10-08T19:25:12.802363+0000","last_became_peered":"2021-10-08T19:25:12.802363+0000","last_unstale":"2021-10-08T19:26:36.638367+0000","last_undegraded":"2021-10-08T19:26:36.638367+0000","last_fullsized":"2021-10-08T19:26:36.638367+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642664+0000","last_change":"2021-10-08T19:25:10.810656+0000","last_active":"2021-10-08T19:26:36.642664+0000","last_peered":"2021-10-08T19:26:36.642664+0000","last_clean":"2021-10-08T19:26:36.642664+0000","last_became_active":"2021-10-08T19:25:10.809891+0000","last_became_peered":"2021-10-08T19:25:10.809891+0000","last_unstale":"2021-10-08T19:26:36.642664+0000","last_undegraded":"2021-10-08T19:26:36.642664+0000","last_fullsized":"2021-10-08T19:26:36.642664+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635987+0000","last_change":"2021-10-08T19:25:06.796997+0000","last_active":"2021-10-08T19:26:36.635987+0000","last_peered":"2021-10-08T19:26:36.635987+0000","last_clean":"2021-10-08T19:26:36.635987+0000","last_became_active":"2021-10-08T19:25:06.796724+0000","last_became_peered":"2021-10-08T19:25:06.796724+0000","last_unstale":"2021-10-08T19:26:36.635987+0000","last_undegraded":"2021-10-08T19:26:36.635987+0000","last_fullsized":"2021-10-08T19:26:36.635987+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"65'4","reported_seq":39,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:37.908430+0000","last_change":"2021-10-08T19:26:37.908430+0000","last_active":"2021-10-08T19:26:37.908430+0000","last_peered":"2021-10-08T19:26:37.908430+0000","last_clean":"2021-10-08T19:26:37.908430+0000","last_became_active":"2021-10-08T19:26:37.645534+0000","last_became_peered":"2021-10-08T19:26:37.645534+0000","last_unstale":"2021-10-08T19:26:37.908430+0000","last_undegraded":"2021-10-08T19:26:37.908430+0000","last_fullsized":"2021-10-08T19:26:37.908430+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640074+0000","last_change":"2021-10-08T19:25:12.805312+0000","last_active":"2021-10-08T19:26:36.640074+0000","last_peered":"2021-10-08T19:26:36.640074+0000","last_clean":"2021-10-08T19:26:36.640074+0000","last_became_active":"2021-10-08T19:25:12.804831+0000","last_became_peered":"2021-10-08T19:25:12.804831+0000","last_unstale":"2021-10-08T19:26:36.640074+0000","last_undegraded":"2021-10-08T19:26:36.640074+0000","last_fullsized":"2021-10-08T19:26:36.640074+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644390+0000","last_change":"2021-10-08T19:25:10.800440+0000","last_active":"2021-10-08T19:26:36.644390+0000","last_peered":"2021-10-08T19:26:36.644390+0000","last_clean":"2021-10-08T19:26:36.644390+0000","last_became_active":"2021-10-08T19:25:10.800110+0000","last_became_peered":"2021-10-08T19:25:10.800110+0000","last_unstale":"2021-10-08T19:26:36.644390+0000","last_undegraded":"2021-10-08T19:26:36.644390+0000","last_fullsized":"2021-10-08T19:26:36.644390+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645049+0000","last_change":"2021-10-08T19:25:06.797592+0000","last_active":"2021-10-08T19:26:36.645049+0000","last_peered":"2021-10-08T19:26:36.645049+0000","last_clean":"2021-10-08T19:26:36.645049+0000","last_became_active":"2021-10-08T19:25:06.797301+0000","last_became_peered":"2021-10-08T19:25:06.797301+0000","last_unstale":"2021-10-08T19:26:36.645049+0000","last_undegraded":"2021-10-08T19:26:36.645049+0000","last_fullsized":"2021-10-08T19:26:36.645049+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"65'11","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638874+0000","last_change":"2021-10-08T19:25:08.798732+0000","last_active":"2021-10-08T19:26:36.638874+0000","last_peered":"2021-10-08T19:26:36.638874+0000","last_clean":"2021-10-08T19:26:36.638874+0000","last_became_active":"2021-10-08T19:25:08.798495+0000","last_became_peered":"2021-10-08T19:25:08.798495+0000","last_unstale":"2021-10-08T19:26:36.638874+0000","last_undegraded":"2021-10-08T19:26:36.638874+0000","last_fullsized":"2021-10-08T19:26:36.638874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"65'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633060+0000","last_change":"2021-10-08T19:25:12.811278+0000","last_active":"2021-10-08T19:26:36.633060+0000","last_peered":"2021-10-08T19:26:36.633060+0000","last_clean":"2021-10-08T19:26:36.633060+0000","last_became_active":"2021-10-08T19:25:12.810536+0000","last_became_peered":"2021-10-08T19:25:12.810536+0000","last_unstale":"2021-10-08T19:26:36.633060+0000","last_undegraded":"2021-10-08T19:26:36.633060+0000","last_fullsized":"2021-10-08T19:26:36.633060+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640497+0000","last_change":"2021-10-08T19:25:10.804442+0000","last_active":"2021-10-08T19:26:36.640497+0000","last_peered":"2021-10-08T19:26:36.640497+0000","last_clean":"2021-10-08T19:26:36.640497+0000","last_became_active":"2021-10-08T19:25:10.804162+0000","last_became_peered":"2021-10-08T19:25:10.804162+0000","last_unstale":"2021-10-08T19:26:36.640497+0000","last_undegraded":"2021-10-08T19:26:36.640497+0000","last_fullsized":"2021-10-08T19:26:36.640497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642377+0000","last_change":"2021-10-08T19:25:06.794000+0000","last_active":"2021-10-08T19:26:36.642377+0000","last_peered":"2021-10-08T19:26:36.642377+0000","last_clean":"2021-10-08T19:26:36.642377+0000","last_became_active":"2021-10-08T19:25:06.793694+0000","last_became_peered":"2021-10-08T19:25:06.793694+0000","last_unstale":"2021-10-08T19:26:36.642377+0000","last_undegraded":"2021-10-08T19:26:36.642377+0000","last_fullsized":"2021-10-08T19:26:36.642377+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644341+0000","last_change":"2021-10-08T19:25:08.800849+0000","last_active":"2021-10-08T19:26:36.644341+0000","last_peered":"2021-10-08T19:26:36.644341+0000","last_clean":"2021-10-08T19:26:36.644341+0000","last_became_active":"2021-10-08T19:25:08.800562+0000","last_became_peered":"2021-10-08T19:25:08.800562+0000","last_unstale":"2021-10-08T19:26:36.644341+0000","last_undegraded":"2021-10-08T19:26:36.644341+0000","last_fullsized":"2021-10-08T19:26:36.644341+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640651+0000","last_change":"2021-10-08T19:25:12.803810+0000","last_active":"2021-10-08T19:26:36.640651+0000","last_peered":"2021-10-08T19:26:36.640651+0000","last_clean":"2021-10-08T19:26:36.640651+0000","last_became_active":"2021-10-08T19:25:12.803518+0000","last_became_peered":"2021-10-08T19:25:12.803518+0000","last_unstale":"2021-10-08T19:26:36.640651+0000","last_undegraded":"2021-10-08T19:26:36.640651+0000","last_fullsized":"2021-10-08T19:26:36.640651+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"65'11","reported_seq":52,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:50.499295+0000","last_change":"2021-10-08T19:25:10.802213+0000","last_active":"2021-10-08T19:26:50.499295+0000","last_peered":"2021-10-08T19:26:50.499295+0000","last_clean":"2021-10-08T19:26:50.499295+0000","last_became_active":"2021-10-08T19:25:10.801895+0000","last_became_peered":"2021-10-08T19:25:10.801895+0000","last_unstale":"2021-10-08T19:26:50.499295+0000","last_undegraded":"2021-10-08T19:26:50.499295+0000","last_fullsized":"2021-10-08T19:26:50.499295+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633894+0000","last_change":"2021-10-08T19:25:06.798407+0000","last_active":"2021-10-08T19:26:36.633894+0000","last_peered":"2021-10-08T19:26:36.633894+0000","last_clean":"2021-10-08T19:26:36.633894+0000","last_became_active":"2021-10-08T19:25:06.798064+0000","last_became_peered":"2021-10-08T19:25:06.798064+0000","last_unstale":"2021-10-08T19:26:36.633894+0000","last_undegraded":"2021-10-08T19:26:36.633894+0000","last_fullsized":"2021-10-08T19:26:36.633894+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635911+0000","last_change":"2021-10-08T19:25:09.298297+0000","last_active":"2021-10-08T19:26:36.635911+0000","last_peered":"2021-10-08T19:26:36.635911+0000","last_clean":"2021-10-08T19:26:36.635911+0000","last_became_active":"2021-10-08T19:25:09.297984+0000","last_became_peered":"2021-10-08T19:25:09.297984+0000","last_unstale":"2021-10-08T19:26:36.635911+0000","last_undegraded":"2021-10-08T19:26:36.635911+0000","last_fullsized":"2021-10-08T19:26:36.635911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633576+0000","last_change":"2021-10-08T19:25:12.808216+0000","last_active":"2021-10-08T19:26:36.633576+0000","last_peered":"2021-10-08T19:26:36.633576+0000","last_clean":"2021-10-08T19:26:36.633576+0000","last_became_active":"2021-10-08T19:25:12.807902+0000","last_became_peered":"2021-10-08T19:25:12.807902+0000","last_unstale":"2021-10-08T19:26:36.633576+0000","last_undegraded":"2021-10-08T19:26:36.633576+0000","last_fullsized":"2021-10-08T19:26:36.633576+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"65'11","reported_seq":49,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:50.499406+0000","last_change":"2021-10-08T19:25:10.802900+0000","last_active":"2021-10-08T19:26:50.499406+0000","last_peered":"2021-10-08T19:26:50.499406+0000","last_clean":"2021-10-08T19:26:50.499406+0000","last_became_active":"2021-10-08T19:25:10.802372+0000","last_became_peered":"2021-10-08T19:25:10.802372+0000","last_unstale":"2021-10-08T19:26:50.499406+0000","last_undegraded":"2021-10-08T19:26:50.499406+0000","last_fullsized":"2021-10-08T19:26:50.499406+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635325+0000","last_change":"2021-10-08T19:25:06.799834+0000","last_active":"2021-10-08T19:26:36.635325+0000","last_peered":"2021-10-08T19:26:36.635325+0000","last_clean":"2021-10-08T19:26:36.635325+0000","last_became_active":"2021-10-08T19:25:06.799207+0000","last_became_peered":"2021-10-08T19:25:06.799207+0000","last_unstale":"2021-10-08T19:26:36.635325+0000","last_undegraded":"2021-10-08T19:26:36.635325+0000","last_fullsized":"2021-10-08T19:26:36.635325+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"65'10","reported_seq":54,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:37.652230+0000","last_change":"2021-10-08T19:26:37.652230+0000","last_active":"2021-10-08T19:26:37.652230+0000","last_peered":"2021-10-08T19:26:37.652230+0000","last_clean":"2021-10-08T19:26:37.652230+0000","last_became_active":"2021-10-08T19:26:37.645057+0000","last_became_peered":"2021-10-08T19:26:37.645057+0000","last_unstale":"2021-10-08T19:26:37.652230+0000","last_undegraded":"2021-10-08T19:26:37.652230+0000","last_fullsized":"2021-10-08T19:26:37.652230+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.637973+0000","last_change":"2021-10-08T19:25:13.234205+0000","last_active":"2021-10-08T19:26:36.637973+0000","last_peered":"2021-10-08T19:26:36.637973+0000","last_clean":"2021-10-08T19:26:36.637973+0000","last_became_active":"2021-10-08T19:25:13.233903+0000","last_became_peered":"2021-10-08T19:25:13.233903+0000","last_unstale":"2021-10-08T19:26:36.637973+0000","last_undegraded":"2021-10-08T19:26:36.637973+0000","last_fullsized":"2021-10-08T19:26:36.637973+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635909+0000","last_change":"2021-10-08T19:25:10.806684+0000","last_active":"2021-10-08T19:26:36.635909+0000","last_peered":"2021-10-08T19:26:36.635909+0000","last_clean":"2021-10-08T19:26:36.635909+0000","last_became_active":"2021-10-08T19:25:10.806062+0000","last_became_peered":"2021-10-08T19:25:10.806062+0000","last_unstale":"2021-10-08T19:26:36.635909+0000","last_undegraded":"2021-10-08T19:26:36.635909+0000","last_fullsized":"2021-10-08T19:26:36.635909+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642764+0000","last_change":"2021-10-08T19:25:06.793531+0000","last_active":"2021-10-08T19:26:36.642764+0000","last_peered":"2021-10-08T19:26:36.642764+0000","last_clean":"2021-10-08T19:26:36.642764+0000","last_became_active":"2021-10-08T19:25:06.793114+0000","last_became_peered":"2021-10-08T19:25:06.793114+0000","last_unstale":"2021-10-08T19:26:36.642764+0000","last_undegraded":"2021-10-08T19:26:36.642764+0000","last_fullsized":"2021-10-08T19:26:36.642764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"65'6","reported_seq":27,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641761+0000","last_change":"2021-10-08T19:25:09.296456+0000","last_active":"2021-10-08T19:26:36.641761+0000","last_peered":"2021-10-08T19:26:36.641761+0000","last_clean":"2021-10-08T19:26:36.641761+0000","last_became_active":"2021-10-08T19:25:09.296158+0000","last_became_peered":"2021-10-08T19:25:09.296158+0000","last_unstale":"2021-10-08T19:26:36.641761+0000","last_undegraded":"2021-10-08T19:26:36.641761+0000","last_fullsized":"2021-10-08T19:26:36.641761+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636547+0000","last_change":"2021-10-08T19:25:12.804275+0000","last_active":"2021-10-08T19:26:36.636547+0000","last_peered":"2021-10-08T19:26:36.636547+0000","last_clean":"2021-10-08T19:26:36.636547+0000","last_became_active":"2021-10-08T19:25:12.803989+0000","last_became_peered":"2021-10-08T19:25:12.803989+0000","last_unstale":"2021-10-08T19:26:36.636547+0000","last_undegraded":"2021-10-08T19:26:36.636547+0000","last_fullsized":"2021-10-08T19:26:36.636547+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641924+0000","last_change":"2021-10-08T19:25:10.804197+0000","last_active":"2021-10-08T19:26:36.641924+0000","last_peered":"2021-10-08T19:26:36.641924+0000","last_clean":"2021-10-08T19:26:36.641924+0000","last_became_active":"2021-10-08T19:25:10.803875+0000","last_became_peered":"2021-10-08T19:25:10.803875+0000","last_unstale":"2021-10-08T19:26:36.641924+0000","last_undegraded":"2021-10-08T19:26:36.641924+0000","last_fullsized":"2021-10-08T19:26:36.641924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.634902+0000","last_change":"2021-10-08T19:25:06.797360+0000","last_active":"2021-10-08T19:26:36.634902+0000","last_peered":"2021-10-08T19:26:36.634902+0000","last_clean":"2021-10-08T19:26:36.634902+0000","last_became_active":"2021-10-08T19:25:06.797035+0000","last_became_peered":"2021-10-08T19:25:06.797035+0000","last_unstale":"2021-10-08T19:26:36.634902+0000","last_undegraded":"2021-10-08T19:26:36.634902+0000","last_fullsized":"2021-10-08T19:26:36.634902+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633755+0000","last_change":"2021-10-08T19:25:09.297341+0000","last_active":"2021-10-08T19:26:36.633755+0000","last_peered":"2021-10-08T19:26:36.633755+0000","last_clean":"2021-10-08T19:26:36.633755+0000","last_became_active":"2021-10-08T19:25:09.296957+0000","last_became_peered":"2021-10-08T19:25:09.296957+0000","last_unstale":"2021-10-08T19:26:36.633755+0000","last_undegraded":"2021-10-08T19:26:36.633755+0000","last_fullsized":"2021-10-08T19:26:36.633755+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640539+0000","last_change":"2021-10-08T19:25:12.808610+0000","last_active":"2021-10-08T19:26:36.640539+0000","last_peered":"2021-10-08T19:26:36.640539+0000","last_clean":"2021-10-08T19:26:36.640539+0000","last_became_active":"2021-10-08T19:25:12.808312+0000","last_became_peered":"2021-10-08T19:25:12.808312+0000","last_unstale":"2021-10-08T19:26:36.640539+0000","last_undegraded":"2021-10-08T19:26:36.640539+0000","last_fullsized":"2021-10-08T19:26:36.640539+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"57'2","reported_seq":42,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640494+0000","last_change":"2021-10-08T19:25:06.793211+0000","last_active":"2021-10-08T19:26:36.640494+0000","last_peered":"2021-10-08T19:26:36.640494+0000","last_clean":"2021-10-08T19:26:36.640494+0000","last_became_active":"2021-10-08T19:25:06.792968+0000","last_became_peered":"2021-10-08T19:25:06.792968+0000","last_unstale":"2021-10-08T19:26:36.640494+0000","last_undegraded":"2021-10-08T19:26:36.640494+0000","last_fullsized":"2021-10-08T19:26:36.640494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"65'12","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638293+0000","last_change":"2021-10-08T19:25:08.796024+0000","last_active":"2021-10-08T19:26:36.638293+0000","last_peered":"2021-10-08T19:26:36.638293+0000","last_clean":"2021-10-08T19:26:36.638293+0000","last_became_active":"2021-10-08T19:25:08.795819+0000","last_became_peered":"2021-10-08T19:25:08.795819+0000","last_unstale":"2021-10-08T19:26:36.638293+0000","last_undegraded":"2021-10-08T19:26:36.638293+0000","last_fullsized":"2021-10-08T19:26:36.638293+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.634826+0000","last_change":"2021-10-08T19:25:10.801286+0000","last_active":"2021-10-08T19:26:36.634826+0000","last_peered":"2021-10-08T19:26:36.634826+0000","last_clean":"2021-10-08T19:26:36.634826+0000","last_became_active":"2021-10-08T19:25:10.801024+0000","last_became_peered":"2021-10-08T19:25:10.801024+0000","last_unstale":"2021-10-08T19:26:36.634826+0000","last_undegraded":"2021-10-08T19:26:36.634826+0000","last_fullsized":"2021-10-08T19:26:36.634826+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633151+0000","last_change":"2021-10-08T19:25:12.810893+0000","last_active":"2021-10-08T19:26:36.633151+0000","last_peered":"2021-10-08T19:26:36.633151+0000","last_clean":"2021-10-08T19:26:36.633151+0000","last_became_active":"2021-10-08T19:25:12.809997+0000","last_became_peered":"2021-10-08T19:25:12.809997+0000","last_unstale":"2021-10-08T19:26:36.633151+0000","last_undegraded":"2021-10-08T19:26:36.633151+0000","last_fullsized":"2021-10-08T19:26:36.633151+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644425+0000","last_change":"2021-10-08T19:25:06.799449+0000","last_active":"2021-10-08T19:26:36.644425+0000","last_peered":"2021-10-08T19:26:36.644425+0000","last_clean":"2021-10-08T19:26:36.644425+0000","last_became_active":"2021-10-08T19:25:06.799117+0000","last_became_peered":"2021-10-08T19:25:06.799117+0000","last_unstale":"2021-10-08T19:26:36.644425+0000","last_undegraded":"2021-10-08T19:26:36.644425+0000","last_fullsized":"2021-10-08T19:26:36.644425+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"65'10","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644431+0000","last_change":"2021-10-08T19:25:08.797732+0000","last_active":"2021-10-08T19:26:36.644431+0000","last_peered":"2021-10-08T19:26:36.644431+0000","last_clean":"2021-10-08T19:26:36.644431+0000","last_became_active":"2021-10-08T19:25:08.797441+0000","last_became_peered":"2021-10-08T19:25:08.797441+0000","last_unstale":"2021-10-08T19:26:36.644431+0000","last_undegraded":"2021-10-08T19:26:36.644431+0000","last_fullsized":"2021-10-08T19:26:36.644431+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"65'11","reported_seq":49,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:50.499251+0000","last_change":"2021-10-08T19:25:10.800528+0000","last_active":"2021-10-08T19:26:50.499251+0000","last_peered":"2021-10-08T19:26:50.499251+0000","last_clean":"2021-10-08T19:26:50.499251+0000","last_became_active":"2021-10-08T19:25:10.800192+0000","last_became_peered":"2021-10-08T19:25:10.800192+0000","last_unstale":"2021-10-08T19:26:50.499251+0000","last_undegraded":"2021-10-08T19:26:50.499251+0000","last_fullsized":"2021-10-08T19:26:50.499251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.641246+0000","last_change":"2021-10-08T19:25:12.803348+0000","last_active":"2021-10-08T19:26:36.641246+0000","last_peered":"2021-10-08T19:26:36.641246+0000","last_clean":"2021-10-08T19:26:36.641246+0000","last_became_active":"2021-10-08T19:25:12.802997+0000","last_became_peered":"2021-10-08T19:25:12.802997+0000","last_unstale":"2021-10-08T19:26:36.641246+0000","last_undegraded":"2021-10-08T19:26:36.641246+0000","last_fullsized":"2021-10-08T19:26:36.641246+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635380+0000","last_change":"2021-10-08T19:25:06.795288+0000","last_active":"2021-10-08T19:26:36.635380+0000","last_peered":"2021-10-08T19:26:36.635380+0000","last_clean":"2021-10-08T19:26:36.635380+0000","last_became_active":"2021-10-08T19:25:06.794978+0000","last_became_peered":"2021-10-08T19:25:06.794978+0000","last_unstale":"2021-10-08T19:26:36.635380+0000","last_undegraded":"2021-10-08T19:26:36.635380+0000","last_fullsized":"2021-10-08T19:26:36.635380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"65'30","reported_seq":91,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:50.499674+0000","last_change":"2021-10-08T19:25:08.800279+0000","last_active":"2021-10-08T19:26:50.499674+0000","last_peered":"2021-10-08T19:26:50.499674+0000","last_clean":"2021-10-08T19:26:50.499674+0000","last_became_active":"2021-10-08T19:25:08.800000+0000","last_became_peered":"2021-10-08T19:25:08.800000+0000","last_unstale":"2021-10-08T19:26:50.499674+0000","last_undegraded":"2021-10-08T19:26:50.499674+0000","last_fullsized":"2021-10-08T19:26:50.499674+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633973+0000","last_change":"2021-10-08T19:25:10.803863+0000","last_active":"2021-10-08T19:26:36.633973+0000","last_peered":"2021-10-08T19:26:36.633973+0000","last_clean":"2021-10-08T19:26:36.633973+0000","last_became_active":"2021-10-08T19:25:10.803528+0000","last_became_peered":"2021-10-08T19:25:10.803528+0000","last_unstale":"2021-10-08T19:26:36.633973+0000","last_undegraded":"2021-10-08T19:26:36.633973+0000","last_fullsized":"2021-10-08T19:26:36.633973+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639773+0000","last_change":"2021-10-08T19:25:13.232071+0000","last_active":"2021-10-08T19:26:36.639773+0000","last_peered":"2021-10-08T19:26:36.639773+0000","last_clean":"2021-10-08T19:26:36.639773+0000","last_became_active":"2021-10-08T19:25:13.231793+0000","last_became_peered":"2021-10-08T19:25:13.231793+0000","last_unstale":"2021-10-08T19:26:36.639773+0000","last_undegraded":"2021-10-08T19:26:36.639773+0000","last_fullsized":"2021-10-08T19:26:36.639773+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"65'5","reported_seq":124,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:54.831862+0000","last_change":"2021-10-08T19:25:07.792337+0000","last_active":"2021-10-08T19:26:54.831862+0000","last_peered":"2021-10-08T19:26:54.831862+0000","last_clean":"2021-10-08T19:26:54.831862+0000","last_became_active":"2021-10-08T19:25:07.792044+0000","last_became_peered":"2021-10-08T19:25:07.792044+0000","last_unstale":"2021-10-08T19:26:54.831862+0000","last_undegraded":"2021-10-08T19:26:54.831862+0000","last_fullsized":"2021-10-08T19:26:54.831862+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_clean_scrub_stamp":"2021-10-08T19:25:06.778978+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.634994+0000","last_change":"2021-10-08T19:25:06.795341+0000","last_active":"2021-10-08T19:26:36.634994+0000","last_peered":"2021-10-08T19:26:36.634994+0000","last_clean":"2021-10-08T19:26:36.634994+0000","last_became_active":"2021-10-08T19:25:06.795071+0000","last_became_peered":"2021-10-08T19:25:06.795071+0000","last_unstale":"2021-10-08T19:26:36.634994+0000","last_undegraded":"2021-10-08T19:26:36.634994+0000","last_fullsized":"2021-10-08T19:26:36.634994+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"65'13","reported_seq":45,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645079+0000","last_change":"2021-10-08T19:25:08.803387+0000","last_active":"2021-10-08T19:26:36.645079+0000","last_peered":"2021-10-08T19:26:36.645079+0000","last_clean":"2021-10-08T19:26:36.645079+0000","last_became_active":"2021-10-08T19:25:08.803077+0000","last_became_peered":"2021-10-08T19:25:08.803077+0000","last_unstale":"2021-10-08T19:26:36.645079+0000","last_undegraded":"2021-10-08T19:26:36.645079+0000","last_fullsized":"2021-10-08T19:26:36.645079+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636838+0000","last_change":"2021-10-08T19:25:10.807447+0000","last_active":"2021-10-08T19:26:36.636838+0000","last_peered":"2021-10-08T19:26:36.636838+0000","last_clean":"2021-10-08T19:26:36.636838+0000","last_became_active":"2021-10-08T19:25:10.807152+0000","last_became_peered":"2021-10-08T19:25:10.807152+0000","last_unstale":"2021-10-08T19:26:36.636838+0000","last_undegraded":"2021-10-08T19:26:36.636838+0000","last_fullsized":"2021-10-08T19:26:36.636838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636194+0000","last_change":"2021-10-08T19:25:12.808276+0000","last_active":"2021-10-08T19:26:36.636194+0000","last_peered":"2021-10-08T19:26:36.636194+0000","last_clean":"2021-10-08T19:26:36.636194+0000","last_became_active":"2021-10-08T19:25:12.807968+0000","last_became_peered":"2021-10-08T19:25:12.807968+0000","last_unstale":"2021-10-08T19:26:36.636194+0000","last_undegraded":"2021-10-08T19:26:36.636194+0000","last_fullsized":"2021-10-08T19:26:36.636194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642306+0000","last_change":"2021-10-08T19:25:07.794182+0000","last_active":"2021-10-08T19:26:36.642306+0000","last_peered":"2021-10-08T19:26:36.642306+0000","last_clean":"2021-10-08T19:26:36.642306+0000","last_became_active":"2021-10-08T19:25:07.793367+0000","last_became_peered":"2021-10-08T19:25:07.793367+0000","last_unstale":"2021-10-08T19:26:36.642306+0000","last_undegraded":"2021-10-08T19:26:36.642306+0000","last_fullsized":"2021-10-08T19:26:36.642306+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_clean_scrub_stamp":"2021-10-08T19:25:06.778978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"57'1","reported_seq":42,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:37.730654+0000","last_change":"2021-10-08T19:26:37.730654+0000","last_active":"2021-10-08T19:26:37.730654+0000","last_peered":"2021-10-08T19:26:37.730654+0000","last_clean":"2021-10-08T19:26:37.730654+0000","last_became_active":"2021-10-08T19:26:37.642282+0000","last_became_peered":"2021-10-08T19:26:37.642282+0000","last_unstale":"2021-10-08T19:26:37.730654+0000","last_undegraded":"2021-10-08T19:26:37.730654+0000","last_fullsized":"2021-10-08T19:26:37.730654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"66'128","reported_seq":268,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638182+0000","last_change":"2021-10-08T19:25:02.612588+0000","last_active":"2021-10-08T19:26:36.638182+0000","last_peered":"2021-10-08T19:26:36.638182+0000","last_clean":"2021-10-08T19:26:36.638182+0000","last_became_active":"2021-10-08T19:25:02.612168+0000","last_became_peered":"2021-10-08T19:25:02.612168+0000","last_unstale":"2021-10-08T19:26:36.638182+0000","last_undegraded":"2021-10-08T19:26:36.638182+0000","last_fullsized":"2021-10-08T19:26:36.638182+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:23:27.938485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:23:27.938485+0000","last_clean_scrub_stamp":"2021-10-08T19:23:27.938485+0000","log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"65'14","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642690+0000","last_change":"2021-10-08T19:25:09.297809+0000","last_active":"2021-10-08T19:26:36.642690+0000","last_peered":"2021-10-08T19:26:36.642690+0000","last_clean":"2021-10-08T19:26:36.642690+0000","last_became_active":"2021-10-08T19:25:09.297507+0000","last_became_peered":"2021-10-08T19:25:09.297507+0000","last_unstale":"2021-10-08T19:26:36.642690+0000","last_undegraded":"2021-10-08T19:26:36.642690+0000","last_fullsized":"2021-10-08T19:26:36.642690+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639216+0000","last_change":"2021-10-08T19:25:10.800205+0000","last_active":"2021-10-08T19:26:36.639216+0000","last_peered":"2021-10-08T19:26:36.639216+0000","last_clean":"2021-10-08T19:26:36.639216+0000","last_became_active":"2021-10-08T19:25:10.799914+0000","last_became_peered":"2021-10-08T19:25:10.799914+0000","last_unstale":"2021-10-08T19:26:36.639216+0000","last_undegraded":"2021-10-08T19:26:36.639216+0000","last_fullsized":"2021-10-08T19:26:36.639216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644201+0000","last_change":"2021-10-08T19:25:12.814098+0000","last_active":"2021-10-08T19:26:36.644201+0000","last_peered":"2021-10-08T19:26:36.644201+0000","last_clean":"2021-10-08T19:26:36.644201+0000","last_became_active":"2021-10-08T19:25:12.813784+0000","last_became_peered":"2021-10-08T19:25:12.813784+0000","last_unstale":"2021-10-08T19:26:36.644201+0000","last_undegraded":"2021-10-08T19:26:36.644201+0000","last_fullsized":"2021-10-08T19:26:36.644201+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633347+0000","last_change":"2021-10-08T19:25:07.796350+0000","last_active":"2021-10-08T19:26:36.633347+0000","last_peered":"2021-10-08T19:26:36.633347+0000","last_clean":"2021-10-08T19:26:36.633347+0000","last_became_active":"2021-10-08T19:25:07.796040+0000","last_became_peered":"2021-10-08T19:25:07.796040+0000","last_unstale":"2021-10-08T19:26:36.633347+0000","last_undegraded":"2021-10-08T19:26:36.633347+0000","last_fullsized":"2021-10-08T19:26:36.633347+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:06.778978+0000","last_clean_scrub_stamp":"2021-10-08T19:25:06.778978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638120+0000","last_change":"2021-10-08T19:25:06.798704+0000","last_active":"2021-10-08T19:26:36.638120+0000","last_peered":"2021-10-08T19:26:36.638120+0000","last_clean":"2021-10-08T19:26:36.638120+0000","last_became_active":"2021-10-08T19:25:06.798174+0000","last_became_peered":"2021-10-08T19:25:06.798174+0000","last_unstale":"2021-10-08T19:26:36.638120+0000","last_undegraded":"2021-10-08T19:26:36.638120+0000","last_fullsized":"2021-10-08T19:26:36.638120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"65'12","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633670+0000","last_change":"2021-10-08T19:25:08.799978+0000","last_active":"2021-10-08T19:26:36.633670+0000","last_peered":"2021-10-08T19:26:36.633670+0000","last_clean":"2021-10-08T19:26:36.633670+0000","last_became_active":"2021-10-08T19:25:08.799673+0000","last_became_peered":"2021-10-08T19:25:08.799673+0000","last_unstale":"2021-10-08T19:26:36.633670+0000","last_undegraded":"2021-10-08T19:26:36.633670+0000","last_fullsized":"2021-10-08T19:26:36.633670+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636156+0000","last_change":"2021-10-08T19:25:10.807943+0000","last_active":"2021-10-08T19:26:36.636156+0000","last_peered":"2021-10-08T19:26:36.636156+0000","last_clean":"2021-10-08T19:26:36.636156+0000","last_became_active":"2021-10-08T19:25:10.807055+0000","last_became_peered":"2021-10-08T19:25:10.807055+0000","last_unstale":"2021-10-08T19:26:36.636156+0000","last_undegraded":"2021-10-08T19:26:36.636156+0000","last_fullsized":"2021-10-08T19:26:36.636156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.643875+0000","last_change":"2021-10-08T19:25:13.232381+0000","last_active":"2021-10-08T19:26:36.643875+0000","last_peered":"2021-10-08T19:26:36.643875+0000","last_clean":"2021-10-08T19:26:36.643875+0000","last_became_active":"2021-10-08T19:25:13.232027+0000","last_became_peered":"2021-10-08T19:25:13.232027+0000","last_unstale":"2021-10-08T19:26:36.643875+0000","last_undegraded":"2021-10-08T19:26:36.643875+0000","last_fullsized":"2021-10-08T19:26:36.643875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639818+0000","last_change":"2021-10-08T19:25:06.800598+0000","last_active":"2021-10-08T19:26:36.639818+0000","last_peered":"2021-10-08T19:26:36.639818+0000","last_clean":"2021-10-08T19:26:36.639818+0000","last_became_active":"2021-10-08T19:25:06.800130+0000","last_became_peered":"2021-10-08T19:25:06.800130+0000","last_unstale":"2021-10-08T19:26:36.639818+0000","last_undegraded":"2021-10-08T19:26:36.639818+0000","last_fullsized":"2021-10-08T19:26:36.639818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"65'19","reported_seq":54,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633825+0000","last_change":"2021-10-08T19:25:09.297231+0000","last_active":"2021-10-08T19:26:36.633825+0000","last_peered":"2021-10-08T19:26:36.633825+0000","last_clean":"2021-10-08T19:26:36.633825+0000","last_became_active":"2021-10-08T19:25:09.296955+0000","last_became_peered":"2021-10-08T19:25:09.296955+0000","last_unstale":"2021-10-08T19:26:36.633825+0000","last_undegraded":"2021-10-08T19:26:36.633825+0000","last_fullsized":"2021-10-08T19:26:36.633825+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642352+0000","last_change":"2021-10-08T19:25:10.805897+0000","last_active":"2021-10-08T19:26:36.642352+0000","last_peered":"2021-10-08T19:26:36.642352+0000","last_clean":"2021-10-08T19:26:36.642352+0000","last_became_active":"2021-10-08T19:25:10.805618+0000","last_became_peered":"2021-10-08T19:25:10.805618+0000","last_unstale":"2021-10-08T19:26:36.642352+0000","last_undegraded":"2021-10-08T19:26:36.642352+0000","last_fullsized":"2021-10-08T19:26:36.642352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638453+0000","last_change":"2021-10-08T19:25:12.802846+0000","last_active":"2021-10-08T19:26:36.638453+0000","last_peered":"2021-10-08T19:26:36.638453+0000","last_clean":"2021-10-08T19:26:36.638453+0000","last_became_active":"2021-10-08T19:25:12.802543+0000","last_became_peered":"2021-10-08T19:25:12.802543+0000","last_unstale":"2021-10-08T19:26:36.638453+0000","last_undegraded":"2021-10-08T19:26:36.638453+0000","last_fullsized":"2021-10-08T19:26:36.638453+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645299+0000","last_change":"2021-10-08T19:25:06.796937+0000","last_active":"2021-10-08T19:26:36.645299+0000","last_peered":"2021-10-08T19:26:36.645299+0000","last_clean":"2021-10-08T19:26:36.645299+0000","last_became_active":"2021-10-08T19:25:06.796647+0000","last_became_peered":"2021-10-08T19:25:06.796647+0000","last_unstale":"2021-10-08T19:26:36.645299+0000","last_undegraded":"2021-10-08T19:26:36.645299+0000","last_fullsized":"2021-10-08T19:26:36.645299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"65'18","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640004+0000","last_change":"2021-10-08T19:25:09.297025+0000","last_active":"2021-10-08T19:26:36.640004+0000","last_peered":"2021-10-08T19:26:36.640004+0000","last_clean":"2021-10-08T19:26:36.640004+0000","last_became_active":"2021-10-08T19:25:09.296839+0000","last_became_peered":"2021-10-08T19:25:09.296839+0000","last_unstale":"2021-10-08T19:26:36.640004+0000","last_undegraded":"2021-10-08T19:26:36.640004+0000","last_fullsized":"2021-10-08T19:26:36.640004+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638388+0000","last_change":"2021-10-08T19:25:10.804742+0000","last_active":"2021-10-08T19:26:36.638388+0000","last_peered":"2021-10-08T19:26:36.638388+0000","last_clean":"2021-10-08T19:26:36.638388+0000","last_became_active":"2021-10-08T19:25:10.804578+0000","last_became_peered":"2021-10-08T19:25:10.804578+0000","last_unstale":"2021-10-08T19:26:36.638388+0000","last_undegraded":"2021-10-08T19:26:36.638388+0000","last_fullsized":"2021-10-08T19:26:36.638388+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638747+0000","last_change":"2021-10-08T19:25:13.234327+0000","last_active":"2021-10-08T19:26:36.638747+0000","last_peered":"2021-10-08T19:26:36.638747+0000","last_clean":"2021-10-08T19:26:36.638747+0000","last_became_active":"2021-10-08T19:25:13.234036+0000","last_became_peered":"2021-10-08T19:25:13.234036+0000","last_unstale":"2021-10-08T19:26:36.638747+0000","last_undegraded":"2021-10-08T19:26:36.638747+0000","last_fullsized":"2021-10-08T19:26:36.638747+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642716+0000","last_change":"2021-10-08T19:25:06.794814+0000","last_active":"2021-10-08T19:26:36.642716+0000","last_peered":"2021-10-08T19:26:36.642716+0000","last_clean":"2021-10-08T19:26:36.642716+0000","last_became_active":"2021-10-08T19:25:06.794554+0000","last_became_peered":"2021-10-08T19:25:06.794554+0000","last_unstale":"2021-10-08T19:26:36.642716+0000","last_undegraded":"2021-10-08T19:26:36.642716+0000","last_fullsized":"2021-10-08T19:26:36.642716+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"65'14","reported_seq":39,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638100+0000","last_change":"2021-10-08T19:25:08.793890+0000","last_active":"2021-10-08T19:26:36.638100+0000","last_peered":"2021-10-08T19:26:36.638100+0000","last_clean":"2021-10-08T19:26:36.638100+0000","last_became_active":"2021-10-08T19:25:08.793662+0000","last_became_peered":"2021-10-08T19:25:08.793662+0000","last_unstale":"2021-10-08T19:26:36.638100+0000","last_undegraded":"2021-10-08T19:26:36.638100+0000","last_fullsized":"2021-10-08T19:26:36.638100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"65'11","reported_seq":49,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:50.499272+0000","last_change":"2021-10-08T19:25:10.804314+0000","last_active":"2021-10-08T19:26:50.499272+0000","last_peered":"2021-10-08T19:26:50.499272+0000","last_clean":"2021-10-08T19:26:50.499272+0000","last_became_active":"2021-10-08T19:25:10.803885+0000","last_became_peered":"2021-10-08T19:25:10.803885+0000","last_unstale":"2021-10-08T19:26:50.499272+0000","last_undegraded":"2021-10-08T19:26:50.499272+0000","last_fullsized":"2021-10-08T19:26:50.499272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640974+0000","last_change":"2021-10-08T19:25:13.232344+0000","last_active":"2021-10-08T19:26:36.640974+0000","last_peered":"2021-10-08T19:26:36.640974+0000","last_clean":"2021-10-08T19:26:36.640974+0000","last_became_active":"2021-10-08T19:25:13.231902+0000","last_became_peered":"2021-10-08T19:25:13.231902+0000","last_unstale":"2021-10-08T19:26:36.640974+0000","last_undegraded":"2021-10-08T19:26:36.640974+0000","last_fullsized":"2021-10-08T19:26:36.640974+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636089+0000","last_change":"2021-10-08T19:25:10.808038+0000","last_active":"2021-10-08T19:26:36.636089+0000","last_peered":"2021-10-08T19:26:36.636089+0000","last_clean":"2021-10-08T19:26:36.636089+0000","last_became_active":"2021-10-08T19:25:10.807344+0000","last_became_peered":"2021-10-08T19:25:10.807344+0000","last_unstale":"2021-10-08T19:26:36.636089+0000","last_undegraded":"2021-10-08T19:26:36.636089+0000","last_fullsized":"2021-10-08T19:26:36.636089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638299+0000","last_change":"2021-10-08T19:25:06.802367+0000","last_active":"2021-10-08T19:26:36.638299+0000","last_peered":"2021-10-08T19:26:36.638299+0000","last_clean":"2021-10-08T19:26:36.638299+0000","last_became_active":"2021-10-08T19:25:06.802093+0000","last_became_peered":"2021-10-08T19:25:06.802093+0000","last_unstale":"2021-10-08T19:26:36.638299+0000","last_undegraded":"2021-10-08T19:26:36.638299+0000","last_fullsized":"2021-10-08T19:26:36.638299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"65'11","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640460+0000","last_change":"2021-10-08T19:25:08.797858+0000","last_active":"2021-10-08T19:26:36.640460+0000","last_peered":"2021-10-08T19:26:36.640460+0000","last_clean":"2021-10-08T19:26:36.640460+0000","last_became_active":"2021-10-08T19:25:08.797585+0000","last_became_peered":"2021-10-08T19:25:08.797585+0000","last_unstale":"2021-10-08T19:26:36.640460+0000","last_undegraded":"2021-10-08T19:26:36.640460+0000","last_fullsized":"2021-10-08T19:26:36.640460+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635692+0000","last_change":"2021-10-08T19:25:12.809342+0000","last_active":"2021-10-08T19:26:36.635692+0000","last_peered":"2021-10-08T19:26:36.635692+0000","last_clean":"2021-10-08T19:26:36.635692+0000","last_became_active":"2021-10-08T19:25:12.809056+0000","last_became_peered":"2021-10-08T19:25:12.809056+0000","last_unstale":"2021-10-08T19:26:36.635692+0000","last_undegraded":"2021-10-08T19:26:36.635692+0000","last_fullsized":"2021-10-08T19:26:36.635692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"65'11","reported_seq":49,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:50.499505+0000","last_change":"2021-10-08T19:25:10.810482+0000","last_active":"2021-10-08T19:26:50.499505+0000","last_peered":"2021-10-08T19:26:50.499505+0000","last_clean":"2021-10-08T19:26:50.499505+0000","last_became_active":"2021-10-08T19:25:10.810238+0000","last_became_peered":"2021-10-08T19:25:10.810238+0000","last_unstale":"2021-10-08T19:26:50.499505+0000","last_undegraded":"2021-10-08T19:26:50.499505+0000","last_fullsized":"2021-10-08T19:26:50.499505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.643998+0000","last_change":"2021-10-08T19:25:06.796604+0000","last_active":"2021-10-08T19:26:36.643998+0000","last_peered":"2021-10-08T19:26:36.643998+0000","last_clean":"2021-10-08T19:26:36.643998+0000","last_became_active":"2021-10-08T19:25:06.796390+0000","last_became_peered":"2021-10-08T19:25:06.796390+0000","last_unstale":"2021-10-08T19:26:36.643998+0000","last_undegraded":"2021-10-08T19:26:36.643998+0000","last_fullsized":"2021-10-08T19:26:36.643998+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"65'15","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645193+0000","last_change":"2021-10-08T19:25:08.798857+0000","last_active":"2021-10-08T19:26:36.645193+0000","last_peered":"2021-10-08T19:26:36.645193+0000","last_clean":"2021-10-08T19:26:36.645193+0000","last_became_active":"2021-10-08T19:25:08.798579+0000","last_became_peered":"2021-10-08T19:25:08.798579+0000","last_unstale":"2021-10-08T19:26:36.645193+0000","last_undegraded":"2021-10-08T19:26:36.645193+0000","last_fullsized":"2021-10-08T19:26:36.645193+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.640259+0000","last_change":"2021-10-08T19:25:12.810115+0000","last_active":"2021-10-08T19:26:36.640259+0000","last_peered":"2021-10-08T19:26:36.640259+0000","last_clean":"2021-10-08T19:26:36.640259+0000","last_became_active":"2021-10-08T19:25:12.809800+0000","last_became_peered":"2021-10-08T19:25:12.809800+0000","last_unstale":"2021-10-08T19:26:36.640259+0000","last_undegraded":"2021-10-08T19:26:36.640259+0000","last_fullsized":"2021-10-08T19:26:36.640259+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"65'11","reported_seq":49,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:50.499287+0000","last_change":"2021-10-08T19:25:10.802128+0000","last_active":"2021-10-08T19:26:50.499287+0000","last_peered":"2021-10-08T19:26:50.499287+0000","last_clean":"2021-10-08T19:26:50.499287+0000","last_became_active":"2021-10-08T19:25:10.801783+0000","last_became_peered":"2021-10-08T19:25:10.801783+0000","last_unstale":"2021-10-08T19:26:50.499287+0000","last_undegraded":"2021-10-08T19:26:50.499287+0000","last_fullsized":"2021-10-08T19:26:50.499287+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644305+0000","last_change":"2021-10-08T19:25:06.797719+0000","last_active":"2021-10-08T19:26:36.644305+0000","last_peered":"2021-10-08T19:26:36.644305+0000","last_clean":"2021-10-08T19:26:36.644305+0000","last_became_active":"2021-10-08T19:25:06.797462+0000","last_became_peered":"2021-10-08T19:25:06.797462+0000","last_unstale":"2021-10-08T19:26:36.644305+0000","last_undegraded":"2021-10-08T19:26:36.644305+0000","last_fullsized":"2021-10-08T19:26:36.644305+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"65'10","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638788+0000","last_change":"2021-10-08T19:25:08.793170+0000","last_active":"2021-10-08T19:26:36.638788+0000","last_peered":"2021-10-08T19:26:36.638788+0000","last_clean":"2021-10-08T19:26:36.638788+0000","last_became_active":"2021-10-08T19:25:08.792867+0000","last_became_peered":"2021-10-08T19:25:08.792867+0000","last_unstale":"2021-10-08T19:26:36.638788+0000","last_undegraded":"2021-10-08T19:26:36.638788+0000","last_fullsized":"2021-10-08T19:26:36.638788+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636885+0000","last_change":"2021-10-08T19:25:12.808091+0000","last_active":"2021-10-08T19:26:36.636885+0000","last_peered":"2021-10-08T19:26:36.636885+0000","last_clean":"2021-10-08T19:26:36.636885+0000","last_became_active":"2021-10-08T19:25:12.807756+0000","last_became_peered":"2021-10-08T19:25:12.807756+0000","last_unstale":"2021-10-08T19:26:36.636885+0000","last_undegraded":"2021-10-08T19:26:36.636885+0000","last_fullsized":"2021-10-08T19:26:36.636885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.644284+0000","last_change":"2021-10-08T19:25:10.802949+0000","last_active":"2021-10-08T19:26:36.644284+0000","last_peered":"2021-10-08T19:26:36.644284+0000","last_clean":"2021-10-08T19:26:36.644284+0000","last_became_active":"2021-10-08T19:25:10.802627+0000","last_became_peered":"2021-10-08T19:25:10.802627+0000","last_unstale":"2021-10-08T19:26:36.644284+0000","last_undegraded":"2021-10-08T19:26:36.644284+0000","last_fullsized":"2021-10-08T19:26:36.644284+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638468+0000","last_change":"2021-10-08T19:25:06.798829+0000","last_active":"2021-10-08T19:26:36.638468+0000","last_peered":"2021-10-08T19:26:36.638468+0000","last_clean":"2021-10-08T19:26:36.638468+0000","last_became_active":"2021-10-08T19:25:06.798562+0000","last_became_peered":"2021-10-08T19:25:06.798562+0000","last_unstale":"2021-10-08T19:26:36.638468+0000","last_undegraded":"2021-10-08T19:26:36.638468+0000","last_fullsized":"2021-10-08T19:26:36.638468+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"65'17","reported_seq":46,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.639430+0000","last_change":"2021-10-08T19:25:08.799362+0000","last_active":"2021-10-08T19:26:36.639430+0000","last_peered":"2021-10-08T19:26:36.639430+0000","last_clean":"2021-10-08T19:26:36.639430+0000","last_became_active":"2021-10-08T19:25:08.799053+0000","last_became_peered":"2021-10-08T19:25:08.799053+0000","last_unstale":"2021-10-08T19:26:36.639430+0000","last_undegraded":"2021-10-08T19:26:36.639430+0000","last_fullsized":"2021-10-08T19:26:36.639430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.638047+0000","last_change":"2021-10-08T19:25:12.808233+0000","last_active":"2021-10-08T19:26:36.638047+0000","last_peered":"2021-10-08T19:26:36.638047+0000","last_clean":"2021-10-08T19:26:36.638047+0000","last_became_active":"2021-10-08T19:25:12.807997+0000","last_became_peered":"2021-10-08T19:25:12.807997+0000","last_unstale":"2021-10-08T19:26:36.638047+0000","last_undegraded":"2021-10-08T19:26:36.638047+0000","last_fullsized":"2021-10-08T19:26:36.638047+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636063+0000","last_change":"2021-10-08T19:25:10.809663+0000","last_active":"2021-10-08T19:26:36.636063+0000","last_peered":"2021-10-08T19:26:36.636063+0000","last_clean":"2021-10-08T19:26:36.636063+0000","last_became_active":"2021-10-08T19:25:10.809442+0000","last_became_peered":"2021-10-08T19:25:10.809442+0000","last_unstale":"2021-10-08T19:26:36.636063+0000","last_undegraded":"2021-10-08T19:26:36.636063+0000","last_fullsized":"2021-10-08T19:26:36.636063+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636336+0000","last_change":"2021-10-08T19:25:06.794320+0000","last_active":"2021-10-08T19:26:36.636336+0000","last_peered":"2021-10-08T19:26:36.636336+0000","last_clean":"2021-10-08T19:26:36.636336+0000","last_became_active":"2021-10-08T19:25:06.794025+0000","last_became_peered":"2021-10-08T19:25:06.794025+0000","last_unstale":"2021-10-08T19:26:36.636336+0000","last_undegraded":"2021-10-08T19:26:36.636336+0000","last_fullsized":"2021-10-08T19:26:36.636336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"65'19","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.642285+0000","last_change":"2021-10-08T19:25:09.297649+0000","last_active":"2021-10-08T19:26:36.642285+0000","last_peered":"2021-10-08T19:26:36.642285+0000","last_clean":"2021-10-08T19:26:36.642285+0000","last_became_active":"2021-10-08T19:25:09.297357+0000","last_became_peered":"2021-10-08T19:25:09.297357+0000","last_unstale":"2021-10-08T19:26:36.642285+0000","last_undegraded":"2021-10-08T19:26:36.642285+0000","last_fullsized":"2021-10-08T19:26:36.642285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633109+0000","last_change":"2021-10-08T19:25:12.805291+0000","last_active":"2021-10-08T19:26:36.633109+0000","last_peered":"2021-10-08T19:26:36.633109+0000","last_clean":"2021-10-08T19:26:36.633109+0000","last_became_active":"2021-10-08T19:25:12.804969+0000","last_became_peered":"2021-10-08T19:25:12.804969+0000","last_unstale":"2021-10-08T19:26:36.633109+0000","last_undegraded":"2021-10-08T19:26:36.633109+0000","last_fullsized":"2021-10-08T19:26:36.633109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635221+0000","last_change":"2021-10-08T19:25:10.805439+0000","last_active":"2021-10-08T19:26:36.635221+0000","last_peered":"2021-10-08T19:26:36.635221+0000","last_clean":"2021-10-08T19:26:36.635221+0000","last_became_active":"2021-10-08T19:25:10.805133+0000","last_became_peered":"2021-10-08T19:25:10.805133+0000","last_unstale":"2021-10-08T19:26:36.635221+0000","last_undegraded":"2021-10-08T19:26:36.635221+0000","last_fullsized":"2021-10-08T19:26:36.635221+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.645088+0000","last_change":"2021-10-08T19:25:06.795325+0000","last_active":"2021-10-08T19:26:36.645088+0000","last_peered":"2021-10-08T19:26:36.645088+0000","last_clean":"2021-10-08T19:26:36.645088+0000","last_became_active":"2021-10-08T19:25:06.795050+0000","last_became_peered":"2021-10-08T19:25:06.795050+0000","last_unstale":"2021-10-08T19:26:36.645088+0000","last_undegraded":"2021-10-08T19:26:36.645088+0000","last_fullsized":"2021-10-08T19:26:36.645088+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"65'9","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.633941+0000","last_change":"2021-10-08T19:25:08.799996+0000","last_active":"2021-10-08T19:26:36.633941+0000","last_peered":"2021-10-08T19:26:36.633941+0000","last_clean":"2021-10-08T19:26:36.633941+0000","last_became_active":"2021-10-08T19:25:08.799698+0000","last_became_peered":"2021-10-08T19:25:08.799698+0000","last_unstale":"2021-10-08T19:26:36.633941+0000","last_undegraded":"2021-10-08T19:26:36.633941+0000","last_fullsized":"2021-10-08T19:26:36.633941+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635159+0000","last_change":"2021-10-08T19:25:13.232312+0000","last_active":"2021-10-08T19:26:36.635159+0000","last_peered":"2021-10-08T19:26:36.635159+0000","last_clean":"2021-10-08T19:26:36.635159+0000","last_became_active":"2021-10-08T19:25:13.232000+0000","last_became_peered":"2021-10-08T19:25:13.232000+0000","last_unstale":"2021-10-08T19:26:36.635159+0000","last_undegraded":"2021-10-08T19:26:36.635159+0000","last_fullsized":"2021-10-08T19:26:36.635159+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:11.788920+0000","last_clean_scrub_stamp":"2021-10-08T19:25:11.788920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.636918+0000","last_change":"2021-10-08T19:25:06.799739+0000","last_active":"2021-10-08T19:26:36.636918+0000","last_peered":"2021-10-08T19:26:36.636918+0000","last_clean":"2021-10-08T19:26:36.636918+0000","last_became_active":"2021-10-08T19:25:06.799444+0000","last_became_peered":"2021-10-08T19:25:06.799444+0000","last_unstale":"2021-10-08T19:26:36.636918+0000","last_undegraded":"2021-10-08T19:26:36.636918+0000","last_fullsized":"2021-10-08T19:26:36.636918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:05.777149+0000","last_clean_scrub_stamp":"2021-10-08T19:25:05.777149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'15","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2021-10-08T19:26:36.635170+0000","last_change":"2021-10-08T19:25:09.296223+0000","last_active":"2021-10-08T19:26:36.635170+0000","last_peered":"2021-10-08T19:26:36.635170+0000","last_clean":"2021-10-08T19:26:36.635170+0000","last_became_active":"2021-10-08T19:25:09.295960+0000","last_became_peered":"2021-10-08T19:25:09.295960+0000","last_unstale":"2021-10-08T19:26:36.635170+0000","last_undegraded":"2021-10-08T19:26:36.635170+0000","last_fullsized":"2021-10-08T19:26:36.635170+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:07.782958+0000","last_clean_scrub_stamp":"2021-10-08T19:25:07.782958+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"65'11","reported_seq":49,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:26:50.499396+0000","last_change":"2021-10-08T19:25:10.803515+0000","last_active":"2021-10-08T19:26:50.499396+0000","last_peered":"2021-10-08T19:26:50.499396+0000","last_clean":"2021-10-08T19:26:50.499396+0000","last_became_active":"2021-10-08T19:25:10.803212+0000","last_became_peered":"2021-10-08T19:25:10.803212+0000","last_unstale":"2021-10-08T19:26:50.499396+0000","last_undegraded":"2021-10-08T19:26:50.499396+0000","last_fullsized":"2021-10-08T19:26:50.499396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:25:09.786068+0000","last_clean_scrub_stamp":"2021-10-08T19:25:09.786068+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":51,"seq":219043332121,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6752,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738400,"statfs":{"total":95995035648,"available":95988121600,"internally_reserved":0,"allocated":1269760,"data_stored":854233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":5.8220000000000001,"5min":5.8220000000000001,"15min":5.8220000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.438}]},{"osd":2,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.298,"5min":3.298,"15min":3.298},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.371},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.376}]},{"osd":4,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.315}]},{"osd":5,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.39800000000000002}]},{"osd":6,"last update":"Fri Oct 8 19:25:58 2021","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.34399999999999997}]}]},{"osd":6,"up_from":44,"seq":188978561052,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6740,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738412,"statfs":{"total":95995035648,"available":95988133888,"internally_reserved":0,"allocated":1257472,"data_stored":854814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.497,"15min":0.505},"min":{"1min":0.33500000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.372},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.498,"15min":0.502},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61799999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51900000000000002,"15min":0.52700000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64900000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.59799999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.434}]},{"osd":2,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69299999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64700000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.43099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.30099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79700000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44900000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88600000000000001,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.34899999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:26:03 2021","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7028,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93738124,"statfs":{"total":95995035648,"available":95987838976,"internally_reserved":0,"allocated":700416,"data_stored":264140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:10 2021","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33200000000000002,"15min":0.33000000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.35399999999999998,"15min":0.35699999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.47699999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:26:30 2021","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.37,"15min":0.372},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47099999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.314},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.28999999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:26:46 2021","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.24399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.42999999999999999,"15min":0.44400000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56200000000000006,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:26:10 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71999999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Oct 8 19:26:26 2021","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Oct 8 19:26:41 2021","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71299999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:26:00 2021","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.51500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7460,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93737692,"statfs":{"total":95995035648,"available":95987396608,"internally_reserved":0,"allocated":1273856,"data_stored":853943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:26:14 2021","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.33300000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.66300000000000003,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.38500000000000001,"15min":0.35899999999999999},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56100000000000005,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:26:35 2021","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.252,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.38500000000000001,"15min":0.38300000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52500000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:26:47 2021","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.435,"15min":0.435},"min":{"1min":0.309,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56200000000000006,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.74199999999999999,"5min":1.79,"15min":1.79},"last":0.498}]},{"osd":4,"last update":"Fri Oct 8 19:26:10 2021","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.022,"5min":1.603,"15min":1.603},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:26:27 2021","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.68999999999999995,"15min":0.70999999999999996},"min":{"1min":0.38900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79400000000000004,"5min":3.915,"15min":3.915},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.68600000000000005,"15min":0.71399999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81100000000000005,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:26:42 2021","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":1.268,"15min":1.268},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.67700000000000005,"15min":0.69599999999999995},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":2.851,"15min":2.851},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:26:00 2021","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.59599999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411371,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6684,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":6016,"kb_avail":93738468,"statfs":{"total":95995035648,"available":95988191232,"internally_reserved":0,"allocated":675840,"data_stored":265157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6160384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:27 2021","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34699999999999998,"15min":0.34999999999999998},"min":{"1min":0.216,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.5,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.23599999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.42599999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.21299999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:27 2021","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.37,"15min":0.375},"min":{"1min":0.23300000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.39000000000000001,"15min":0.39500000000000002},"min":{"1min":0.24399999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.495,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.24099999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:26:49 2021","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.41199999999999998,"15min":0.42699999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.443,"15min":0.44500000000000001},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52900000000000003,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:26:09 2021","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.313},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Oct 8 19:26:26 2021","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.372,"15min":0.372},"max":{"1min":0.754,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.40699999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:26:44 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58599999999999997,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.497},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42299999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:26:02 2021","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.441}]}]},{"osd":3,"up_from":25,"seq":107374182441,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6316,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738836,"statfs":{"total":95995035648,"available":95988568064,"internally_reserved":0,"allocated":692224,"data_stored":264048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36299999999999999,"15min":0.37},"min":{"1min":0.23499999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.44500000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.253},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.39200000000000002,"15min":0.40999999999999998},"min":{"1min":0.245,"5min":0.189,"15min":0.189},"max":{"1min":0.46100000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.39300000000000002,"15min":0.40899999999999997},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48899999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.40899999999999997,"15min":0.42699999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48799999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:26:51 2021","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.432,"15min":0.45200000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.47799999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.318},{"interface":"front","average":{"1min":0.379,"5min":0.41099999999999998,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51300000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:26:04 2021","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.308,"15min":0.308},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.435},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51900000000000002,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.309}]},{"osd":5,"last update":"Fri Oct 8 19:26:27 2021","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:26:43 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75900000000000001,"5min":0.871,"15min":0.871},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72899999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40000000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:26:01 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.41399999999999998}]}]},{"osd":4,"up_from":30,"seq":128849018917,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6308,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738844,"statfs":{"total":95995035648,"available":95988576256,"internally_reserved":0,"allocated":684032,"data_stored":264074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:07 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:07 2021","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51500000000000001,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.748,"5min":0.75,"15min":0.75},"last":0.435}]},{"osd":2,"last update":"Fri Oct 8 19:26:07 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.5,"15min":0.504},"min":{"1min":0.33400000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70099999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Oct 8 19:26:07 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.37},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:26:43 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.44900000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42199999999999999,"15min":0.41399999999999998},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:26:02 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.40000000000000002}]}]},{"osd":5,"up_from":37,"seq":158913789984,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6164,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738988,"statfs":{"total":95995035648,"available":95988723712,"internally_reserved":0,"allocated":667648,"data_stored":264430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:23 2021","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.498},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.504},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47799999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42699999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.495,"15min":0.505},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65600000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Oct 8 19:26:23 2021","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.373,"5min":0.311,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Oct 8 19:26:25 2021","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.316},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.39300000000000002},"min":{"1min":0.33800000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.29999999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:26:43 2021","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.42399999999999999,"15min":0.41799999999999998},"min":{"1min":0.318,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.38800000000000001}]},{"osd":7,"last update":"Fri Oct 8 19:25:59 2021","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.36599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:26:59.678 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-10-08T19:26:59.679 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-10-08T19:26:59.680 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-10-08T19:26:59.681 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid 906d7a14-286c-11ec-8c25-001a4aab830c -- ceph health --format=json 2021-10-08T19:27:00.015 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:59 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi196 2021-10-08T19:27:00.016 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:59 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi157 2021-10-08T19:27:00.016 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:26:59 smithi157 ceph-mon[32847]: from='client.24691 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:27:00.017 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:59 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi196 2021-10-08T19:27:00.017 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:59 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi157 2021-10-08T19:27:00.017 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:26:59 smithi157 ceph-mon[42114]: from='client.24691 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:27:00.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:59 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi196 2021-10-08T19:27:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:59 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi157 2021-10-08T19:27:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:26:59 smithi196 ceph-mon[34258]: from='client.24691 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:27:00.132 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/906d7a14-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:01.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:00 smithi157 ceph-mon[32847]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:01.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:00 smithi157 ceph-mon[42114]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:01.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:00 smithi196 ceph-mon[34258]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:02.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:01 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:02.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:01 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:02.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:01 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:02.306 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 -- 172.21.15.157:0/2097723153 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65f00feea0 msgr2=0x7f65f00f86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:02.306 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 --2- 172.21.15.157:0/2097723153 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65f00feea0 0x7f65f00f86a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f65e00046e0 tx=0x7f65e0009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:02.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 -- 172.21.15.157:0/2097723153 shutdown_connections 2021-10-08T19:27:02.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 --2- 172.21.15.157:0/2097723153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65f00f8dd0 0x7f65f0105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:02.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 --2- 172.21.15.157:0/2097723153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65f00fe590 0x7f65f00fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:02.307 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 --2- 172.21.15.157:0/2097723153 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65f00feea0 0x7f65f00f86a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:02.308 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 -- 172.21.15.157:0/2097723153 >> 172.21.15.157:0/2097723153 conn(0x7f65f0070510 msgr2=0x7f65f0070910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:02.308 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 -- 172.21.15.157:0/2097723153 shutdown_connections 2021-10-08T19:27:02.308 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 -- 172.21.15.157:0/2097723153 wait complete. 2021-10-08T19:27:02.308 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 Processor -- start 2021-10-08T19:27:02.308 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 -- start start 2021-10-08T19:27:02.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65f00f8dd0 0x7f65f006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:02.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65f00fe590 0x7f65f006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:02.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65f00feea0 0x7f65f0116d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:02.309 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f006c4f0 con 0x7f65f00f8dd0 2021-10-08T19:27:02.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f0117280 con 0x7f65f00fe590 2021-10-08T19:27:02.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.302+0000 7f65f6b74700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f01173f0 con 0x7f65f00feea0 2021-10-08T19:27:02.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5b72700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65f00f8dd0 0x7f65f006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:02.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5b72700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65f00f8dd0 0x7f65f006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41264/0 (socket says 172.21.15.157:41264) 2021-10-08T19:27:02.310 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5b72700 1 -- 172.21.15.157:0/1212181828 learned_addr learned my addr 172.21.15.157:0/1212181828 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:27:02.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f6373700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65f00feea0 0x7f65f0116d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:02.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5371700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65f00fe590 0x7f65f006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:02.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5b72700 1 -- 172.21.15.157:0/1212181828 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65f00feea0 msgr2=0x7f65f0116d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:02.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5b72700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65f00feea0 0x7f65f0116d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:02.311 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5b72700 1 -- 172.21.15.157:0/1212181828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65f00fe590 msgr2=0x7f65f006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:02.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5b72700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65f00fe590 0x7f65f006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:02.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5b72700 1 -- 172.21.15.157:0/1212181828 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec005040 con 0x7f65f00f8dd0 2021-10-08T19:27:02.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f6373700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65f00feea0 0x7f65f0116d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:02.312 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f5b72700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65f00f8dd0 0x7f65f006b6c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0048f0 tx=0x7f65ec009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:02.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65e67fc700 1 -- 172.21.15.157:0/1212181828 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec00e050 con 0x7f65f00f8dd0 2021-10-08T19:27:02.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e0005040 con 0x7f65f00f8dd0 2021-10-08T19:27:02.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65e67fc700 1 -- 172.21.15.157:0/1212181828 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f65ec00f040 con 0x7f65f00f8dd0 2021-10-08T19:27:02.313 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65e67fc700 1 -- 172.21.15.157:0/1212181828 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0147e0 con 0x7f65f00f8dd0 2021-10-08T19:27:02.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.303+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f0117a80 con 0x7f65f00f8dd0 2021-10-08T19:27:02.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.304+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f0072030 con 0x7f65f00f8dd0 2021-10-08T19:27:02.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.305+0000 7f65e67fc700 1 -- 172.21.15.157:0/1212181828 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f65ec01b030 con 0x7f65f00f8dd0 2021-10-08T19:27:02.314 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.305+0000 7f65e67fc700 1 --2- 172.21.15.157:0/1212181828 >> v2:172.21.15.157:6800/1475557172 conn(0x7f65dc0635a0 0x7f65dc065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:02.315 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.305+0000 7f65e67fc700 1 -- 172.21.15.157:0/1212181828 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6281+0+0 (secure 0 0 0) 0x7f65ec07f490 con 0x7f65f00f8dd0 2021-10-08T19:27:02.315 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.305+0000 7f65f5371700 1 --2- 172.21.15.157:0/1212181828 >> v2:172.21.15.157:6800/1475557172 conn(0x7f65dc0635a0 0x7f65dc065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:02.315 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.306+0000 7f65f5371700 1 --2- 172.21.15.157:0/1212181828 >> v2:172.21.15.157:6800/1475557172 conn(0x7f65dc0635a0 0x7f65dc065a50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65e0014510 tx=0x7f65e0009b30 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:02.316 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.310+0000 7f65e67fc700 1 -- 172.21.15.157:0/1212181828 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f65ec048b00 con 0x7f65f00f8dd0 2021-10-08T19:27:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.562+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f65f01079c0 con 0x7f65f00f8dd0 2021-10-08T19:27:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.562+0000 7f65e67fc700 1 -- 172.21.15.157:0/1212181828 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f65ec052000 con 0x7f65f00f8dd0 2021-10-08T19:27:02.564 INFO:teuthology.orchestra.run.smithi157.stdout: 2021-10-08T19:27:02.564 INFO:teuthology.orchestra.run.smithi157.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-10-08T19:27:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 >> v2:172.21.15.157:6800/1475557172 conn(0x7f65dc0635a0 msgr2=0x7f65dc065a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 --2- 172.21.15.157:0/1212181828 >> v2:172.21.15.157:6800/1475557172 conn(0x7f65dc0635a0 0x7f65dc065a50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65e0014510 tx=0x7f65e0009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65f00f8dd0 msgr2=0x7f65f006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65f00f8dd0 0x7f65f006b6c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0048f0 tx=0x7f65ec009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 shutdown_connections 2021-10-08T19:27:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 --2- 172.21.15.157:0/1212181828 >> v2:172.21.15.157:6800/1475557172 conn(0x7f65dc0635a0 0x7f65dc065a50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65f00feea0 0x7f65f0116d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:02.568 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65f00f8dd0 0x7f65f006b6c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:02.568 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 --2- 172.21.15.157:0/1212181828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65f00fe590 0x7f65f006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:02.569 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 >> 172.21.15.157:0/1212181828 conn(0x7f65f0070510 msgr2=0x7f65f00f77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:02.569 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 shutdown_connections 2021-10-08T19:27:02.569 INFO:teuthology.orchestra.run.smithi157.stderr:2021-10-08T19:27:02.564+0000 7f65f6b74700 1 -- 172.21.15.157:0/1212181828 wait complete. 2021-10-08T19:27:03.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:02 smithi157 ceph-mon[42114]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:03.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1212181828' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-10-08T19:27:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:02 smithi157 ceph-mon[32847]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1212181828' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-10-08T19:27:03.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:02 smithi196 ceph-mon[34258]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:03.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1212181828' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-10-08T19:27:03.338 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-10-08T19:27:03.339 INFO:tasks.cephadm:Setup complete, yielding 2021-10-08T19:27:03.339 INFO:teuthology.run_tasks:Running task workunit... 2021-10-08T19:27:03.365 INFO:tasks.workunit:Pulling workunits from ref 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 2021-10-08T19:27:03.367 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-10-08T19:27:03.368 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.0 2021-10-08T19:27:03.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-08T19:27:03.385 INFO:teuthology.orchestra.run.smithi157.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-08T19:27:03.385 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-10-08T19:27:03.445 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-10-08T19:27:03.445 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-10-08T19:27:03.500 INFO:tasks.workunit:timeout=3h 2021-10-08T19:27:03.501 INFO:tasks.workunit:cleanup=True 2021-10-08T19:27:03.502 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/liewegas/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 2021-10-08T19:27:03.555 INFO:tasks.workunit.client.0.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-10-08T19:27:05.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:04 smithi157 ceph-mon[32847]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:05.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:04 smithi157 ceph-mon[42114]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:05.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:04 smithi196 ceph-mon[34258]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:05.497 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:05 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:27:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:06.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:06 smithi157 ceph-mon[32847]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:27:06.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:06 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:06.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:06 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:27:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:06.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:06 smithi157 ceph-mon[32847]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:06.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:06 smithi157 ceph-mon[42114]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:27:06.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:06 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:06.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:06 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:27:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:06.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:06 smithi157 ceph-mon[42114]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:06.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:06 smithi196 ceph-mon[34258]: Received old metadata from agent on host smithi157. Requested up-to-date metadata. 2021-10-08T19:27:06.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:06 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:06.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:06 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:27:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:06.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:06 smithi196 ceph-mon[34258]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:07.116 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:27:06 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:27:07.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:07 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:07.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:07 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:07.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:07 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:08.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:08 smithi157 ceph-mon[32847]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:08.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:08 smithi157 ceph-mon[42114]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:08.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:08 smithi196 ceph-mon[34258]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:10 smithi157 ceph-mon[32847]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:10 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:11.079 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:10 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:27:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:11.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:10 smithi157 ceph-mon[42114]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:11.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:10 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:10 smithi196 ceph-mon[34258]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:10 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:12.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:11 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:27:12.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:11 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:27:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:12.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:11 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:27:12.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:11 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:27:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:12.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:11 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:27:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:11 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:27:10] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:12 smithi196 ceph-mon[34258]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:12 smithi157 ceph-mon[32847]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:13.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:12 smithi157 ceph-mon[42114]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:13.617 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:13 smithi196 systemd[1]: Starting Ceph prometheus.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:27:14.613 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 bash[66104]: b52cc33188995603fe494b0f4d5e717c25f76fc7f327a89dbc62fb6eb253513a 2021-10-08T19:27:14.614 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 systemd[1]: Started Ceph prometheus.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:27:14.614 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.279Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-10-08T19:27:14.614 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.279Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-10-08T19:27:14.614 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.279Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-10-08T19:27:14.614 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.279Z caller=main.go:339 host_details="(Linux 4.18.0-305.19.1.el8_4.x86_64 #1 SMP Wed Sep 15 15:39:39 UTC 2021 x86_64 smithi196 (none))" 2021-10-08T19:27:14.615 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.279Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-10-08T19:27:14.615 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.279Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-10-08T19:27:14.615 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.281Z caller=main.go:678 msg="Starting TSDB ..." 2021-10-08T19:27:14.615 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.281Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-10-08T19:27:14.616 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.283Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-10-08T19:27:14.616 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.283Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-10-08T19:27:14.616 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.283Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=116.639µs 2021-10-08T19:27:14.616 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.284Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-10-08T19:27:14.616 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.284Z caller=main.go:695 msg="TSDB started" 2021-10-08T19:27:14.617 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.284Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:27:14.617 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.290Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:27:14.617 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:27:14 smithi196 conmon[66293]: level=info ts=2021-10-08T19:27:14.290Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-10-08T19:27:14.631 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[32847]: poll took 15229.260 ms: 1 events 2021-10-08T19:27:14.632 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[32847]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:14.632 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:14.632 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:14.633 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:14.633 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:14.633 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:14.633 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[42114]: poll took 15229.260 ms: 1 events 2021-10-08T19:27:14.634 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[42114]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:14.634 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:14.634 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:14.634 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:14.635 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:14.635 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:14 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:14.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:14 smithi196 ceph-mon[34258]: poll took 15229.260 ms: 1 events 2021-10-08T19:27:14.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:14 smithi196 ceph-mon[34258]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:14.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:14 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:14.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:14 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:14.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:14 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:14.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:14 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:14.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:14 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:16.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[32847]: poll took 1002.639 ms: 1 events 2021-10-08T19:27:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[32847]: Sending message to agent on host smithi196 2021-10-08T19:27:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:16.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[32847]: Reconfiguring alertmanager.a (dependencies changed)... 2021-10-08T19:27:16.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[32847]: Reconfiguring daemon alertmanager.a on smithi157 2021-10-08T19:27:16.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[42114]: poll took 1002.639 ms: 1 events 2021-10-08T19:27:16.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[42114]: Sending message to agent on host smithi196 2021-10-08T19:27:16.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:16.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[42114]: Reconfiguring alertmanager.a (dependencies changed)... 2021-10-08T19:27:16.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:15 smithi157 ceph-mon[42114]: Reconfiguring daemon alertmanager.a on smithi157 2021-10-08T19:27:16.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:15 smithi196 ceph-mon[34258]: poll took 1002.639 ms: 1 events 2021-10-08T19:27:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:15 smithi196 ceph-mon[34258]: Sending message to agent on host smithi196 2021-10-08T19:27:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:15 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:15 smithi196 ceph-mon[34258]: Reconfiguring alertmanager.a (dependencies changed)... 2021-10-08T19:27:16.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:15 smithi196 ceph-mon[34258]: Reconfiguring daemon alertmanager.a on smithi157 2021-10-08T19:27:17.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:16 smithi157 ceph-mon[32847]: Received "ACK" from agent on host smithi196 2021-10-08T19:27:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:16 smithi157 ceph-mon[32847]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:16 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:17.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:16 smithi157 ceph-mon[42114]: Received "ACK" from agent on host smithi196 2021-10-08T19:27:17.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:16 smithi157 ceph-mon[42114]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:17.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:16 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:17.116 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:27:16 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:27:17.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:16 smithi196 ceph-mon[34258]: Received "ACK" from agent on host smithi196 2021-10-08T19:27:17.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:16 smithi196 ceph-mon[34258]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:17.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:16 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:18.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:17 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:17 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:18.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:17 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:18.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:18 smithi157 systemd[1]: Stopping Ceph alertmanager.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:27:18.978 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:18 smithi157 bash[86824]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-alertmanager.a found: no such container 2021-10-08T19:27:18.979 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:18 smithi157 conmon[74087]: level=info ts=2021-10-08T19:27:18.638Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-10-08T19:27:19.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:18 smithi196 ceph-mon[34258]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:18 smithi157 ceph-mon[32847]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:19.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:18 smithi157 ceph-mon[42114]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:19.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:19 smithi157 bash[86824]: a3fa7b05d4e2d5162b5487c783b4aaa94bbc94eecbdbaa1d3cd98cfd30b83525 2021-10-08T19:27:19.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:19 smithi157 bash[86824]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-alertmanager.a found: no such container 2021-10-08T19:27:19.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:19 smithi157 systemd[1]: Stopped Ceph alertmanager.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:27:19.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:19 smithi157 systemd[1]: Starting Ceph alertmanager.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:27:20.169 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:19 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:27:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:20.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:20 smithi157 conmon[87186]: level=info ts=2021-10-08T19:27:20.450Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-10-08T19:27:20.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:20 smithi157 conmon[87186]: level=info ts=2021-10-08T19:27:20.450Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-10-08T19:27:20.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:20 smithi157 conmon[87186]: level=info ts=2021-10-08T19:27:20.451Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.157 port=9094 2021-10-08T19:27:20.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:20 smithi157 conmon[87186]: level=info ts=2021-10-08T19:27:20.452Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-10-08T19:27:20.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:20 smithi157 bash[86996]: fd1a02efea50c93b73bad84065bc790946121cdf4397aa6717517945b82e69fc 2021-10-08T19:27:20.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:20 smithi157 systemd[1]: Started Ceph alertmanager.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:27:20.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:20 smithi157 conmon[87186]: level=info ts=2021-10-08T19:27:20.475Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:27:20.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:20 smithi157 conmon[87186]: level=info ts=2021-10-08T19:27:20.476Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:27:20.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:20 smithi157 conmon[87186]: level=info ts=2021-10-08T19:27:20.479Z caller=main.go:497 msg=Listening address=:9093 2021-10-08T19:27:21.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:20 smithi196 ceph-mon[34258]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:20 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:20 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:20 smithi157 ceph-mon[32847]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:20 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:20 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:21.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:20 smithi157 ceph-mon[42114]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:21.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:20 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:21.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:20 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:22.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:21 smithi196 ceph-mon[34258]: Received old metadata from agent on host smithi196. Requested up-to-date metadata. 2021-10-08T19:27:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:21 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:27:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:21 smithi196 ceph-mon[34258]: poll took 5855.958 ms: 1 events 2021-10-08T19:27:22.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:21 smithi196 ceph-mon[34258]: Reconfiguring grafana.a (dependencies changed)... 2021-10-08T19:27:22.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:21 smithi196 ceph-mon[34258]: Reconfiguring daemon grafana.a on smithi196 2021-10-08T19:27:22.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[32847]: Received old metadata from agent on host smithi196. Requested up-to-date metadata. 2021-10-08T19:27:22.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:27:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:22.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[32847]: poll took 5855.958 ms: 1 events 2021-10-08T19:27:22.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[32847]: Reconfiguring grafana.a (dependencies changed)... 2021-10-08T19:27:22.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[32847]: Reconfiguring daemon grafana.a on smithi196 2021-10-08T19:27:22.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[42114]: Received old metadata from agent on host smithi196. Requested up-to-date metadata. 2021-10-08T19:27:22.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:27:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:22.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[42114]: poll took 5855.958 ms: 1 events 2021-10-08T19:27:22.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[42114]: Reconfiguring grafana.a (dependencies changed)... 2021-10-08T19:27:22.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:21 smithi157 ceph-mon[42114]: Reconfiguring daemon grafana.a on smithi196 2021-10-08T19:27:22.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:22 smithi157 conmon[87186]: level=info ts=2021-10-08T19:27:22.452Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00008854s 2021-10-08T19:27:22.957 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:22 smithi196 ceph-mon[34258]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:22 smithi157 ceph-mon[32847]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:23.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:22 smithi157 ceph-mon[42114]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:24.117 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 systemd[1]: Stopping Ceph grafana.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:27:24.118 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 bash[67996]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-grafana.a found: no such container 2021-10-08T19:27:24.118 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2021-10-08T19:27:24.119 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" 2021-10-08T19:27:24.119 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped PluginManager" logger=server reason="context canceled" 2021-10-08T19:27:24.120 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped RemoteCache" logger=server reason="context canceled" 2021-10-08T19:27:24.120 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped Stream Manager" 2021-10-08T19:27:24.121 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped AlertEngine" logger=server reason="context canceled" 2021-10-08T19:27:24.121 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" 2021-10-08T19:27:24.122 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" 2021-10-08T19:27:24.122 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped CleanUpService" logger=server reason="context canceled" 2021-10-08T19:27:24.123 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped UserAuthTokenService" logger=server reason="context canceled" 2021-10-08T19:27:24.123 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped InternalMetricsService" logger=server reason="context canceled" 2021-10-08T19:27:24.123 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:23 smithi196 conmon[62976]: t=2021-10-08T19:27:23+0000 lvl=info msg="Stopped provisioningServiceImpl" logger=server reason="context canceled" 2021-10-08T19:27:24.618 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:24 smithi196 bash[67996]: 6148e11c3064af2194466fd69fca7d7210d726997e5de008083e3afa8e86a8d8 2021-10-08T19:27:24.618 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:24 smithi196 bash[67996]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-grafana.a found: no such container 2021-10-08T19:27:24.619 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:24 smithi196 systemd[1]: Stopped Ceph grafana.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:27:24.620 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:24 smithi196 systemd[1]: Starting Ceph grafana.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:27:25.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:24 smithi157 ceph-mon[32847]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:25.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:24 smithi157 ceph-mon[42114]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:25.112 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:24 smithi196 ceph-mon[34258]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:25.367 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Starting Grafana" logger=server version=6.7.4 commit=8e44bbc5f5 branch=HEAD compiled=2020-05-26T17:35:38+0000 2021-10-08T19:27:25.367 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-10-08T19:27:25.368 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-10-08T19:27:25.368 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-10-08T19:27:25.368 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-10-08T19:27:25.369 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-10-08T19:27:25.369 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-10-08T19:27:25.369 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-10-08T19:27:25.369 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-10-08T19:27:25.370 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-10-08T19:27:25.370 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-10-08T19:27:25.370 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-10-08T19:27:25.370 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="App mode production" logger=settings 2021-10-08T19:27:25.371 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-10-08T19:27:25.371 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-10-08T19:27:25.371 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-10-08T19:27:25.371 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-10-08T19:27:25.371 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-10-08T19:27:25.372 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-10-08T19:27:25.372 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-10-08T19:27:25.372 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-10-08T19:27:25.372 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-10-08T19:27:25.373 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing HooksService" logger=server 2021-10-08T19:27:25.373 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-10-08T19:27:25.373 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-10-08T19:27:25.373 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-10-08T19:27:25.374 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-10-08T19:27:25.374 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-10-08T19:27:25.374 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-10-08T19:27:25.374 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-10-08T19:27:25.374 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-10-08T19:27:25.375 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-10-08T19:27:25.375 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing LoginService" logger=server 2021-10-08T19:27:25.375 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing SearchService" logger=server 2021-10-08T19:27:25.375 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing TracingService" logger=server 2021-10-08T19:27:25.376 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-10-08T19:27:25.376 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-10-08T19:27:25.376 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-10-08T19:27:25.376 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-10-08T19:27:25.376 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-10-08T19:27:25.377 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2021-10-08T19:27:25.377 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 bash[68181]: 07ba4c1773471b560ea7f0b37607d17d3cf4a995955eceb122848a2abaaf8d72 2021-10-08T19:27:25.377 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 systemd[1]: Started Ceph grafana.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:27:25.377 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-10-08T19:27:25.378 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-10-08T19:27:25.378 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="Initializing Stream Manager" 2021-10-08T19:27:25.378 INFO:journalctl@ceph.grafana.a.smithi196.stdout:Oct 08 19:27:25 smithi196 conmon[68369]: t=2021-10-08T19:27:25+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-10-08T19:27:26.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: poll took 4169.339 ms: 1 events 2021-10-08T19:27:26.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:27:26.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:27:26.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.157:9093"}]: dispatch 2021-10-08T19:27:26.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.157:9093"}]: dispatch 2021-10-08T19:27:26.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:27:26.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:27:26.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.196:3000"}]: dispatch 2021-10-08T19:27:26.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.196:3000"}]: dispatch 2021-10-08T19:27:26.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:27:26.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:27:26.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.196:9095"}]: dispatch 2021-10-08T19:27:26.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.196:9095"}]: dispatch 2021-10-08T19:27:26.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:26.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:26.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:26.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:26.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:26.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:26.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:26.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:26.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[32847]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:26.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: poll took 4169.339 ms: 1 events 2021-10-08T19:27:26.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:27:26.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:27:26.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.157:9093"}]: dispatch 2021-10-08T19:27:26.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.157:9093"}]: dispatch 2021-10-08T19:27:26.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:27:26.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:27:26.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.196:3000"}]: dispatch 2021-10-08T19:27:26.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.196:3000"}]: dispatch 2021-10-08T19:27:26.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:27:26.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:27:26.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.196:9095"}]: dispatch 2021-10-08T19:27:26.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.196:9095"}]: dispatch 2021-10-08T19:27:26.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:26.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:26.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:26.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:26.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:26.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:26.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:26.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:26.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:26 smithi157 ceph-mon[42114]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: poll took 4169.339 ms: 1 events 2021-10-08T19:27:26.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:27:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:27:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.157:9093"}]: dispatch 2021-10-08T19:27:26.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.157:9093"}]: dispatch 2021-10-08T19:27:26.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:27:26.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:27:26.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.196:3000"}]: dispatch 2021-10-08T19:27:26.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.196:3000"}]: dispatch 2021-10-08T19:27:26.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:27:26.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:27:26.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.196:9095"}]: dispatch 2021-10-08T19:27:26.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.196:9095"}]: dispatch 2021-10-08T19:27:26.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:26.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:26.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:26.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:26.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:26.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:26.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:26.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:26.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:26.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:26 smithi196 ceph-mon[34258]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:27.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:27:26 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:27:27.534 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:27 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:27.535 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:27 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:27.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:27 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:27:27] "GET /metrics HTTP/1.1" 200 153789 "" "Prometheus/2.18.1" 2021-10-08T19:27:28.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:28 smithi157 ceph-mon[32847]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:28.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:28 smithi157 ceph-mon[42114]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:28.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:28 smithi196 ceph-mon[34258]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:29.118 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:27:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:27:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:30.704 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:30 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:27:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:30.705 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:27:30 smithi157 conmon[87186]: level=info ts=2021-10-08T19:27:30.452Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000465419s 2021-10-08T19:27:30.705 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[42114]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:30.706 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:30.706 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:30.706 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:30.706 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:30.707 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[32847]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:30 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:31.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:30 smithi196 ceph-mon[34258]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:31.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:30 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:31.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:30 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:31.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:30 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:31.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:30 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:31.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:30 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:32.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:31 smithi157 ceph-mon[32847]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:27:32.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:31 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:27:32.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:31 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:27:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:31 smithi157 ceph-mon[42114]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:27:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:31 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:27:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:31 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:27:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:31 smithi196 ceph-mon[34258]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:27:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:31 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:27:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:31 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:27:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:32 smithi157 ceph-mon[32847]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:33.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:32 smithi157 ceph-mon[42114]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:33.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:32 smithi196 ceph-mon[34258]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:34.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:34 smithi157 ceph-mon[32847]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:34.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:34 smithi157 ceph-mon[42114]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:34 smithi196 ceph-mon[34258]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[32847]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:37.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[42114]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:37.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:37.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:37.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:37.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:37.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:27:36 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:27:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:36 smithi196 ceph-mon[34258]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:37.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:37 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:37.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:37 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:37.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:27:37] "GET /metrics HTTP/1.1" 200 153788 "" "Prometheus/2.18.1" 2021-10-08T19:27:38.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:37 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:38.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:37 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:27:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:39.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:38 smithi157 ceph-mon[32847]: pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:39.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:38 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:38 smithi157 ceph-mon[42114]: pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:38 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:38 smithi196 ceph-mon[34258]: pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:38 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:39.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:27:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:27:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:40.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:39 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:27:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:39 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:27:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:40.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:39 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:27:40.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:39 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:27:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:39 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:27:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:39 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:27:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:41.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:40 smithi157 ceph-mon[32847]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:41.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:40 smithi157 ceph-mon[42114]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:41.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:40 smithi196 ceph-mon[34258]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:42 smithi157 ceph-mon[32847]: pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:43.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:42 smithi157 ceph-mon[42114]: pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:43.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:42 smithi196 ceph-mon[34258]: pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:45.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:44 smithi157 ceph-mon[32847]: pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:45.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:44 smithi157 ceph-mon[42114]: pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:45.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:44 smithi196 ceph-mon[34258]: pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:47.030 INFO:tasks.workunit.client.0.smithi157.stderr:Note: switching to '6d1d7181c8e91145ded12e11fc2a9c8ce31671f6'. 2021-10-08T19:27:47.031 INFO:tasks.workunit.client.0.smithi157.stderr: 2021-10-08T19:27:47.031 INFO:tasks.workunit.client.0.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-10-08T19:27:47.031 INFO:tasks.workunit.client.0.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2021-10-08T19:27:47.031 INFO:tasks.workunit.client.0.smithi157.stderr:state without impacting any branches by switching back to a branch. 2021-10-08T19:27:47.032 INFO:tasks.workunit.client.0.smithi157.stderr: 2021-10-08T19:27:47.032 INFO:tasks.workunit.client.0.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2021-10-08T19:27:47.032 INFO:tasks.workunit.client.0.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2021-10-08T19:27:47.032 INFO:tasks.workunit.client.0.smithi157.stderr: 2021-10-08T19:27:47.032 INFO:tasks.workunit.client.0.smithi157.stderr: git switch -c 2021-10-08T19:27:47.033 INFO:tasks.workunit.client.0.smithi157.stderr: 2021-10-08T19:27:47.033 INFO:tasks.workunit.client.0.smithi157.stderr:Or undo this operation with: 2021-10-08T19:27:47.033 INFO:tasks.workunit.client.0.smithi157.stderr: 2021-10-08T19:27:47.033 INFO:tasks.workunit.client.0.smithi157.stderr: git switch - 2021-10-08T19:27:47.034 INFO:tasks.workunit.client.0.smithi157.stderr: 2021-10-08T19:27:47.034 INFO:tasks.workunit.client.0.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-10-08T19:27:47.034 INFO:tasks.workunit.client.0.smithi157.stderr: 2021-10-08T19:27:47.034 INFO:tasks.workunit.client.0.smithi157.stderr:HEAD is now at 6d1d7181c8e qa/tasks/nvme_loop: loop until 'nvme list' shows new devs 2021-10-08T19:27:47.036 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-10-08T19:27:47.062 INFO:tasks.workunit.client.0.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-10-08T19:27:47.063 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-10-08T19:27:47.064 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-10-08T19:27:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:46 smithi157 ceph-mon[32847]: pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:47.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:46 smithi157 ceph-mon[42114]: pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:47.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:46 smithi196 ceph-mon[34258]: pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:47.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:27:46 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:27:47.545 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-10-08T19:27:47.613 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-10-08T19:27:47.651 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-10-08T19:27:47.652 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-10-08T19:27:47.652 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-10-08T19:27:47.688 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-10-08T19:27:47.691 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2021-10-08T19:27:47.691 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-10-08T19:27:47.747 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2021-10-08T19:27:47.749 INFO:tasks.workunit:Running workunit rados/test.sh... 2021-10-08T19:27:47.750 DEBUG:teuthology.orchestra.run.smithi157:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2021-10-08T19:27:47.817 INFO:tasks.workunit.client.0.smithi157.stderr:+ parallel=1 2021-10-08T19:27:47.818 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' '' = --serial ']' 2021-10-08T19:27:47.818 INFO:tasks.workunit.client.0.smithi157.stderr:+ color= 2021-10-08T19:27:47.818 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -t 1 ']' 2021-10-08T19:27:47.818 INFO:tasks.workunit.client.0.smithi157.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2021-10-08T19:27:47.819 INFO:tasks.workunit.client.0.smithi157.stderr:+ declare -A pids 2021-10-08T19:27:47.819 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.819 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.819 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_aio 2021-10-08T19:27:47.820 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_aio' 2021-10-08T19:27:47.820 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_aio 2021-10-08T19:27:47.820 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.821 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_aio 2021-10-08T19:27:47.821 INFO:tasks.workunit.client.0.smithi157.stdout:test api_aio on pid 88483 2021-10-08T19:27:47.823 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88483 2021-10-08T19:27:47.823 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_aio on pid 88483' 2021-10-08T19:27:47.824 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88483 2021-10-08T19:27:47.824 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.824 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.824 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2021-10-08T19:27:47.824 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_aio_pp 2021-10-08T19:27:47.825 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_aio_pp' 2021-10-08T19:27:47.825 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_aio_pp 2021-10-08T19:27:47.825 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.825 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_aio 2021-10-08T19:27:47.826 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_aio.log 2021-10-08T19:27:47.826 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_aio: /' 2021-10-08T19:27:47.826 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_aio_pp 2021-10-08T19:27:47.826 INFO:tasks.workunit.client.0.smithi157.stdout:test api_aio_pp on pid 88491 2021-10-08T19:27:47.828 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88491 2021-10-08T19:27:47.828 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_aio_pp on pid 88491' 2021-10-08T19:27:47.829 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88491 2021-10-08T19:27:47.829 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.830 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.830 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2021-10-08T19:27:47.830 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_io 2021-10-08T19:27:47.830 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_io' 2021-10-08T19:27:47.831 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_io 2021-10-08T19:27:47.831 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.831 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_aio_pp 2021-10-08T19:27:47.831 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_aio_pp.log 2021-10-08T19:27:47.832 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_aio_pp: /' 2021-10-08T19:27:47.832 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_io 2021-10-08T19:27:47.832 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88499 2021-10-08T19:27:47.833 INFO:tasks.workunit.client.0.smithi157.stdout:test api_io on pid 88499 2021-10-08T19:27:47.835 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_io on pid 88499' 2021-10-08T19:27:47.835 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88499 2021-10-08T19:27:47.835 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.835 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.836 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2021-10-08T19:27:47.836 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_io_pp 2021-10-08T19:27:47.836 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_io_pp' 2021-10-08T19:27:47.836 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_io_pp 2021-10-08T19:27:47.836 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.837 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_io 2021-10-08T19:27:47.837 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_io.log 2021-10-08T19:27:47.837 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_io: /' 2021-10-08T19:27:47.837 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_io_pp 2021-10-08T19:27:47.838 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88507 2021-10-08T19:27:47.838 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_io_pp on pid 88507' 2021-10-08T19:27:47.839 INFO:tasks.workunit.client.0.smithi157.stdout:test api_io_pp on pid 88507 2021-10-08T19:27:47.841 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88507 2021-10-08T19:27:47.842 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.842 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.843 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2021-10-08T19:27:47.843 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_asio 2021-10-08T19:27:47.843 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_asio' 2021-10-08T19:27:47.843 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_asio 2021-10-08T19:27:47.843 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.844 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_io_pp 2021-10-08T19:27:47.844 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_io_pp.log 2021-10-08T19:27:47.844 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_io_pp: /' 2021-10-08T19:27:47.844 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_asio 2021-10-08T19:27:47.844 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88515 2021-10-08T19:27:47.845 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_asio on pid 88515' 2021-10-08T19:27:47.845 INFO:tasks.workunit.client.0.smithi157.stdout:test api_asio on pid 88515 2021-10-08T19:27:47.846 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88515 2021-10-08T19:27:47.847 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.847 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.847 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2021-10-08T19:27:47.847 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_list 2021-10-08T19:27:47.848 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_list' 2021-10-08T19:27:47.848 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_list 2021-10-08T19:27:47.848 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.848 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_asio 2021-10-08T19:27:47.849 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:27:47] "GET /metrics HTTP/1.1" 200 153788 "" "Prometheus/2.18.1" 2021-10-08T19:27:47.849 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:47 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:47.850 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_asio.log 2021-10-08T19:27:47.850 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_asio: /' 2021-10-08T19:27:47.850 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:47 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:47.851 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_list 2021-10-08T19:27:47.851 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88523 2021-10-08T19:27:47.852 INFO:tasks.workunit.client.0.smithi157.stdout:test api_list on pid 88523 2021-10-08T19:27:47.853 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_list on pid 88523' 2021-10-08T19:27:47.853 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88523 2021-10-08T19:27:47.854 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.854 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.854 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2021-10-08T19:27:47.854 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_lock 2021-10-08T19:27:47.855 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_lock' 2021-10-08T19:27:47.855 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_lock 2021-10-08T19:27:47.855 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.855 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_list 2021-10-08T19:27:47.855 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_list.log 2021-10-08T19:27:47.856 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_list: /' 2021-10-08T19:27:47.856 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_lock 2021-10-08T19:27:47.856 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88531 2021-10-08T19:27:47.856 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_lock on pid 88531' 2021-10-08T19:27:47.857 INFO:tasks.workunit.client.0.smithi157.stdout:test api_lock on pid 88531 2021-10-08T19:27:47.858 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88531 2021-10-08T19:27:47.858 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.858 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.859 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2021-10-08T19:27:47.859 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_lock_pp 2021-10-08T19:27:47.859 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_lock_pp' 2021-10-08T19:27:47.859 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_lock_pp 2021-10-08T19:27:47.859 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.860 INFO:tasks.workunit.client.0.smithi157.stdout:test api_lock_pp on pid 88539 2021-10-08T19:27:47.861 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_lock 2021-10-08T19:27:47.862 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_lock_pp 2021-10-08T19:27:47.862 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88539 2021-10-08T19:27:47.862 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_lock_pp on pid 88539' 2021-10-08T19:27:47.862 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88539 2021-10-08T19:27:47.863 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.863 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.863 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2021-10-08T19:27:47.863 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_lock_pp 2021-10-08T19:27:47.863 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_lock: /' 2021-10-08T19:27:47.864 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_lock_pp.log 2021-10-08T19:27:47.864 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_lock_pp: /' 2021-10-08T19:27:47.864 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_misc 2021-10-08T19:27:47.864 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_misc' 2021-10-08T19:27:47.864 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_lock.log 2021-10-08T19:27:47.865 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_misc 2021-10-08T19:27:47.865 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.865 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_misc 2021-10-08T19:27:47.865 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88547 2021-10-08T19:27:47.865 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_misc on pid 88547' 2021-10-08T19:27:47.866 INFO:tasks.workunit.client.0.smithi157.stdout:test api_misc on pid 88547 2021-10-08T19:27:47.868 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88547 2021-10-08T19:27:47.868 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2021-10-08T19:27:47.868 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.868 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.868 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_misc_pp 2021-10-08T19:27:47.869 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_misc_pp' 2021-10-08T19:27:47.869 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_misc_pp 2021-10-08T19:27:47.869 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.869 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_misc 2021-10-08T19:27:47.870 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_misc.log 2021-10-08T19:27:47.870 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_misc: /' 2021-10-08T19:27:47.870 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_misc_pp 2021-10-08T19:27:47.870 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88555 2021-10-08T19:27:47.870 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_misc_pp on pid 88555' 2021-10-08T19:27:47.871 INFO:tasks.workunit.client.0.smithi157.stdout:test api_misc_pp on pid 88555 2021-10-08T19:27:47.872 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88555 2021-10-08T19:27:47.872 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.873 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.873 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2021-10-08T19:27:47.873 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_tier_pp 2021-10-08T19:27:47.873 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_tier_pp' 2021-10-08T19:27:47.874 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_misc_pp 2021-10-08T19:27:47.874 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_misc_pp.log 2021-10-08T19:27:47.874 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_misc_pp: /' 2021-10-08T19:27:47.874 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_tier_pp 2021-10-08T19:27:47.874 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.875 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_tier_pp 2021-10-08T19:27:47.875 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88563 2021-10-08T19:27:47.875 INFO:tasks.workunit.client.0.smithi157.stdout:test api_tier_pp on pid 88563 2021-10-08T19:27:47.877 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_tier_pp on pid 88563' 2021-10-08T19:27:47.877 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88563 2021-10-08T19:27:47.877 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.878 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2021-10-08T19:27:47.878 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.878 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_pool 2021-10-08T19:27:47.878 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_pool' 2021-10-08T19:27:47.879 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_pool 2021-10-08T19:27:47.879 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.879 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_tier_pp 2021-10-08T19:27:47.879 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_tier_pp.log 2021-10-08T19:27:47.879 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_tier_pp: /' 2021-10-08T19:27:47.880 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_pool 2021-10-08T19:27:47.880 INFO:tasks.workunit.client.0.smithi157.stdout:test api_pool on pid 88571 2021-10-08T19:27:47.881 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88571 2021-10-08T19:27:47.881 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_pool on pid 88571' 2021-10-08T19:27:47.881 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88571 2021-10-08T19:27:47.881 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.882 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2021-10-08T19:27:47.882 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.882 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_snapshots 2021-10-08T19:27:47.882 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_snapshots' 2021-10-08T19:27:47.883 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_pool 2021-10-08T19:27:47.883 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_pool: /' 2021-10-08T19:27:47.883 INFO:tasks.workunit.client.0.smithi157.stdout:test api_snapshots on pid 88599 2021-10-08T19:27:47.884 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.884 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_snapshots 2021-10-08T19:27:47.884 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_pool.log 2021-10-08T19:27:47.885 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_snapshots 2021-10-08T19:27:47.885 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88599 2021-10-08T19:27:47.885 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_snapshots on pid 88599' 2021-10-08T19:27:47.885 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88599 2021-10-08T19:27:47.885 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.886 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.886 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_snapshots_pp 2021-10-08T19:27:47.886 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_snapshots_pp' 2021-10-08T19:27:47.886 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2021-10-08T19:27:47.887 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_snapshots_pp 2021-10-08T19:27:47.892 INFO:tasks.workunit.client.0.smithi157.stdout:test api_snapshots_pp on pid 88625 2021-10-08T19:27:47.892 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.892 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_snapshots_pp 2021-10-08T19:27:47.893 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88625 2021-10-08T19:27:47.893 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_snapshots_pp on pid 88625' 2021-10-08T19:27:47.893 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88625 2021-10-08T19:27:47.893 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:47.893 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:47.894 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_stat 2021-10-08T19:27:47.894 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_stat' 2021-10-08T19:27:47.894 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_stat 2021-10-08T19:27:47.896 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2021-10-08T19:27:47.896 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_snapshots 2021-10-08T19:27:47.897 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [==========] Running 11 tests from 4 test suites. 2021-10-08T19:27:47.898 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] Global test environment set-up. 2021-10-08T19:27:47.898 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2021-10-08T19:27:47.898 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2021-10-08T19:27:47.898 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2021-10-08T19:27:47.899 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-10-08T19:27:47.899 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.899 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure 2021-10-08T19:27:47.899 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2021-10-08T19:27:47.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 0 2021-10-08T19:27:47.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.882+0000 7f8ec8283540 10 monclient: get_monmap_and_config 2021-10-08T19:27:47.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.882+0000 7f8ec8283540 10 monclient: build_initial_monmap 2021-10-08T19:27:47.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.882+0000 7f8ec8283540 10 monclient: monmap: 2021-10-08T19:27:47.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: epoch 0 2021-10-08T19:27:47.901 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: fsid 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:27:47.901 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: last_changed 2021-10-08T19:27:47.883783+0000 2021-10-08T19:27:47.901 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: created 2021-10-08T19:27:47.883783+0000 2021-10-08T19:27:47.901 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: min_mon_release 0 (unknown) 2021-10-08T19:27:47.902 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: election_strategy: 1 2021-10-08T19:27:47.902 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2021-10-08T19:27:47.902 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2021-10-08T19:27:47.902 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2021-10-08T19:27:47.903 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.903 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 1 Processor -- start 2021-10-08T19:27:47.903 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 1 -- start start 2021-10-08T19:27:47.903 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:47.904 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:47.904 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient: _add_conns ranks=[1,2,0] 2021-10-08T19:27:47.904 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd04f350 0x5555fd04f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.904 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd04f350 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:47.905 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.905 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fd04fc60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:47.905 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 0x5555fd04aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.905 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd04aad0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:47.905 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.906 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcf07940 con 0x5555fd04aad0 2021-10-08T19:27:47.906 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.906 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcea90c0 con 0x5555fd04f350 2021-10-08T19:27:47.907 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_snapshots: /' 2021-10-08T19:27:47.907 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.907 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb72b0 con 0x5555fd04fc60 2021-10-08T19:27:47.908 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:47.908 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.235498s 2021-10-08T19:27:47.908 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebaffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:47.908 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebaffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50586/0 (socket says 172.21.15.157:50586) 2021-10-08T19:27:47.911 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebaffd700 1 -- 172.21.15.157:0/1919344001 learned_addr learned my addr 172.21.15.157:0/1919344001 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:27:47.912 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebaffd700 10 monclient(hunting): get_auth_request con 0x5555fd04fc60 auth_method 0 2021-10-08T19:27:47.912 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebaffd700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-10-08T19:27:47.912 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebaffd700 10 monclient(hunting): _init_auth method 2 2021-10-08T19:27:47.912 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebaffd700 10 monclient(hunting): _init_auth creating new auth 2021-10-08T19:27:47.913 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebbfff700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 0x5555fd04aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:47.913 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebbfff700 10 monclient(hunting): get_auth_request con 0x5555fd04aad0 auth_method 0 2021-10-08T19:27:47.913 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebbfff700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-10-08T19:27:47.914 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebbfff700 10 monclient(hunting): _init_auth method 2 2021-10-08T19:27:47.914 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.895+0000 7f8ebbfff700 10 monclient(hunting): _init_auth creating new auth 2021-10-08T19:27:47.914 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ebaffd700 10 monclient(hunting): handle_auth_reply_more payload 9 2021-10-08T19:27:47.914 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ebaffd700 10 monclient(hunting): handle_auth_reply_more payload_len 9 2021-10-08T19:27:47.915 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ebaffd700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2021-10-08T19:27:47.915 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ec8283540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:27:47.915 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ec8283540 10 monclient(hunting): shutdown 2021-10-08T19:27:47.915 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ec8283540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:27:47.916 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 msgr2=0x5555fd04a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.916 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.916 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_snapshots.log 2021-10-08T19:27:47.917 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd04f350 msgr2=0x5555fd04f720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:27:47.917 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd04f350 0x5555fd04f720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.917 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 msgr2=0x5555fd04aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.918 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.896+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 0x5555fd04aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.918 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:47.918 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:47.918 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient: _add_conns ranks=[0,1,2] 2021-10-08T19:27:47.919 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 0x5555fd04aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.919 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd04aad0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:47.919 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 0x5555fd0504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.919 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd050120 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:47.920 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.920 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fd04fc60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:47.920 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.920 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcf07940 con 0x5555fd04aad0 2021-10-08T19:27:47.920 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.921 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcea90c0 con 0x5555fd050120 2021-10-08T19:27:47.921 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.921 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb72b0 con 0x5555fd04fc60 2021-10-08T19:27:47.922 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:47.922 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.238468s 2021-10-08T19:27:47.922 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:27:47.923 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_snapshots_pp 2021-10-08T19:27:47.924 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2021-10-08T19:27:47.924 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_snapshots_pp: /' 2021-10-08T19:27:47.924 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:47.926 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 10 monclient(hunting): shutdown 2021-10-08T19:27:47.927 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:27:47.927 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 msgr2=0x5555fd04a560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-10-08T19:27:47.927 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.928 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 msgr2=0x5555fd0504f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-10-08T19:27:47.928 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 0x5555fd0504f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.928 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 msgr2=0x5555fd04aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.929 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.898+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 0x5555fd04aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.929 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:47.929 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:47.930 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient: _add_conns ranks=[2,0,1] 2021-10-08T19:27:47.930 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.930 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fd04fc60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:47.930 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 0x5555fd04aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.931 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd04aad0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:47.931 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 0x5555fd0504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.931 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd050120 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:47.932 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.932 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcf07940 con 0x5555fd04aad0 2021-10-08T19:27:47.932 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.933 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcea90c0 con 0x5555fd050120 2021-10-08T19:27:47.933 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.933 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb72b0 con 0x5555fd04fc60 2021-10-08T19:27:47.933 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:47.933 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.246793s 2021-10-08T19:27:47.934 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ebaffd700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 0x5555fd04aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:47.934 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ebaffd700 10 monclient(hunting): get_auth_request con 0x5555fd04aad0 auth_method 0 2021-10-08T19:27:47.934 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ebaffd700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-10-08T19:27:47.934 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ebaffd700 10 monclient(hunting): _init_auth method 2 2021-10-08T19:27:47.935 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.906+0000 7f8ebaffd700 10 monclient(hunting): _init_auth creating new auth 2021-10-08T19:27:47.935 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 10 monclient(hunting): handle_auth_reply_more payload 9 2021-10-08T19:27:47.935 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 10 monclient(hunting): handle_auth_reply_more payload_len 9 2021-10-08T19:27:47.935 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2021-10-08T19:27:47.935 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebb7fe700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:47.936 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebb7fe700 10 monclient(hunting): get_auth_request con 0x5555fd04fc60 auth_method 0 2021-10-08T19:27:47.936 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebb7fe700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-10-08T19:27:47.936 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebb7fe700 10 monclient(hunting): _init_auth method 2 2021-10-08T19:27:47.936 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-10-08T19:27:47.936 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebb7fe700 10 monclient(hunting): handle_auth_reply_more payload 9 2021-10-08T19:27:47.937 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebb7fe700 10 monclient(hunting): handle_auth_reply_more payload_len 9 2021-10-08T19:27:47.937 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebb7fe700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2021-10-08T19:27:47.937 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 10 monclient(hunting): handle_auth_done global_id 14832 payload 274 2021-10-08T19:27:47.938 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 msgr2=0x5555fd04a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.938 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.938 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 msgr2=0x5555fd0504f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:27:47.938 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 0x5555fd0504f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.939 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 10 monclient: _finish_hunting 0 2021-10-08T19:27:47.939 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 1 monclient: found mon.noname-a 2021-10-08T19:27:47.939 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 20 monclient: _un_backoff reopen_interval_multipler now 1 2021-10-08T19:27:47.940 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2021-10-08T19:27:47.940 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555fceb41b0 con 0x5555fd04aad0 2021-10-08T19:27:47.940 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.907+0000 7f8ebaffd700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 0x5555fd04aea0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009700 tx=0x7f8eb0005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219336c30994431b server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:47.940 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 5 monclient: authenticate success, global_id 14832 2021-10-08T19:27:47.940 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 -1 monclient: get_monmap_and_config failed to get config 2021-10-08T19:27:47.941 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient: shutdown 2021-10-08T19:27:47.941 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 20 monclient: shutdown discarding 0 pending message(s) 2021-10-08T19:27:47.941 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 msgr2=0x5555fd04aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:47.941 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aad0 0x5555fd04aea0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009700 tx=0x7f8eb0005b10 comp rx=0 tx=0).stop 2021-10-08T19:27:47.942 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:47.942 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:47.942 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient: _add_conns ranks=[2,0,1] 2021-10-08T19:27:47.942 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.942 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fd04fc60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:47.943 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd0561d0 0x5555fd0565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.943 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd0561d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:47.943 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 0x5555fd0504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.944 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd050120 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:47.944 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.944 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb4570 con 0x5555fd0561d0 2021-10-08T19:27:47.944 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.945 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056ae0 con 0x5555fd050120 2021-10-08T19:27:47.945 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.945 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056c20 con 0x5555fd04fc60 2021-10-08T19:27:47.945 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:47.945 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.252372s 2021-10-08T19:27:47.946 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ebb7fe700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:47.946 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ebb7fe700 10 monclient(hunting): get_auth_request con 0x5555fd04fc60 auth_method 0 2021-10-08T19:27:47.946 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ebb7fe700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-10-08T19:27:47.946 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ebb7fe700 10 monclient(hunting): _init_auth method 2 2021-10-08T19:27:47.947 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ebb7fe700 10 monclient(hunting): _init_auth creating new auth 2021-10-08T19:27:47.947 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:27:47.947 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 10 monclient(hunting): shutdown 2021-10-08T19:27:47.948 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:27:47.948 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 msgr2=0x5555fd04a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.948 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.948 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 msgr2=0x5555fd0504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.949 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 0x5555fd0504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.949 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd0561d0 msgr2=0x5555fd0565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.949 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd0561d0 0x5555fd0565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.949 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.912+0000 7f8ebb7fe700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:27:47.950 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:47.950 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:47.950 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient: _add_conns ranks=[1,0,2] 2021-10-08T19:27:47.950 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 0x5555fd0504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.951 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd050120 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:47.952 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd0561d0 0x5555fd0565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.952 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd0561d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:47.953 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.953 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fd04fc60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:47.953 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.954 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb4570 con 0x5555fd0561d0 2021-10-08T19:27:47.954 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.955 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056ae0 con 0x5555fd050120 2021-10-08T19:27:47.955 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.956 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056c20 con 0x5555fd04fc60 2021-10-08T19:27:47.956 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:47.956 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.254362s 2021-10-08T19:27:47.957 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:27:47.957 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): shutdown 2021-10-08T19:27:47.958 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:27:47.958 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 msgr2=0x5555fd04a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.959 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.959 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 msgr2=0x5555fd0504f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-10-08T19:27:47.959 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd050120 0x5555fd0504f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.960 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd0561d0 msgr2=0x5555fd0565a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-10-08T19:27:47.961 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd0561d0 0x5555fd0565a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.961 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:47.962 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:47.962 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient: _add_conns ranks=[0,1,2] 2021-10-08T19:27:47.962 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 0x5555fd052a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.963 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd053ac0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:47.963 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 0x5555fd053350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.964 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd052f80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:47.964 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.965 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fd04fc60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:47.965 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.966 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb4570 con 0x5555fd053ac0 2021-10-08T19:27:47.966 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.966 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056ae0 con 0x5555fd052f80 2021-10-08T19:27:47.967 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.967 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056c20 con 0x5555fd04fc60 2021-10-08T19:27:47.968 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:47.968 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.254741s 2021-10-08T19:27:47.969 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ebbfff700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:47.969 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:27:47.969 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient(hunting): shutdown 2021-10-08T19:27:47.970 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:27:47.970 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 msgr2=0x5555fd04a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.971 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.971 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 msgr2=0x5555fd053350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-10-08T19:27:47.972 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 0x5555fd053350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.972 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 msgr2=0x5555fd052a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-10-08T19:27:47.973 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 0x5555fd052a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.973 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:47.974 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ebbfff700 10 monclient: get_auth_request con 0x5555fd04fc60 auth_method 0 2021-10-08T19:27:47.974 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.914+0000 7f8ebbfff700 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:27:47.975 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:47.975 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient: _add_conns ranks=[0,1,2] 2021-10-08T19:27:47.976 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 0x5555fd052a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.976 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd053ac0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:47.977 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 0x5555fd053350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.977 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd052f80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:47.977 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd052500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.978 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fd04fc60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:47.978 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.979 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb4570 con 0x5555fd053ac0 2021-10-08T19:27:47.979 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.980 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056ae0 con 0x5555fd052f80 2021-10-08T19:27:47.980 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.981 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056c20 con 0x5555fd04fc60 2021-10-08T19:27:47.981 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:47.981 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.255131s 2021-10-08T19:27:47.982 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:27:47.982 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): shutdown 2021-10-08T19:27:47.983 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:27:47.983 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 msgr2=0x5555fd052500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.984 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd052500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.984 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 msgr2=0x5555fd053350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.984 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 0x5555fd053350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.985 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 msgr2=0x5555fd052a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.985 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 0x5555fd052a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.986 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:47.986 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:47.987 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient: _add_conns ranks=[0,2,1] 2021-10-08T19:27:47.987 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 0x5555fd052a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.988 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd053ac0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:47.988 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.988 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fd04fc60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:47.989 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 0x5555fd053350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.989 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd052f80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:47.990 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.990 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb4570 con 0x5555fd053ac0 2021-10-08T19:27:47.991 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.991 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056ae0 con 0x5555fd052f80 2021-10-08T19:27:47.991 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:47.992 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056c20 con 0x5555fd04fc60 2021-10-08T19:27:47.992 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:47.992 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.255555s 2021-10-08T19:27:47.992 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:27:47.993 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): shutdown 2021-10-08T19:27:47.993 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:27:47.993 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 msgr2=0x5555fd04a560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-10-08T19:27:47.994 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04fc60 0x5555fd04a560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.994 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 msgr2=0x5555fd053350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:27:47.994 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 0x5555fd053350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:47.995 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 msgr2=0x5555fd052a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:47.995 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 0x5555fd052a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 test api_stat on pid 88754 2021-10-08T19:27:47.996 INFO:tasks.workunit.client.0.smithi157.stdout:comp rx=0 tx=0).stop 2021-10-08T19:27:47.996 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:47.996 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:47.997 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient: _add_conns ranks=[2,0,1] 2021-10-08T19:27:47.997 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fcfbf610 0x5555fd0565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.997 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fcfbf610 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:47.998 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 0x5555fd052510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.998 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd053ac0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:47.999 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 0x5555fd053350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:47.999 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd052f80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:48.000 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:48.000 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb4570 con 0x5555fd053ac0 2021-10-08T19:27:48.001 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:48.001 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056ae0 con 0x5555fd052f80 2021-10-08T19:27:48.002 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:48.002 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056c20 con 0x5555fcfbf610 2021-10-08T19:27:48.002 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:48.003 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.255888s 2021-10-08T19:27:48.003 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:27:48.003 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 10 monclient(hunting): shutdown 2021-10-08T19:27:48.004 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:27:48.004 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fcfbf610 msgr2=0x5555fd0565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:48.005 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fcfbf610 0x5555fd0565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.006 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_stat 2021-10-08T19:27:48.006 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88754 2021-10-08T19:27:48.007 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_stat on pid 88754' 2021-10-08T19:27:48.007 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88754 2021-10-08T19:27:48.007 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.007 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.008 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 msgr2=0x5555fd053350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:27:48.008 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd052f80 0x5555fd053350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.008 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 msgr2=0x5555fd052510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-10-08T19:27:48.009 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.915+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd053ac0 0x5555fd052510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.009 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient: init 2021-10-08T19:27:48.009 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient: _reopen_session rank -1 2021-10-08T19:27:48.009 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient: _add_conns ranks=[0,2,1] 2021-10-08T19:27:48.010 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aea0 0x5555fd04c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:48.010 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-a con 0x5555fd04aea0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2021-10-08T19:27:48.010 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04c620 0x5555fd04c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:48.011 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-c con 0x5555fd04c620 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2021-10-08T19:27:48.011 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd072bc0 0x5555fd074fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:48.011 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient(hunting): picked mon.noname-b con 0x5555fd072bc0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2021-10-08T19:27:48.012 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:48.012 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fcfb4570 con 0x5555fd04aea0 2021-10-08T19:27:48.012 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:48.013 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056ae0 con 0x5555fd072bc0 2021-10-08T19:27:48.013 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient(hunting): start opening mon connection 2021-10-08T19:27:48.013 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555fd056c20 con 0x5555fd04c620 2021-10-08T19:27:48.014 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient(hunting): _renew_subs 2021-10-08T19:27:48.014 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient(hunting): authenticate will time out at 1039.256418s 2021-10-08T19:27:48.014 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:27:48.014 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 10 monclient(hunting): shutdown 2021-10-08T19:27:48.016 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_stat_pp 2021-10-08T19:27:48.016 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_stat_pp' 2021-10-08T19:27:48.016 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2021-10-08T19:27:48.017 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_stat_pp 2021-10-08T19:27:48.017 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.017 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_stat 2021-10-08T19:27:48.018 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_stat: /' 2021-10-08T19:27:48.018 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_stat_pp 2021-10-08T19:27:48.018 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88775 2021-10-08T19:27:48.019 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_stat_pp on pid 88775' 2021-10-08T19:27:48.019 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 20 monclient(hunting): shutdown discarding 1test api_stat_pp on pid 88775 2021-10-08T19:27:48.021 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88775 2021-10-08T19:27:48.022 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.022 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.022 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2021-10-08T19:27:48.023 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_watch_notify 2021-10-08T19:27:48.023 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_watch_notify' 2021-10-08T19:27:48.023 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.023 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_stat_pp 2021-10-08T19:27:48.024 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_stat.log 2021-10-08T19:27:48.024 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_watch_notify 2021-10-08T19:27:48.024 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_watch_notify 2021-10-08T19:27:48.025 INFO:tasks.workunit.client.0.smithi157.stdout:test api_watch_notify on pid 88792 2021-10-08T19:27:48.027 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88792 2021-10-08T19:27:48.027 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_watch_notify on pid 88792' 2021-10-08T19:27:48.028 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88792 2021-10-08T19:27:48.028 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.028 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.029 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2021-10-08T19:27:48.029 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_stat_pp.log 2021-10-08T19:27:48.029 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_watch_notify_pp 2021-10-08T19:27:48.030 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_watch_notify_pp' 2021-10-08T19:27:48.030 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_watch_notify 2021-10-08T19:27:48.031 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_stat_pp: /' 2021-10-08T19:27:48.031 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_watch_notify_pp 2021-10-08T19:27:48.031 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.032 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_watch_notify.log 2021-10-08T19:27:48.032 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_watch_notify: /' 2021-10-08T19:27:48.032 INFO:tasks.workunit.client.0.smithi157.stdout:test api_watch_notify_pp on pid 88814 2021-10-08T19:27:48.033 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_watch_notify_pp 2021-10-08T19:27:48.034 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88814 2021-10-08T19:27:48.034 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_watch_notify_pp on pid 88814' 2021-10-08T19:27:48.034 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88814 2021-10-08T19:27:48.035 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.035 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2021-10-08T19:27:48.035 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.035 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_cmd 2021-10-08T19:27:48.036 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_cmd' 2021-10-08T19:27:48.036 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.036 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_cmd 2021-10-08T19:27:48.037 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_watch_notify_pp 2021-10-08T19:27:48.037 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2021-10-08T19:27:48.037 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_cmd 2021-10-08T19:27:48.037 INFO:tasks.workunit.client.0.smithi157.stdout:test api_cmd on pid 88833 2021-10-08T19:27:48.039 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88833 2021-10-08T19:27:48.039 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_cmd on pid 88833' 2021-10-08T19:27:48.039 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88833 2021-10-08T19:27:48.040 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.040 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2021-10-08T19:27:48.040 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.041 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_cmd_pp 2021-10-08T19:27:48.041 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_cmd_pp' 2021-10-08T19:27:48.041 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_cmd.log 2021-10-08T19:27:48.042 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_cmd: /' 2021-10-08T19:27:48.042 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_cmd 2021-10-08T19:27:48.042 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2021-10-08T19:27:48.043 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_cmd_pp 2021-10-08T19:27:48.043 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.043 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_cmd_pp 2021-10-08T19:27:48.044 INFO:tasks.workunit.client.0.smithi157.stdout:test api_cmd_pp on pid 88880 2021-10-08T19:27:48.045 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88880 2021-10-08T19:27:48.045 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_cmd_pp on pid 88880' 2021-10-08T19:27:48.045 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88880 2021-10-08T19:27:48.046 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.046 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2021-10-08T19:27:48.046 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.046 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_service 2021-10-08T19:27:48.047 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_service' 2021-10-08T19:27:48.047 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_cmd_pp 2021-10-08T19:27:48.047 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_service 2021-10-08T19:27:48.047 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_cmd_pp: /' 2021-10-08T19:27:48.048 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2021-10-08T19:27:48.048 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.048 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_service 2021-10-08T19:27:48.048 INFO:tasks.workunit.client.0.smithi157.stdout:test api_service on pid 88916 2021-10-08T19:27:48.049 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88916 2021-10-08T19:27:48.049 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_service on pid 88916' 2021-10-08T19:27:48.050 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88916 2021-10-08T19:27:48.050 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.050 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2021-10-08T19:27:48.050 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.051 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_service_pp 2021-10-08T19:27:48.051 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_service_pp' 2021-10-08T19:27:48.051 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_service 2021-10-08T19:27:48.051 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_service.log 2021-10-08T19:27:48.051 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_service_pp 2021-10-08T19:27:48.052 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.052 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_service_pp 2021-10-08T19:27:48.052 INFO:tasks.workunit.client.0.smithi157.stdout:test api_service_pp on pid 88941 2021-10-08T19:27:48.053 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88941 2021-10-08T19:27:48.054 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_service_pp on pid 88941' 2021-10-08T19:27:48.054 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88941 2021-10-08T19:27:48.054 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.054 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.055 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2021-10-08T19:27:48.055 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_service_pp 2021-10-08T19:27:48.055 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_service_pp.log 2021-10-08T19:27:48.055 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_c_write_operations 2021-10-08T19:27:48.056 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_service_pp: /' 2021-10-08T19:27:48.056 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_c_write_operations' 2021-10-08T19:27:48.056 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_service: /' 2021-10-08T19:27:48.056 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.056 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_c_write_operations 2021-10-08T19:27:48.057 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_c_write_operations 2021-10-08T19:27:48.057 INFO:tasks.workunit.client.0.smithi157.stdout:test api_c_write_operations on pid 88958 2021-10-08T19:27:48.058 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88958 2021-10-08T19:27:48.058 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_c_write_operations on pid 88958' 2021-10-08T19:27:48.058 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88958 2021-10-08T19:27:48.059 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.059 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.059 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_c_read_operations 2021-10-08T19:27:48.059 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_c_read_operations' 2021-10-08T19:27:48.059 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_c_read_operations 2021-10-08T19:27:48.060 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.060 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2021-10-08T19:27:48.060 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_c_read_operations 2021-10-08T19:27:48.061 INFO:tasks.workunit.client.0.smithi157.stdout:test api_c_read_operations on pid 88966 2021-10-08T19:27:48.061 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_c_write_operations 2021-10-08T19:27:48.061 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88966 2021-10-08T19:27:48.062 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_c_read_operations on pid 88966' 2021-10-08T19:27:48.062 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88966 2021-10-08T19:27:48.062 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2021-10-08T19:27:48.063 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.063 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.063 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2021-10-08T19:27:48.063 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_c_write_operations: /' 2021-10-08T19:27:48.064 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s api_cls_remote_reads 2021-10-08T19:27:48.064 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' api_cls_remote_reads' 2021-10-08T19:27:48.064 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo api_cls_remote_reads 2021-10-08T19:27:48.064 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_c_read_operations 2021-10-08T19:27:48.064 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2021-10-08T19:27:48.065 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_c_read_operations: /' 2021-10-08T19:27:48.065 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.065 INFO:tasks.workunit.client.0.smithi157.stdout:test api_cls_remote_reads on pid 88981 2021-10-08T19:27:48.066 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=api_cls_remote_reads 2021-10-08T19:27:48.067 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88981 2021-10-08T19:27:48.067 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test api_cls_remote_reads on pid 88981' 2021-10-08T19:27:48.067 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88981 2021-10-08T19:27:48.067 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.068 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.068 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2021-10-08T19:27:48.068 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s list_parallel 2021-10-08T19:27:48.068 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' list_parallel' 2021-10-08T19:27:48.068 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo list_parallel 2021-10-08T19:27:48.069 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_api_cls_remote_reads 2021-10-08T19:27:48.069 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2021-10-08T19:27:48.069 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.069 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=list_parallel 2021-10-08T19:27:48.070 INFO:tasks.workunit.client.0.smithi157.stdout:test list_parallel on pid 88991 2021-10-08T19:27:48.071 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88991 2021-10-08T19:27:48.071 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test list_parallel on pid 88991' 2021-10-08T19:27:48.072 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=88991 2021-10-08T19:27:48.072 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.073 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2021-10-08T19:27:48.073 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.073 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s open_pools_parallel 2021-10-08T19:27:48.073 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' open_pools_parallel' 2021-10-08T19:27:48.074 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_list_parallel.log 2021-10-08T19:27:48.074 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo open_pools_parallel 2021-10-08T19:27:48.074 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_list_parallel 2021-10-08T19:27:48.074 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ list_parallel: /' 2021-10-08T19:27:48.075 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.075 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2021-10-08T19:27:48.075 INFO:tasks.workunit.client.0.smithi157.stdout:test open_pools_parallel on pid 89002 2021-10-08T19:27:48.076 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=open_pools_parallel 2021-10-08T19:27:48.077 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=89002 2021-10-08T19:27:48.077 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test open_pools_parallel on pid 89002' 2021-10-08T19:27:48.077 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=89002 2021-10-08T19:27:48.077 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:27:48.077 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.078 INFO:tasks.workunit.client.0.smithi157.stderr:++ printf %25s delete_pools_parallel 2021-10-08T19:27:48.078 INFO:tasks.workunit.client.0.smithi157.stderr:+ r=' delete_pools_parallel' 2021-10-08T19:27:48.078 INFO:tasks.workunit.client.0.smithi157.stderr:++ echo delete_pools_parallel 2021-10-08T19:27:48.078 INFO:tasks.workunit.client.0.smithi157.stderr:++ awk '{print $1}' 2021-10-08T19:27:48.079 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2021-10-08T19:27:48.079 INFO:tasks.workunit.client.0.smithi157.stdout:test delete_pools_parallel on pid 89010 2021-10-08T19:27:48.080 INFO:tasks.workunit.client.0.smithi157.stderr:+ ff=delete_pools_parallel 2021-10-08T19:27:48.080 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=89010 2021-10-08T19:27:48.081 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo 'test delete_pools_parallel on pid 89010' 2021-10-08T19:27:48.081 INFO:tasks.workunit.client.0.smithi157.stderr:+ pids[$f]=89010 2021-10-08T19:27:48.081 INFO:tasks.workunit.client.0.smithi157.stderr:+ ret=0 2021-10-08T19:27:48.081 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:27:48.081 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:27:48.082 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88599 2021-10-08T19:27:48.082 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88599 2021-10-08T19:27:48.082 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_open_pools_parallel 2021-10-08T19:27:48.082 INFO:tasks.workunit.client.0.smithi157.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2021-10-08T19:27:48.083 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ open_pools_parallel: /' 2021-10-08T19:27:48.083 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2021-10-08T19:27:48.083 INFO:tasks.workunit.client.0.smithi157.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2021-10-08T19:27:48.083 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph_test_rados_delete_pools_parallel 2021-10-08T19:27:48.083 INFO:tasks.workunit.client.0.smithi157.stderr:+ sed 's/^/ delete_pools_parallel: /' 2021-10-08T19:27:48.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:47 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:48.901 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:27:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:27:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:48 smithi157 ceph-mon[32847]: pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2836848096' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-10-08T19:27:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:48 smithi157 ceph-mon[42114]: pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2836848096' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-10-08T19:27:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:48 smithi196 ceph-mon[34258]: pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2836848096' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-10-08T19:27:53.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/158515859' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1113790117' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:53 smithi196 ceph-mon[34258]: osdmap e69: 8 total, 8 up, 8 in 2021-10-08T19:27:53.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/158515859' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:53.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:53.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1113790117' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:53.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:53 smithi157 ceph-mon[32847]: osdmap e69: 8 total, 8 up, 8 in 2021-10-08T19:27:53.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/158515859' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:53.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:53.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1113790117' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:53.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:53 smithi157 ceph-mon[42114]: osdmap e69: 8 total, 8 up, 8 in 2021-10-08T19:27:54.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4263173374' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88890-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3167916399' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2700908637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88986-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2365536819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1120796350' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2045750419' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88784-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/963852364' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2634514473' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2199086284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88972-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/80542488' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: osdmap e70: 8 total, 8 up, 8 in 2021-10-08T19:27:54.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:27:54.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/860395557' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/534249721' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88536-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: osdmap e71: 8 total, 8 up, 8 in 2021-10-08T19:27:54.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:27:54.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4263173374' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88890-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3167916399' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2700908637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88986-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2365536819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1120796350' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2045750419' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88784-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/963852364' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2634514473' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2199086284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88972-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/80542488' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: osdmap e70: 8 total, 8 up, 8 in 2021-10-08T19:27:54.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:27:54.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/860395557' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/534249721' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88536-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: osdmap e71: 8 total, 8 up, 8 in 2021-10-08T19:27:54.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:27:54.612 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2021-10-08T19:27:54.612 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [----------] Global test environment set-up. 2021-10-08T19:27:54.613 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [----------] 7 tests from LibRadosList 2021-10-08T19:27:54.613 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2021-10-08T19:27:54.613 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosList.ListObjects (114 ms) 2021-10-08T19:27:54.613 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2021-10-08T19:27:54.614 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (21 ms) 2021-10-08T19:27:54.614 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2021-10-08T19:27:54.614 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: myset foo1,foo2,foo3 2021-10-08T19:27:54.614 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo1 2021-10-08T19:27:54.615 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo2 2021-10-08T19:27:54.615 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo3 2021-10-08T19:27:54.616 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: myset foo1,foo4,foo5 2021-10-08T19:27:54.616 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo4 2021-10-08T19:27:54.616 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo5 2021-10-08T19:27:54.617 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo1 2021-10-08T19:27:54.617 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: myset foo6,foo7 2021-10-08T19:27:54.617 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo7 2021-10-08T19:27:54.617 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo6 2021-10-08T19:27:54.618 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-10-08T19:27:54.618 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns1:foo4 2021-10-08T19:27:54.619 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns1:foo5 2021-10-08T19:27:54.619 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns2:foo7 2021-10-08T19:27:54.619 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns2:foo6 2021-10-08T19:27:54.620 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns1:foo1 2021-10-08T19:27:54.620 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: :foo1 2021-10-08T19:27:54.620 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: :foo2 2021-10-08T19:27:54.621 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: :foo3 2021-10-08T19:27:54.621 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (61 ms) 2021-10-08T19:27:54.622 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2021-10-08T19:27:54.622 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 1 0 2021-10-08T19:27:54.622 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 10 0 2021-10-08T19:27:54.622 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 13 0 2021-10-08T19:27:54.622 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 7 0 2021-10-08T19:27:54.623 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 14 0 2021-10-08T19:27:54.623 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 0 0 2021-10-08T19:27:54.623 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 15 0 2021-10-08T19:27:54.623 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 11 0 2021-10-08T19:27:54.624 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 5 0 2021-10-08T19:27:54.624 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 8 0 2021-10-08T19:27:54.624 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 6 0 2021-10-08T19:27:54.624 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 3 0 2021-10-08T19:27:54.624 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 4 0 2021-10-08T19:27:54.625 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 12 0 2021-10-08T19:27:54.625 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 9 0 2021-10-08T19:27:54.625 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 2 0 2021-10-08T19:27:54.625 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-10-08T19:27:54.625 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (62 ms) 2021-10-08T19:27:54.626 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2021-10-08T19:27:54.626 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: x cursor=MIN 2021-10-08T19:27:54.626 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=1 cursor=8:02547ec2:::1:head 2021-10-08T19:27:54.627 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=10 cursor=8:52ea6a34:::10:head 2021-10-08T19:27:54.627 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=13 cursor=8:566253c9:::13:head 2021-10-08T19:27:54.627 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=7 cursor=8:5c6b0b28:::7:head 2021-10-08T19:27:54.627 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=14 cursor=8:62a1935d:::14:head 2021-10-08T19:27:54.627 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=0 cursor=8:6cac518f:::0:head 2021-10-08T19:27:54.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=15 cursor=8:863748b0:::15:head 2021-10-08T19:27:54.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=11 cursor=8:89d3ae78:::11:head 2021-10-08T19:27:54.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=5 cursor=8:b29083e3:::5:head 2021-10-08T19:27:54.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=8 cursor=8:bd63b0f1:::8:head 2021-10-08T19:27:54.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=6 cursor=8:c4fdafeb:::6:head 2021-10-08T19:27:54.629 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=3 cursor=8:cfc208b3:::3:head 2021-10-08T19:27:54.629 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=4 cursor=8:d83876eb:::4:head 2021-10-08T19:27:54.629 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=12 cursor=8:de5d7c5f:::12:head 2021-10-08T19:27:54.629 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=9 cursor=8:e960b815:::9:head 2021-10-08T19:27:54.630 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > oid=2 cursor=8:f905c69b:::2:head 2021-10-08T19:27:54.630 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: FIRST> seek to MIN oid=1 2021-10-08T19:27:54.630 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=1 cursor=8:02547ec2:::1:head 2021-10-08T19:27:54.630 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:02547ec2:::1:head 2021-10-08T19:27:54.630 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:02547ec2:::1:head -> 1 2021-10-08T19:27:54.631 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=10 cursor=8:52ea6a34:::10:head 2021-10-08T19:27:54.631 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:52ea6a34:::10:head 2021-10-08T19:27:54.631 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2021-10-08T19:27:54.631 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=13 cursor=8:566253c9:::13:head 2021-10-08T19:27:54.632 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:566253c9:::13:head 2021-10-08T19:27:54.632 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:566253c9:::13:head -> 13 2021-10-08T19:27:54.632 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=7 cursor=8:5c6b0b28:::7:head 2021-10-08T19:27:54.632 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:5c6b0b28:::7:head 2021-10-08T19:27:54.632 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:5c6b0b28:::7:head -> 7 2021-10-08T19:27:54.633 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=14 cursor=8:62a1935d:::14:head 2021-10-08T19:27:54.633 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4263173374' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88890-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.634 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3167916399' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.634 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2700908637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88986-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.634 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2365536819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.634 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1120796350' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.635 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2045750419' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88784-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.635 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/963852364' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.635 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2634514473' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.635 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2199086284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88972-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.636 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/80542488' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.636 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: osdmap e70: 8 total, 8 up, 8 in 2021-10-08T19:27:54.636 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.636 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.636 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:27:54.637 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.637 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.637 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/860395557' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.637 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/534249721' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88536-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:54.638 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: osdmap e71: 8 total, 8 up, 8 in 2021-10-08T19:27:54.638 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:27:54.660 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:62a1935d:::14:head 2021-10-08T19:27:54.661 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:62a1935d:::14:head -> 14 2021-10-08T19:27:54.661 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=0 cursor=8:6cac518f:::0:head 2021-10-08T19:27:54.662 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:6cac518f:::0:head 2021-10-08T19:27:54.662 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:6cac518f:::0:head -> 0 2021-10-08T19:27:54.662 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=15 cursor=8:863748b0:::15:head 2021-10-08T19:27:54.662 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:863748b0:::15:head 2021-10-08T19:27:54.663 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:863748b0:::15:head -> 15 2021-10-08T19:27:54.663 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=11 cursor=8:89d3ae78:::11:head 2021-10-08T19:27:54.663 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:89d3ae78:::11:head 2021-10-08T19:27:54.663 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2021-10-08T19:27:54.663 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=5 cursor=8:b29083e3:::5:head 2021-10-08T19:27:54.664 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:b29083e3:::5:head 2021-10-08T19:27:54.664 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:b29083e3:::5:head -> 5 2021-10-08T19:27:54.664 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=8 cursor=8:bd63b0f1:::8:head 2021-10-08T19:27:54.664 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:bd63b0f1:::8:head 2021-10-08T19:27:54.665 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:bd63b0f1:::8:head -> 8 2021-10-08T19:27:54.665 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=6 cursor=8:c4fdafeb:::6:head 2021-10-08T19:27:54.665 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:c4fdafeb:::6:head 2021-10-08T19:27:54.665 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:c4fdafeb:::6:head -> 6 2021-10-08T19:27:54.665 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=3 cursor=8:cfc208b3:::3:head 2021-10-08T19:27:54.666 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:cfc208b3:::3:head 2021-10-08T19:27:54.666 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:cfc208b3:::3:head -> 3 2021-10-08T19:27:54.666 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=4 cursor=8:d83876eb:::4:head 2021-10-08T19:27:54.666 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:d83876eb:::4:head 2021-10-08T19:27:54.667 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:d83876eb:::4:head -> 4 2021-10-08T19:27:54.667 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=12 cursor=8:de5d7c5f:::12:head 2021-10-08T19:27:54.667 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:de5d7c5f:::12:head 2021-10-08T19:27:54.667 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:de5d7c5f:::12:head -> 12 2021-10-08T19:27:54.667 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=9 cursor=8:e960b815:::9:head 2021-10-08T19:27:54.668 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:e960b815:::9:head 2021-10-08T19:27:54.668 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:e960b815:::9:head -> 9 2021-10-08T19:27:54.668 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : oid=2 cursor=8:f905c69b:::2:head 2021-10-08T19:27:54.668 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:f905c69b:::2:head 2021-10-08T19:27:54.669 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:f905c69b:::2:head -> 2 2021-10-08T19:27:54.669 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:f905c69b:::2:head 2021-10-08T19:27:54.669 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:f905c69b:::2:head expected=8:f905c69b:::2:head 2021-10-08T19:27:54.669 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:f905c69b:::2:head -> 2 2021-10-08T19:27:54.669 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=2 expected=2 2021-10-08T19:27:54.670 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:bd63b0f1:::8:head 2021-10-08T19:27:54.670 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:bd63b0f1:::8:head expected=8:bd63b0f1:::8:head 2021-10-08T19:27:54.670 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:bd63b0f1:::8:head -> 8 2021-10-08T19:27:54.670 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=8 expected=8 2021-10-08T19:27:54.670 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:de5d7c5f:::12:head 2021-10-08T19:27:54.671 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:de5d7c5f:::12:head expected=8:de5d7c5f:::12:head 2021-10-08T19:27:54.671 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:de5d7c5f:::12:head -> 12 2021-10-08T19:27:54.672 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=12 expected=12 2021-10-08T19:27:54.672 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:d83876eb:::4:head 2021-10-08T19:27:54.672 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:d83876eb:::4:head expected=8:d83876eb:::4:head 2021-10-08T19:27:54.672 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:d83876eb:::4:head -> 4 2021-10-08T19:27:54.672 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=4 expected=4 2021-10-08T19:27:54.673 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:cfc208b3:::3:head 2021-10-08T19:27:54.673 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:cfc208b3:::3:head expected=8:cfc208b3:::3:head 2021-10-08T19:27:54.673 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:cfc208b3:::3:head -> 3 2021-10-08T19:27:54.673 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=3 expected=3 2021-10-08T19:27:54.674 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:c4fdafeb:::6:head 2021-10-08T19:27:54.674 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:c4fdafeb:::6:head expected=8:c4fdafeb:::6:head 2021-10-08T19:27:54.674 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:c4fdafeb:::6:head -> 6 2021-10-08T19:27:54.674 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=6 expected=6 2021-10-08T19:27:54.674 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:5c6b0b28:::7:head 2021-10-08T19:27:54.675 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:5c6b0b28:::7:head expected=8:5c6b0b28:::7:head 2021-10-08T19:27:54.675 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:5c6b0b28:::7:head -> 7 2021-10-08T19:27:54.675 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=7 expected=7 2021-10-08T19:27:54.675 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:566253c9:::13:head 2021-10-08T19:27:54.676 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:566253c9:::13:head expected=8:566253c9:::13:head 2021-10-08T19:27:54.676 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:566253c9:::13:head -> 13 2021-10-08T19:27:54.676 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=13 expected=13 2021-10-08T19:27:54.676 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:b29083e3:::5:head 2021-10-08T19:27:55.506 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : api_asio: [==========] Running 12 tests from 1 test suite. 2021-10-08T19:27:55.506 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [----------] Global test environment set-up. 2021-10-08T19:27:55.506 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [----------] 12 tests from AsioRados 2021-10-08T19:27:55.507 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2021-10-08T19:27:55.507 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (2 ms) 2021-10-08T19:27:55.508 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2021-10-08T19:27:55.508 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (1 ms) 2021-10-08T19:27:55.508 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2021-10-08T19:27:55.509 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (1 ms) 2021-10-08T19:27:55.509 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2021-10-08T19:27:55.509 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (2 ms) 2021-10-08T19:27:55.510 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2021-10-08T19:27:55.510 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (2 ms) 2021-10-08T19:27:55.510 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2021-10-08T19:27:55.511 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (2 ms) 2021-10-08T19:27:55.511 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2021-10-08T19:27:55.511 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2021-10-08T19:27:55.511 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2021-10-08T19:27:55.512 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2021-10-08T19:27:55.512 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2021-10-08T19:27:55.512 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2021-10-08T19:27:55.512 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2021-10-08T19:27:55.513 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (6 ms) 2021-10-08T19:27:55.513 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2021-10-08T19:27:55.513 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (7 ms) 2021-10-08T19:27:55.513 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2021-10-08T19:27:55.513 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1 ms) 2021-10-08T19:27:55.514 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [----------] 12 tests from AsioRados (26 ms total) 2021-10-08T19:27:55.514 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: 2021-10-08T19:27:55.514 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [----------] Global test environment tear-down 2021-10-08T19:27:55.515 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (7598 ms total) 2021-10-08T19:27:55.515 INFO:tasks.workunit.client.0.smithi157.stdout: api_asio: [ PASSED ] 12 tests. 2021-10-08T19:27:55.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: pgmap v73: 260 pgs: 128 unknown, 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:27:55.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: pgmap v74: 260 pgs: 88 creating+peering, 132 active+clean, 40 unknown; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:27:55.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: pgmap v77: 836 pgs: 88 creating+peering, 132 active+clean, 616 unknown; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:55.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2740763089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2280538092' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88769-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1883052692' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88795-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88820-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:55.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88986-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88784-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88972-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.585 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88890-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.586 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.586 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.588 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88504-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.588 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88512-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.588 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: osdmap e72: 8 total, 8 up, 8 in 2021-10-08T19:27:55.589 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1764249163' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88845-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.589 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.590 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88536-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.590 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88845-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.590 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/971919413' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:27:55.591 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:55.591 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:27:55.593 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: pgmap v73: 260 pgs: 128 unknown, 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:27:55.593 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: pgmap v74: 260 pgs: 88 creating+peering, 132 active+clean, 40 unknown; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:27:55.593 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: pgmap v77: 836 pgs: 88 creating+peering, 132 active+clean, 616 unknown; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:55.594 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2740763089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.594 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2280538092' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88769-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.595 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1883052692' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88795-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.595 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88820-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:55.595 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88986-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.596 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.599 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88784-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.601 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.601 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.602 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88972-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.604 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88890-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.605 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.605 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.606 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.606 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.607 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.608 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88504-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.608 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88512-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.608 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: osdmap e72: 8 total, 8 up, 8 in 2021-10-08T19:27:55.610 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1764249163' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88845-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.611 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.611 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88536-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.611 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88845-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.611 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/971919413' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:27:55.612 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:55.612 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:27:55.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: pgmap v73: 260 pgs: 128 unknown, 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:27:55.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: pgmap v74: 260 pgs: 88 creating+peering, 132 active+clean, 40 unknown; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:27:55.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: pgmap v77: 836 pgs: 88 creating+peering, 132 active+clean, 616 unknown; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:55.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2740763089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2280538092' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88769-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1883052692' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88795-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88820-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:55.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88986-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88784-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88972-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88890-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88504-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88512-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:55.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: osdmap e72: 8 total, 8 up, 8 in 2021-10-08T19:27:55.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1764249163' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88845-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88536-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88845-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:55.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/971919413' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:27:55.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:55.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:27:56.230 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_1_[89007]: starting. 2021-10-08T19:27:56.230 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_1_[89007]: creating pool ceph_test_rados_list_parallel.smithi157-88994 2021-10-08T19:27:56.230 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_1_[89007]: created object 0... 2021-10-08T19:27:56.231 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_1_[89007]: created object 25... 2021-10-08T19:27:56.231 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_1_[89007]: created object 49... 2021-10-08T19:27:56.231 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_1_[89007]: finishing. 2021-10-08T19:27:56.232 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_1_[89007]: shutting down. 2021-10-08T19:27:56.232 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_2_[89008]: starting. 2021-10-08T19:27:56.232 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_2_[89008]: listing objects. 2021-10-08T19:27:56.232 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_2_[89008]: listed object 0... 2021-10-08T19:27:56.232 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_2_[89008]: listed object 25... 2021-10-08T19:27:56.233 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_2_[89008]: saw 50 objects 2021-10-08T19:27:56.233 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_2_[89008]: shutting down. 2021-10-08T19:27:56.233 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.233 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_3_[89730]: starting. 2021-10-08T19:27:56.234 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_3_[89730]: creating pool ceph_test_rados_list_parallel.smithi157-88994 2021-10-08T19:27:56.234 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_3_[89730]: created object 0... 2021-10-08T19:27:56.234 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_3_[89730]: created object 25... 2021-10-08T19:27:56.235 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_3_[89730]: created object 49... 2021-10-08T19:27:56.235 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_3_[89730]: finishing. 2021-10-08T19:27:56.235 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_3_[89730]: shutting down. 2021-10-08T19:27:56.235 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.236 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_4_[89731]: starting. 2021-10-08T19:27:56.236 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_4_[89731]: listing objects. 2021-10-08T19:27:56.236 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_4_[89731]: listed object 0... 2021-10-08T19:27:56.237 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_4_[89731]: listed object 25... 2021-10-08T19:27:56.237 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_4_[89731]: saw 41 objects 2021-10-08T19:27:56.238 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_4_[89731]: shutting down. 2021-10-08T19:27:56.238 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.238 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_5_[89732]: starting. 2021-10-08T19:27:56.238 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_5_[89732]: removed 25 objects... 2021-10-08T19:27:56.239 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_5_[89732]: removed half of the objects 2021-10-08T19:27:56.239 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_5_[89732]: removed 50 objects... 2021-10-08T19:27:56.239 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_5_[89732]: removed 50 objects 2021-10-08T19:27:56.239 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_5_[89732]: shutting down. 2021-10-08T19:27:56.240 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.240 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.240 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_6_[89778]: starting. 2021-10-08T19:27:56.241 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_6_[89778]: creating pool ceph_test_rados_list_parallel.smithi157-88994 2021-10-08T19:27:56.241 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_6_[89778]: created object 0... 2021-10-08T19:27:56.241 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_6_[89778]: created object 25... 2021-10-08T19:27:56.241 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_6_[89778]: created object 49... 2021-10-08T19:27:56.241 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_6_[89778]: finishing. 2021-10-08T19:27:56.242 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_6_[89778]: shutting down. 2021-10-08T19:27:56.242 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.242 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.242 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_7_[89779]: starting. 2021-10-08T19:27:56.242 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_7_[89779]: listing objects. 2021-10-08T19:27:56.243 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_7_[89779]: listed object 0... 2021-10-08T19:27:56.243 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_7_[89779]: listed object 25... 2021-10-08T19:27:56.243 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_7_[89779]: listed object 50... 2021-10-08T19:27:56.243 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_7_[89779]: saw 56 objects 2021-10-08T19:27:56.244 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_7_[89779]: shutting down. 2021-10-08T19:27:56.244 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.244 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.244 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_8_[89780]: starting. 2021-10-08T19:27:56.244 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_8_[89780]: added 25 objects... 2021-10-08T19:27:56.245 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_8_[89780]: added half of the objects 2021-10-08T19:27:56.245 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_8_[89780]: added 50 objects... 2021-10-08T19:27:56.245 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_8_[89780]: added 50 objects 2021-10-08T19:27:56.245 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_8_[89780]: shutting down. 2021-10-08T19:27:56.245 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.247 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2740763089' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2280538092' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88769-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1883052692' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88795-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88820-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:56.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88986-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88784-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88972-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88890-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88541-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88536-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88845-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2740763089' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2280538092' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88769-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1883052692' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88795-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88820-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:56.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88986-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88784-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88972-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88890-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88541-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88536-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88845-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:27:56.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: osdmap e73: 8 total, 8 up, 8 in 2021-10-08T19:27:56.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:27:56.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:56.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.590 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.591 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.592 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.592 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.592 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.592 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[42114]: pgmap v80: 900 pgs: 45 creating+peering, 132 active+clean, 723 unknown; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:27:56.593 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:27:56.593 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: osdmap e73: 8 total, 8 up, 8 in 2021-10-08T19:27:56.594 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:27:56.594 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:56.594 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.594 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.594 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.595 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.595 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.595 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.595 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.596 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.596 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.596 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.596 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.596 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.597 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:56 smithi157 ceph-mon[32847]: pgmap v80: 900 pgs: 45 creating+peering, 132 active+clean, 723 unknown; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:27:56.597 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ********************** api_c_read_operations: Running main() from gmock_main.cc 2021-10-08T19:27:56.598 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [==========] Running 16 tests from 1 test suite. 2021-10-08T19:27:56.598 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [----------] Global test environment set-up. 2021-10-08T19:27:56.598 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest 2021-10-08T19:27:56.599 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2021-10-08T19:27:56.599 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2021-10-08T19:27:56.599 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2021-10-08T19:27:56.600 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (208 ms) 2021-10-08T19:27:56.600 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2021-10-08T19:27:56.600 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (7 ms) 2021-10-08T19:27:56.600 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2021-10-08T19:27:56.601 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (15 ms) 2021-10-08T19:27:56.601 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2021-10-08T19:27:56.602 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (23 ms) 2021-10-08T19:27:56.602 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2021-10-08T19:27:56.602 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (7 ms) 2021-10-08T19:27:56.602 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2021-10-08T19:27:56.602 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (9 ms) 2021-10-08T19:27:56.603 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2021-10-08T19:27:56.603 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (4 ms) 2021-10-08T19:27:56.603 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2021-10-08T19:27:56.603 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (6 ms) 2021-10-08T19:27:56.603 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2021-10-08T19:27:56.604 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (4 ms) 2021-10-08T19:27:56.604 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2021-10-08T19:27:56.604 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (4 ms) 2021-10-08T19:27:56.604 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2021-10-08T19:27:56.605 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (5 ms) 2021-10-08T19:27:56.605 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2021-10-08T19:27:56.605 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (11 ms) 2021-10-08T19:27:56.605 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2021-10-08T19:27:56.605 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (9 ms) 2021-10-08T19:27:56.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2021-10-08T19:27:56.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (8 ms) 2021-10-08T19:27:56.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2021-10-08T19:27:56.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (3 ms) 2021-10-08T19:27:56.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest (323 ms total) 2021-10-08T19:27:56.607 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: 2021-10-08T19:27:56.607 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [----------] Global test environment tear-down 2021-10-08T19:27:56.607 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [==========] 16 tests from 1 test suite ran. (8590 ms total) 2021-10-08T19:27:56.607 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_read_operations: [ PASSED ] 16 tests. 2021-10-08T19:27:56.608 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2021-10-08T19:27:56.608 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2021-10-08T19:27:56.608 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2021-10-08T19:27:56.609 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2021-10-08T19:27:56.609 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (8563 ms) 2021-10-08T19:27:56.609 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (8563 ms total) 2021-10-08T19:27:56.609 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: 2021-10-08T19:27:56.610 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2021-10-08T19:27:56.610 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (8563 ms total) 2021-10-08T19:27:56.610 INFO:tasks.workunit.client.0.smithi157.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2021-10-08T19:27:56.610 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: Running main() from gmock_main.cc 2021-10-08T19:27:56.610 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2021-10-08T19:27:56.611 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [----------] Global test environment set-up. 2021-10-08T19:27:56.611 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2021-10-08T19:27:56.611 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2021-10-08T19:27:56.612 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (60 ms) 2021-10-08T19:27:56.612 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2021-10-08T19:27:56.612 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (33 ms) 2021-10-08T19:27:56.612 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2021-10-08T19:27:56.613 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (8521 ms) 2021-10-08T19:27:56.613 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (8614 ms total) 2021-10-08T19:27:56.613 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: 2021-10-08T19:27:56.613 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [----------] Global test environment tear-down 2021-10-08T19:27:56.613 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (8614 ms total) 2021-10-08T19:27:56.614 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2021-10-08T19:27:56.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2740763089' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2280538092' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88769-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1883052692' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88795-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88820-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:56.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88986-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88784-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88972-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88890-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88541-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88536-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88845-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:56.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:27:56.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: osdmap e73: 8 total, 8 up, 8 in 2021-10-08T19:27:56.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:27:56.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:56.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:56.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:56.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:56.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:56 smithi196 ceph-mon[34258]: pgmap v80: 900 pgs: 45 creating+peering, 132 active+clean, 723 unknown; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:27:56.861 INFO:tasks.workunit.client.0.smithi157.stdout:********* 2021-10-08T19:27:56.861 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_9_[89826]: starting. 2021-10-08T19:27:56.862 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_9_[89826]: creating pool ceph_test_rados_list_parallel.smithi157-88994 2021-10-08T19:27:56.862 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_9_[89826]: created object 0... 2021-10-08T19:27:56.862 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_9_[89826]: created object 25... 2021-10-08T19:27:56.862 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_9_[89826]: created object 49... 2021-10-08T19:27:56.863 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_9_[89826]: finishing. 2021-10-08T19:27:56.863 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_9_[89826]: shutting down. 2021-10-08T19:27:56.863 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.863 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.864 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.864 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_10_[89827]: starting. 2021-10-08T19:27:56.864 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_10_[89827]: listing objects. 2021-10-08T19:27:56.864 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_10_[89827]: listed object 0... 2021-10-08T19:27:56.864 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_10_[89827]: listed object 25... 2021-10-08T19:27:56.865 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_10_[89827]: listed object 50... 2021-10-08T19:27:56.865 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_10_[89827]: listed object 75... 2021-10-08T19:27:56.865 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_10_[89827]: saw 99 objects 2021-10-08T19:27:56.865 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_10_[89827]: shutting down. 2021-10-08T19:27:56.866 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.866 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.866 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.866 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_13_[89830]: starting. 2021-10-08T19:27:56.867 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_13_[89830]: removed 25 objects... 2021-10-08T19:27:56.867 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_13_[89830]: removed half of the objects 2021-10-08T19:27:56.867 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_13_[89830]: removed 50 objects... 2021-10-08T19:27:56.867 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_13_[89830]: removed 50 objects 2021-10-08T19:27:56.868 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_13_[89830]: shutting down. 2021-10-08T19:27:56.868 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.868 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.868 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.869 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_12_[89829]: starting. 2021-10-08T19:27:56.869 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_12_[89829]: added 25 objects... 2021-10-08T19:27:56.869 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_12_[89829]: added half of the objects 2021-10-08T19:27:56.869 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_12_[89829]: added 50 objects... 2021-10-08T19:27:56.869 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_12_[89829]: added 50 objects 2021-10-08T19:27:56.870 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_12_[89829]: shutting down. 2021-10-08T19:27:56.870 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.870 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.870 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.871 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_11_[89828]: starting. 2021-10-08T19:27:56.871 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_11_[89828]: added 25 objects... 2021-10-08T19:27:56.871 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_11_[89828]: added half of the objects 2021-10-08T19:27:56.871 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_11_[89828]: added 50 objects... 2021-10-08T19:27:56.871 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_11_[89828]: added 50 objects 2021-10-08T19:27:56.872 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_11_[89828]: shutting down. 2021-10-08T19:27:56.872 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.872 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.872 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.872 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.873 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_14_[89929]: starting. 2021-10-08T19:27:56.873 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_14_[89929]: creating pool ceph_test_rados_list_parallel.smithi157-88994 2021-10-08T19:27:56.873 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_14_[89929]: created object 0... 2021-10-08T19:27:56.874 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_14_[89929]: created object 25... 2021-10-08T19:27:56.874 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_14_[89929]: created object 49... 2021-10-08T19:27:56.874 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_14_[89929]: finishing. 2021-10-08T19:27:56.874 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_14_[89929]: shutting down. 2021-10-08T19:27:56.875 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.875 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.875 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.876 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:56.876 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: starting. 2021-10-08T19:27:56.876 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: listing objects. 2021-10-08T19:27:56.876 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: listed object 0... 2021-10-08T19:27:57.116 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:27:56 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:27:57.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:27:57] "GET /metrics HTTP/1.1" 200 157950 "" "Prometheus/2.18.1" 2021-10-08T19:27:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3591405965' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:27:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:57.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: osdmap e74: 8 total, 8 up, 8 in 2021-10-08T19:27:57.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:57.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:57.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:57.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:57.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:57.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:57.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:57.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:57.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:27:57.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:27:57.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:27:57.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:27:57.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:27:57.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:27:57.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:27:57.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3591405965' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:27:57.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:57.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:57.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: osdmap e74: 8 total, 8 up, 8 in 2021-10-08T19:27:57.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:57.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:57.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:57.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:57.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:57.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:57.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:57.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:57.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:27:57.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:27:57.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:27:57.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:27:57.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:27:57.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:27:57.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:27:57.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:27:57.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:27:57.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:27:57.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:57.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:57.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:27:57.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:27:57.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:27:57.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:57.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:57.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3591405965' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:27:57.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:57.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:57.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: osdmap e74: 8 total, 8 up, 8 in 2021-10-08T19:27:57.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:57.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:57.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:57.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:57.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:57.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:57.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:57.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:57.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:27:57.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:27:57.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:27:57.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:27:57.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:27:57.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:27:57.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:27:57.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:27:57.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:27:57.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:27:57.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:57.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:58.144 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: listed object 2 api_cmd: Running main() from gmock_main.cc 2021-10-08T19:27:58.145 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2021-10-08T19:27:58.145 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [----------] Global test environment set-up. 2021-10-08T19:27:58.145 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2021-10-08T19:27:58.145 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2021-10-08T19:27:58.146 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (47 ms) 2021-10-08T19:27:58.146 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2021-10-08T19:27:58.146 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (920 ms) 2021-10-08T19:27:58.146 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2021-10-08T19:27:58.147 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (7661 ms) 2021-10-08T19:27:58.147 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2021-10-08T19:27:58.147 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.574199+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88504-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:58.147 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.574281+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88512-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:27:58.149 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.575219+0000 mon.b [INF] from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:58.149 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.575300+0000 mon.c [INF] from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:58.149 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.578333+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:27:58.149 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.582583+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:27:58.150 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.583315+0000 mon.a [INF] from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:58.150 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.630977+0000 mon.c [INF] from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:58.150 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.636987+0000 mon.b [INF] from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:58.150 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.859581+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:27:58.152 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.860338+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:27:58.153 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.861067+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:27:58.425 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-5... 2021-10-08T19:27:58.425 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: listed object 50... 2021-10-08T19:27:58.426 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: listed object 75... 2021-10-08T19:27:58.426 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: listed object 100... 2021-10-08T19:27:58.426 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: listed object 125... 2021-10-08T19:27:58.427 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: saw 150 objects 2021-10-08T19:27:58.427 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_15_[89930]: shutting down. 2021-10-08T19:27:58.427 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:58.428 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:58.428 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:58.428 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:58.429 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_16_[89931]: starting. 2021-10-08T19:27:58.429 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_16_[89931]: added 25 objects... 2021-10-08T19:27:58.429 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_16_[89931]: added half of the objects 2021-10-08T19:27:58.430 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_16_[89931]: added 50 objects... 2021-10-08T19:27:58.430 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_16_[89931]: added 50 objects 2021-10-08T19:27:58.430 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: process_16_[89931]: shutting down. 2021-10-08T19:27:58.431 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:58.431 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:58.431 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:58.432 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:58.432 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******************************* 2021-10-08T19:27:58.432 INFO:tasks.workunit.client.0.smithi157.stdout: list_parallel: ******* SUCCESS ********** 2021-10-08T19:27:58.499 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:58.499 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:27:58.499 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:27:58.500 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:27:58.500 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:27:58.500 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:27:58.501 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:27:58.501 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:27:58.501 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:27:58.501 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:27:58.501 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:27:58.502 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: 10.6 deep-scrub ok 2021-10-08T19:27:58.502 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: onexx 2021-10-08T19:27:58.502 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:58.502 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:27:58.503 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:58.503 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/439412234' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:58.503 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:58.503 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3136403258' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:58.503 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: osdmap e75: 8 total, 8 up, 8 in 2021-10-08T19:27:58.504 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:58.504 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:58.504 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:58.505 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:27:58.505 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:27:58.505 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:27:58.505 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:27:58.505 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:27:58.506 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:27:58.506 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:27:58.506 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:27:58.506 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:27:58.507 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:27:58.507 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: 10.6 deep-scrub ok 2021-10-08T19:27:58.507 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: onexx 2021-10-08T19:27:58.507 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:58.508 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:27:58.508 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:58.508 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/439412234' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:58.508 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:58.508 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3136403258' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:58.509 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: osdmap e75: 8 total, 8 up, 8 in 2021-10-08T19:27:58.510 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:58.510 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:58.867 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:27:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:27:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:58.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:27:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:27:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:27:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:27:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:27:58.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:27:58.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:27:58.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:27:58.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:27:58.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:27:58.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: 10.6 deep-scrub ok 2021-10-08T19:27:58.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: onexx 2021-10-08T19:27:58.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:58.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:27:58.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:27:58.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/439412234' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:58.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:58.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3136403258' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:58.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: osdmap e75: 8 total, 8 up, 8 in 2021-10-08T19:27:58.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:58.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:27:59.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:27:58 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:27:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:59.475 INFO:tasks.workunit.client.0.smithi157.stdout: pending message(s) 2021-10-08T19:27:59.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04c620 msgr2=0x5555fd04c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:59.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04c620 0x5555fd04c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:59.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd072bc0 msgr2=0x5555fd074fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:27:59.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd072bc0 0x5555fd074fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:59.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aea0 msgr2=0x5555fd04c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:27:59.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.916+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aea0 0x5555fd04c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:59.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.918+0000 7f8ec8283540 10 monclient: shutdown 2021-10-08T19:27:59.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.918+0000 7f8ec8283540 20 monclient: shutdown discarding 0 pending message(s) 2021-10-08T19:27:59.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.918+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 shutdown_connections 2021-10-08T19:27:59.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.918+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fd072bc0 0x5555fd074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:59.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.918+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5555fd04c620 0x5555fd04c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:59.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.918+0000 7f8ec8283540 1 --2- 172.21.15.157:0/1919344001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5555fd04aea0 0x5555fd04c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:59.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.918+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 >> 172.21.15.157:0/1919344001 conn(0x5555fd046220 msgr2=0x5555fd048630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:59.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.918+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 shutdown_connections 2021-10-08T19:27:59.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.919+0000 7f8ec8283540 1 -- 172.21.15.157:0/1919344001 wait complete. 2021-10-08T19:27:59.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.919+0000 7f8ec8283540 10 monclient: shutdown 2021-10-08T19:27:59.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:47.919+0000 7f8ec8283540 20 monclient: shutdown discarding 0 pending message(s) 2021-10-08T19:27:59.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (50 ms) 2021-10-08T19:27:59.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure (50 ms total) 2021-10-08T19:27:59.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:27:59.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2021-10-08T19:27:59.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2021-10-08T19:27:59.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: started 0x5555fcebe5d0 2021-10-08T19:27:59.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: started 0x5555fcf9ddc0 2021-10-08T19:27:59.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: started 2 aios 2021-10-08T19:27:59.482 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: waiting 0x5555fcebe5d0 2021-10-08T19:27:59.482 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: waiting 0x5555fcf9ddc0 2021-10-08T19:27:59.482 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: done. 2021-10-08T19:27:59.578 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: Running main() from gmock_main.cc 2021-10-08T19:27:59.578 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2021-10-08T19:27:59.578 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [----------] Global test environment set-up. 2021-10-08T19:27:59.579 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2021-10-08T19:27:59.579 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: seed 88512 2021-10-08T19:27:59.579 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2021-10-08T19:27:59.579 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2021-10-08T19:27:59.579 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2021-10-08T19:27:59.580 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (122 ms) 2021-10-08T19:27:59.580 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2021-10-08T19:27:59.580 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (8 ms) 2021-10-08T19:27:59.580 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2021-10-08T19:27:59.581 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (2 ms) 2021-10-08T19:27:59.581 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2021-10-08T19:27:59.581 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (5 ms) 2021-10-08T19:27:59.581 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2021-10-08T19:27:59.581 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (1 ms) 2021-10-08T19:27:59.582 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2021-10-08T19:27:59.582 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (3 ms) 2021-10-08T19:27:59.582 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2021-10-08T19:27:59.582 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (2 ms) 2021-10-08T19:27:59.583 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2021-10-08T19:27:59.583 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (3 ms) 2021-10-08T19:27:59.583 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2021-10-08T19:27:59.583 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (2 ms) 2021-10-08T19:27:59.584 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2021-10-08T19:27:59.584 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (2 ms) 2021-10-08T19:27:59.584 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2021-10-08T19:27:59.584 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (6 ms) 2021-10-08T19:27:59.585 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2021-10-08T19:27:59.585 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (2 ms) 2021-10-08T19:27:59.585 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2021-10-08T19:27:59.585 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (2 ms) 2021-10-08T19:27:59.585 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2021-10-08T19:27:59.586 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (3 ms) 2021-10-08T19:27:59.586 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2021-10-08T19:27:59.586 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (9 ms) 2021-10-08T19:27:59.586 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2021-10-08T19:27:59.587 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (4 ms) 2021-10-08T19:27:59.587 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2021-10-08T19:27:59.587 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (3 ms) 2021-10-08T19:27:59.587 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2021-10-08T19:27:59.587 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (2 ms) 2021-10-08T19:27:59.588 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2021-10-08T19:27:59.588 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (2 ms) 2021-10-08T19:27:59.588 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (183 ms total) 2021-10-08T19:27:59.588 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: 2021-10-08T19:27:59.589 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2021-10-08T19:27:59.589 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2021-10-08T19:27:59.589 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1127 ms) 2021-10-08T19:27:59.589 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2021-10-08T19:27:59.590 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (15 ms) 2021-10-08T19:27:59.590 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2021-10-08T19:27:59.590 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (3 ms) 2021-10-08T19:27:59.590 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2021-10-08T19:27:59.590 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (3 ms) 2021-10-08T19:27:59.591 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2021-10-08T19:27:59.591 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (3 ms) 2021-10-08T19:27:59.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: pgmap v83: 620 pgs: 32 creating+peering, 484 active+clean, 104 unknown; 97 MiB data, 183 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 665 op/s 2021-10-08T19:27:59.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: 10.0 deep-scrub ok 2021-10-08T19:27:59.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: 10.4 deep-scrub ok 2021-10-08T19:27:59.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: 10.5 deep-scrub ok 2021-10-08T19:27:59.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:27:59.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: 10.9 deep-scrub ok 2021-10-08T19:27:59.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-10-08T19:27:59.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: twoxx 2021-10-08T19:27:59.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-10-08T19:27:59.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:27:59.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:27:59.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/403868420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: osdmap e76: 8 total, 8 up, 8 in 2021-10-08T19:27:59.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:59.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:59.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:59.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: pgmap v83: 620 pgs: 32 creating+peering, 484 active+clean, 104 unknown; 97 MiB data, 183 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 665 op/s 2021-10-08T19:27:59.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: 10.0 deep-scrub ok 2021-10-08T19:27:59.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: 10.4 deep-scrub ok 2021-10-08T19:27:59.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: 10.5 deep-scrub ok 2021-10-08T19:27:59.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:27:59.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: 10.9 deep-scrub ok 2021-10-08T19:27:59.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-10-08T19:27:59.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: twoxx 2021-10-08T19:27:59.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-10-08T19:27:59.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:27:59.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:27:59.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/403868420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: osdmap e76: 8 total, 8 up, 8 in 2021-10-08T19:27:59.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:59.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:59.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:27:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:27:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: pgmap v83: 620 pgs: 32 creating+peering, 484 active+clean, 104 unknown; 97 MiB data, 183 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 665 op/s 2021-10-08T19:27:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: 10.0 deep-scrub ok 2021-10-08T19:27:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: 10.4 deep-scrub ok 2021-10-08T19:27:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: 10.5 deep-scrub ok 2021-10-08T19:27:59.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:27:59.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: 10.9 deep-scrub ok 2021-10-08T19:27:59.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-10-08T19:27:59.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: twoxx 2021-10-08T19:27:59.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-10-08T19:27:59.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88504-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:27:59.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88512-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:27:59.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/403868420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: osdmap e76: 8 total, 8 up, 8 in 2021-10-08T19:27:59.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:27:59.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:27:59.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:27:59.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:27:59.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:27:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:00.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:00.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:27:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:00.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-10-08T19:28:00.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:00.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:00.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:00.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: osdmap e77: 8 total, 8 up, 8 in 2021-10-08T19:28:00.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:00.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:00.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: pgmap v86: 636 pgs: 32 creating+peering, 356 active+clean, 248 unknown; 97 MiB data, 183 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 544 op/s 2021-10-08T19:28:00.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:00.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:00.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:00.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:00.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:00.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:27:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:00.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-10-08T19:28:00.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:00.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:00.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:00.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: osdmap e77: 8 total, 8 up, 8 in 2021-10-08T19:28:00.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:00.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:00.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: pgmap v86: 636 pgs: 32 creating+peering, 356 active+clean, 248 unknown; 97 MiB data, 183 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 544 op/s 2021-10-08T19:28:00.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:00.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:00.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:00.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:00.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:00.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88541-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:00.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:00.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:00.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:00.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:00.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88541-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:00.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:00.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:00.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:27:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-10-08T19:28:00.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:00.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:00.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:00.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:00.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: osdmap e77: 8 total, 8 up, 8 in 2021-10-08T19:28:00.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:00.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:00.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: pgmap v86: 636 pgs: 32 creating+peering, 356 active+clean, 248 unknown; 97 MiB data, 183 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 24 MiB/s wr, 544 op/s 2021-10-08T19:28:00.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:00.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:00.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:00.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:00.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:00.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88541-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:00.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:00.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:00.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:00.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:00.952 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] L delete_pools_parallel: process_1_[89121]: starting. 2021-10-08T19:28:00.952 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_1_[89121]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-89086 2021-10-08T19:28:00.952 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_1_[89121]: created object 0... 2021-10-08T19:28:00.953 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_1_[89121]: created object 25... 2021-10-08T19:28:00.953 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_1_[89121]: created object 49... 2021-10-08T19:28:00.953 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_1_[89121]: finishing. 2021-10-08T19:28:00.953 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_1_[89121]: shutting down. 2021-10-08T19:28:00.954 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_2_[89122]: starting. 2021-10-08T19:28:00.955 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_2_[89122]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-89086 2021-10-08T19:28:00.955 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_2_[89122]: shutting down. 2021-10-08T19:28:00.955 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:00.956 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_3_[89980]: starting. 2021-10-08T19:28:00.956 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_3_[89980]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-89086 2021-10-08T19:28:00.956 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_3_[89980]: created object 0... 2021-10-08T19:28:00.956 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_3_[89980]: created object 25... 2021-10-08T19:28:00.956 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_3_[89980]: created object 49... 2021-10-08T19:28:00.957 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_3_[89980]: finishing. 2021-10-08T19:28:00.957 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_3_[89980]: shutting down. 2021-10-08T19:28:00.957 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:00.958 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_5_[89982]: starting. 2021-10-08T19:28:00.958 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_5_[89982]: listing objects. 2021-10-08T19:28:00.958 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_5_[89982]: listed object 0... 2021-10-08T19:28:00.958 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_5_[89982]: listed object 25... 2021-10-08T19:28:00.959 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_5_[89982]: saw 50 objects 2021-10-08T19:28:00.959 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_5_[89982]: shutting down. 2021-10-08T19:28:00.959 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:00.959 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_4_[89981]: starting. 2021-10-08T19:28:00.959 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_4_[89981]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-89086 2021-10-08T19:28:00.960 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: process_4_[89981]: shutting down. 2021-10-08T19:28:00.960 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:00.960 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:00.960 INFO:tasks.workunit.client.0.smithi157.stdout: delete_pools_parallel: ******* SUCCESS ********** 2021-10-08T19:28:01.686 INFO:tasks.workunit.client.0.smithi157.stdout:08T19:27:56.861609+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:28:01.687 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.862159+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:28:01.687 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.862632+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:28:01.687 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.863057+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:28:01.688 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.863521+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:28:01.688 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.864053+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:28:01.688 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.864559+0000 mon.b [INF] from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:28:01.688 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.895707+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:01.689 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:56.896361+0000 mon.c [INF] from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:01.689 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:57.136244+0000 client.admin [INF] onexx 2021-10-08T19:28:01.689 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:57.371443+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:01.689 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:57.382110+0000 mon.a [INF] from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:28:01.690 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:57.884770+0000 mon.a [INF] from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:01.690 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:57.885694+0000 mon.c [INF] from='client.? 172.21.15.157:0/439412234' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:01.690 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:57.885825+0000 mon.b [INF] from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:01.690 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:57.886080+0000 mon.b [INF] from='client.? 172.21.15.157:0/3136403258' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:01.691 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:58.140630+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:01.691 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:58.937195+0000 mgr.y [INF] Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:01.691 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:58.937636+0000 mgr.y [INF] 172.21.15.196 - - [08/Oct/2021:19:27:58] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:01.691 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.407084+0000 mon.a [INF] from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-10-08T19:28:01.691 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.409956+0000 mon.a [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:01.692 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.415677+0000 mon.a [INF] from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:01.692 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.416043+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:01.692 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.416155+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88784-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:01.692 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.416235+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:01.692 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.416352+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:01.693 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.416495+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88769-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:01.693 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.420413+0000 mon.b [INF] from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:01.693 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.431804+0000 mon.c [INF] from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:01.693 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.731877+0000 mon.a [INF] from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:01.694 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.735445+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:01.694 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.736427+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:01.694 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.738914+0000 mon.a [INF] from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:01.953 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.740577+0000 mon.b [INF] from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", open_pools_parallel: process_1_[89105]: starting. 2021-10-08T19:28:01.953 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_1_[89105]: creating pool ceph_test_rados_open_pools_parallel.smithi157-89023 2021-10-08T19:28:01.953 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_1_[89105]: created object 0... 2021-10-08T19:28:01.954 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_1_[89105]: created object 25... 2021-10-08T19:28:01.954 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_1_[89105]: created object 49... 2021-10-08T19:28:01.954 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_1_[89105]: finishing. 2021-10-08T19:28:01.954 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_1_[89105]: shutting down. 2021-10-08T19:28:01.955 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_2_[89106]: starting. 2021-10-08T19:28:01.955 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_2_[89106]: rados_pool_create. 2021-10-08T19:28:01.955 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_2_[89106]: rados_ioctx_create. 2021-10-08T19:28:01.955 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_2_[89106]: shutting down. 2021-10-08T19:28:01.956 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: ******************************* 2021-10-08T19:28:01.956 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_3_[89977]: starting. 2021-10-08T19:28:01.956 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_3_[89977]: creating pool ceph_test_rados_open_pools_parallel.smithi157-89023 2021-10-08T19:28:01.956 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_3_[89977]: created object 0... 2021-10-08T19:28:01.956 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_3_[89977]: created object 25... 2021-10-08T19:28:01.957 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_3_[89977]: created object 49... 2021-10-08T19:28:01.957 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_3_[89977]: finishing. 2021-10-08T19:28:01.957 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_3_[89977]: shutting down. 2021-10-08T19:28:01.957 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: ******************************* 2021-10-08T19:28:01.958 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_4_[89978]: starting. 2021-10-08T19:28:01.958 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_4_[89978]: rados_pool_create. 2021-10-08T19:28:01.958 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_4_[89978]: rados_ioctx_create. 2021-10-08T19:28:01.958 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: process_4_[89978]: shutting down. 2021-10-08T19:28:01.958 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: ******************************* 2021-10-08T19:28:01.959 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: ******************************* 2021-10-08T19:28:01.959 INFO:tasks.workunit.client.0.smithi157.stdout: open_pools_parallel: ******* SUCCESS ********** 2021-10-08T19:28:02.201 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.201 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.989965+0000 mon.a [INF] from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:02.201 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.990552+0000 mon.a [INF] from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88541-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:02.202 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:27:59.999932+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.202 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.000507+0000 mon.b [INF] from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.202 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.000729+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.202 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.001248+0000 mon.b [INF] from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:02.203 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.001478+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:02.203 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.417933+0000 mon.a [INF] from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:02.203 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.934896+0000 mon.a [INF] from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88541-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:02.203 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.935157+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:02.204 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.936143+0000 mon.b [INF] from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.204 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.936383+0000 mon.b [INF] from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:02.204 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.936773+0000 mon.c [INF] from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.204 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.936975+0000 mon.c [INF] from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:02.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: 10.7 deep-scrub ok 2021-10-08T19:28:02.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: 10.8 deep-scrub ok 2021-10-08T19:28:02.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:02.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: 10.2 deep-scrub ok 2021-10-08T19:28:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88541-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: osdmap e78: 8 total, 8 up, 8 in 2021-10-08T19:28:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:02.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:02.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88541-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:02.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:02.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:02.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:28:02.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:02.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: 10.7 deep-scrub ok 2021-10-08T19:28:02.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: 10.8 deep-scrub ok 2021-10-08T19:28:02.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:02.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: 10.2 deep-scrub ok 2021-10-08T19:28:02.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88541-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:02.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:02.585 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: osdmap e78: 8 total, 8 up, 8 in 2021-10-08T19:28:02.585 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.586 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:02.586 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:02.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88541-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:02.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.588 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:02.588 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:02.588 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:28:02.589 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.589 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:02.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: 10.7 deep-scrub ok 2021-10-08T19:28:02.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: 10.8 deep-scrub ok 2021-10-08T19:28:02.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:02.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: 10.2 deep-scrub ok 2021-10-08T19:28:02.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88541-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:02.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88536-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:02.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: osdmap e78: 8 total, 8 up, 8 in 2021-10-08T19:28:02.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:02.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:02.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88541-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:02.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:02.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:02.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:02.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:28:02.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:02.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:02.716 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.937530+0000 mon.a [INF] from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd pool api_io: Running main() from gmock_main.cc 2021-10-08T19:28:02.717 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2021-10-08T19:28:02.717 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [----------] Global test environment set-up. 2021-10-08T19:28:02.717 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [----------] 14 tests from LibRadosIo 2021-10-08T19:28:02.718 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2021-10-08T19:28:02.719 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (113 ms) 2021-10-08T19:28:02.719 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2021-10-08T19:28:02.719 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2021-10-08T19:28:02.719 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2021-10-08T19:28:02.720 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: no timeout :/ 2021-10-08T19:28:02.720 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: no timeout :/ 2021-10-08T19:28:02.720 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: no timeout :/ 2021-10-08T19:28:02.720 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: no timeout :/ 2021-10-08T19:28:02.720 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: no timeout :/ 2021-10-08T19:28:02.721 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (26 ms) 2021-10-08T19:28:02.721 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2021-10-08T19:28:02.721 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (7 ms) 2021-10-08T19:28:02.721 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2021-10-08T19:28:02.722 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.Checksum (4 ms) 2021-10-08T19:28:02.722 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2021-10-08T19:28:02.722 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (5 ms) 2021-10-08T19:28:02.722 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2021-10-08T19:28:02.723 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (2 ms) 2021-10-08T19:28:02.723 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2021-10-08T19:28:02.723 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (3 ms) 2021-10-08T19:28:02.723 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2021-10-08T19:28:02.723 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (1 ms) 2021-10-08T19:28:02.724 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2021-10-08T19:28:02.724 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.TruncTest (3 ms) 2021-10-08T19:28:02.724 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2021-10-08T19:28:02.724 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (3 ms) 2021-10-08T19:28:02.725 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2021-10-08T19:28:02.725 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (3 ms) 2021-10-08T19:28:02.725 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2021-10-08T19:28:02.725 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.RmXattr (8 ms) 2021-10-08T19:28:02.725 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2021-10-08T19:28:02.726 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIo.XattrIter (3 ms) 2021-10-08T19:28:02.726 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [----------] 14 tests from LibRadosIo (181 ms total) 2021-10-08T19:28:02.726 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: 2021-10-08T19:28:02.726 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2021-10-08T19:28:02.727 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2021-10-08T19:28:02.727 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1136 ms) 2021-10-08T19:28:02.727 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2021-10-08T19:28:02.727 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (6 ms) 2021-10-08T19:28:02.727 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2021-10-08T19:28:02.728 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (6 ms) 2021-10-08T19:28:02.728 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2021-10-08T19:28:02.728 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (4 ms) 2021-10-08T19:28:02.728 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2021-10-08T19:28:02.729 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (7 ms) 2021-10-08T19:28:02.729 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2021-10-08T19:28:02.729 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (4 ms) 2021-10-08T19:28:02.729 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2021-10-08T19:28:02.729 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (2 ms) 2021-10-08T19:28:02.730 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2021-10-08T19:28:02.730 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (4 ms) 2021-10-08T19:28:02.730 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2021-10-08T19:28:02.730 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (11 ms) 2021-10-08T19:28:02.731 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2021-10-08T19:28:02.731 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (5 ms) 2021-10-08T19:28:02.731 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1185 ms total) 2021-10-08T19:28:02.731 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: 2021-10-08T19:28:02.731 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [----------] Global test environment tear-down 2021-10-08T19:28:02.732 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [==========] 24 tests from 2 test suites ran. (14857 ms total) 2021-10-08T19:28:02.732 INFO:tasks.workunit.client.0.smithi157.stdout: api_io: [ PASSED ] 24 tests. 2021-10-08T19:28:02.733 INFO:tasks.workunit.client.0.smithi157.stdout:ibRadosIoECPP.OverlappingWriteRoundTripPP 2021-10-08T19:28:02.733 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (4 ms) 2021-10-08T19:28:02.733 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2021-10-08T19:28:02.733 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (4 ms) 2021-10-08T19:28:02.734 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2021-10-08T19:28:02.734 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (3 ms) 2021-10-08T19:28:02.734 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2021-10-08T19:28:02.734 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (4 ms) 2021-10-08T19:28:02.734 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2021-10-08T19:28:02.735 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (5 ms) 2021-10-08T19:28:02.735 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2021-10-08T19:28:02.735 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (4 ms) 2021-10-08T19:28:02.735 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2021-10-08T19:28:02.736 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2021-10-08T19:28:02.736 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2021-10-08T19:28:02.736 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (10 ms) 2021-10-08T19:28:02.736 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2021-10-08T19:28:02.736 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (4 ms) 2021-10-08T19:28:02.737 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2021-10-08T19:28:02.737 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (4 ms) 2021-10-08T19:28:02.737 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2021-10-08T19:28:02.737 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (4 ms) 2021-10-08T19:28:02.738 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2021-10-08T19:28:02.738 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (4 ms) 2021-10-08T19:28:02.738 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1204 ms total) 2021-10-08T19:28:02.738 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: 2021-10-08T19:28:02.739 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [----------] Global test environment tear-down 2021-10-08T19:28:02.739 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (14869 ms total) 2021-10-08T19:28:02.739 INFO:tasks.workunit.client.0.smithi157.stdout: api_io_pp: [ PASSED ] 37 tests. 2021-10-08T19:28:03.201 INFO:tasks.workunit.client.0.smithi157.stdout: create", "pool": "test-rados-api-smithi157-88541-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:03.202 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.939307+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.202 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.940199+0000 mon.a [INF] from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.202 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.940416+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:03.203 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.941200+0000 mon.a [INF] from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:03.203 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.945621+0000 mon.a [INF] from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:28:03.204 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.948884+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:03.204 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:00.949345+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:03.204 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.407984+0000 client.admin [INF] threexx 2021-10-08T19:28:03.204 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.688282+0000 mon.a [INF] from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:28:03.205 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.692309+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:03.205 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.692408+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:03.205 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.950024+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.205 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.950132+0000 mon.a [INF] from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.206 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.950220+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:28:03.206 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.950294+0000 mon.a [INF] from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:03.206 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.950386+0000 mon.a [INF] from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:28:03.206 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.950983+0000 mon.c [INF] from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:03.207 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:01.960500+0000 mon.c [INF] from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.207 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.189193+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:28:03.207 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.190029+0000 mon.b [INF] from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:03.207 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.190292+0000 mon.c [INF] from='client.? 172.21.15.157:0/1142494637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.208 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.190409+0000 mon.b [INF] from='client.? 172.21.15.157:0/557339086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.208 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.191107+0000 mon.c [INF] from='client.? 172.21.15.157:0/1944532106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.208 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.192331+0000 mon.a [INF] from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:28:03.208 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.192594+0000 mon.a [INF] from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-4", "overlaypool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:03.208 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.197470+0000 mon.a [INF] from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi157-88496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-10-08T19:28:03.209 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.197705+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:03.209 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.198103+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.209 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.206589+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.209 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.207142+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.210 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.210755+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:03.210 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.210980+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.210 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.694620+0000 mon.a [INF] from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88541-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:03.210 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.694708+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:03.217 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.694791+0000 mon.a [INF] from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:28:03.217 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.694849+0000 mon.a [INF] from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-4", "overlaypool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:03.218 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.694992+0000 mon.a [INF] from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi157-88496-3", "field": "max_bytes", "val": "4096"}]': finished 2021-10-08T19:28:03.218 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.695040+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:28:03.218 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.695095+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.219 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.695187+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.219 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.695276+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.220 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.695337+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:28:03.220 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.695394+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.221 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.698852+0000 mon.a [INF] from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:28:03.221 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.705157+0000 mon.c [INF] from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2"}]: dispatch 2021-10-08T19:28:03.221 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.707113+0000 mon.c [INF] from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: threexx 2021-10-08T19:28:03.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: pgmap v88: 548 pgs: 64 creating+peering, 484 active+clean; 145 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:03.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:03.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:28:03.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:03.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:03.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:28:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:28:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-10-08T19:28:03.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:28:03.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: osdmap e79: 8 total, 8 up, 8 in 2021-10-08T19:28:03.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:03.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1142494637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/557339086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: threexx 2021-10-08T19:28:03.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: pgmap v88: 548 pgs: 64 creating+peering, 484 active+clean; 145 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:03.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:03.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:28:03.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:03.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:03.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:28:03.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:03.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:28:03.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:03.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-10-08T19:28:03.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:28:03.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: osdmap e79: 8 total, 8 up, 8 in 2021-10-08T19:28:03.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:03.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1142494637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/557339086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.338 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1944532106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.338 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:28:03.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-4", "overlaypool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:03.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi157-88496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-10-08T19:28:03.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:03.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.340 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.340 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.340 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:03.340 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.340 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: 10.3 deep-scrub ok 2021-10-08T19:28:03.341 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:03.341 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88541-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:03.341 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:03.341 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:28:03.341 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-4", "overlaypool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:03.342 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi157-88496-3", "field": "max_bytes", "val": "4096"}]': finished 2021-10-08T19:28:03.342 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:28:03.342 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.342 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.343 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.343 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:28:03.343 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.343 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: osdmap e80: 8 total, 8 up, 8 in 2021-10-08T19:28:03.344 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:28:03.344 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2"}]: dispatch 2021-10-08T19:28:03.344 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.344 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.345 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1944532106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.345 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:28:03.345 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-4", "overlaypool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:03.345 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi157-88496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-10-08T19:28:03.346 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:03.346 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.346 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.346 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.347 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:03.347 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.347 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: 10.3 deep-scrub ok 2021-10-08T19:28:03.347 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:03.348 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88541-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:03.348 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:03.348 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:28:03.348 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-4", "overlaypool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:03.349 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi157-88496-3", "field": "max_bytes", "val": "4096"}]': finished 2021-10-08T19:28:03.349 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:28:03.349 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.349 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.349 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.350 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:28:03.350 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.350 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: osdmap e80: 8 total, 8 up, 8 in 2021-10-08T19:28:03.350 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:28:03.351 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2"}]: dispatch 2021-10-08T19:28:03.351 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.351 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: threexx 2021-10-08T19:28:03.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: pgmap v88: 548 pgs: 64 creating+peering, 484 active+clean; 145 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:03.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:03.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:28:03.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88784-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:03.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88769-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:03.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:28:03.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:03.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:28:03.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2210435800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:03.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-10-08T19:28:03.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: osdmap e79: 8 total, 8 up, 8 in 2021-10-08T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3652406732' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1142494637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/557339086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1944532106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]: dispatch 2021-10-08T19:28:03.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-4", "overlaypool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:03.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi157-88496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-10-08T19:28:03.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]: dispatch 2021-10-08T19:28:03.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]: dispatch 2021-10-08T19:28:03.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: 10.3 deep-scrub ok 2021-10-08T19:28:03.624 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:03.625 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88541-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:03.625 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88536-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:03.625 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2953473020' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88820-1"}]': finished 2021-10-08T19:28:03.625 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-4", "overlaypool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:03.625 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4271396828' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi157-88496-3", "field": "max_bytes", "val": "4096"}]': finished 2021-10-08T19:28:03.626 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88504-16"}]': finished 2021-10-08T19:28:03.626 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.626 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.626 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.627 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88512-22"}]': finished 2021-10-08T19:28:03.627 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:03.627 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: osdmap e80: 8 total, 8 up, 8 in 2021-10-08T19:28:03.627 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:28:03.628 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2"}]: dispatch 2021-10-08T19:28:03.628 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.628 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:03.782 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:03.504Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:03.783 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:03.504Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:03.783 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:03.504Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:28:04.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-10-08T19:28:04.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: fourxx 2021-10-08T19:28:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-10-08T19:28:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-4-cache", "mode": "writeback"}]': finished 2021-10-08T19:28:04.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:04.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: osdmap e81: 8 total, 8 up, 8 in 2021-10-08T19:28:04.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88820-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:04.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-10-08T19:28:04.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:04.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:28:04.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:04.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:28:04.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:04.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:04.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-10-08T19:28:04.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: fourxx 2021-10-08T19:28:04.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-10-08T19:28:04.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:04.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:04.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-4-cache", "mode": "writeback"}]': finished 2021-10-08T19:28:04.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:04.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: osdmap e81: 8 total, 8 up, 8 in 2021-10-08T19:28:04.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88820-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:04.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-10-08T19:28:04.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:04.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:28:04.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:04.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:28:04.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:04.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:04.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-10-08T19:28:04.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: fourxx 2021-10-08T19:28:04.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-10-08T19:28:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-4-cache", "mode": "writeback"}]': finished 2021-10-08T19:28:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:04.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: osdmap e81: 8 total, 8 up, 8 in 2021-10-08T19:28:04.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88820-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:04.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-10-08T19:28:04.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:04.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:28:04.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:04.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:28:04.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:04.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:05.044 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: got: 2021-10-08T19:28:02.709491+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix" api_stat: Running main() from gmock_main.cc 2021-10-08T19:28:05.044 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [==========] Running 8 tests from 2 test suites. 2021-10-08T19:28:05.044 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [----------] Global test environment set-up. 2021-10-08T19:28:05.045 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [----------] 4 tests from LibRadosStat 2021-10-08T19:28:05.045 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2021-10-08T19:28:05.045 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ OK ] LibRadosStat.Stat (213 ms) 2021-10-08T19:28:05.045 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2021-10-08T19:28:05.045 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ OK ] LibRadosStat.StatNS (17 ms) 2021-10-08T19:28:05.046 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2021-10-08T19:28:05.046 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2021-10-08T19:28:05.046 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2021-10-08T19:28:05.046 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (5 ms) 2021-10-08T19:28:05.047 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [----------] 4 tests from LibRadosStat (235 ms total) 2021-10-08T19:28:05.047 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: 2021-10-08T19:28:05.047 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2021-10-08T19:28:05.047 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2021-10-08T19:28:05.047 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1075 ms) 2021-10-08T19:28:05.048 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2021-10-08T19:28:05.049 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (7 ms) 2021-10-08T19:28:05.049 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2021-10-08T19:28:05.049 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2021-10-08T19:28:05.050 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2021-10-08T19:28:05.050 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (2 ms) 2021-10-08T19:28:05.051 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1084 ms total) 2021-10-08T19:28:05.051 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: 2021-10-08T19:28:05.051 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [----------] Global test environment tear-down 2021-10-08T19:28:05.051 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [==========] 8 tests from 2 test suites ran. (17105 ms total) 2021-10-08T19:28:05.052 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat: [ PASSED ] 8 tests. 2021-10-08T19:28:05.065 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: Running main() from gmock_main.cc 2021-10-08T19:28:05.065 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2021-10-08T19:28:05.065 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [----------] Global test environment set-up. 2021-10-08T19:28:05.065 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2021-10-08T19:28:05.066 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: seed 88784 2021-10-08T19:28:05.066 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2021-10-08T19:28:05.066 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (215 ms) 2021-10-08T19:28:05.066 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2021-10-08T19:28:05.067 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (6 ms) 2021-10-08T19:28:05.067 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2021-10-08T19:28:05.067 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2021-10-08T19:28:05.068 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2021-10-08T19:28:05.068 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (3 ms) 2021-10-08T19:28:05.068 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2021-10-08T19:28:05.068 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (16 ms) 2021-10-08T19:28:05.068 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (240 ms total) 2021-10-08T19:28:05.069 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: 2021-10-08T19:28:05.069 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2021-10-08T19:28:05.069 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2021-10-08T19:28:05.069 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1053 ms) 2021-10-08T19:28:05.070 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2021-10-08T19:28:05.070 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2021-10-08T19:28:05.070 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2021-10-08T19:28:05.070 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (3 ms) 2021-10-08T19:28:05.071 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2021-10-08T19:28:05.071 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (8 ms) 2021-10-08T19:28:05.071 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1065 ms total) 2021-10-08T19:28:05.071 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: 2021-10-08T19:28:05.071 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [----------] Global test environment tear-down 2021-10-08T19:28:05.072 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (17126 ms total) 2021-10-08T19:28:05.072 INFO:tasks.workunit.client.0.smithi157.stdout: api_stat_pp: [ PASSED ] 9 tests. 2021-10-08T19:28:05.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: pgmap v91: 644 pgs: 128 unknown, 64 creating+peering, 452 active+clean; 145 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 13 MiB/s wr, 5 op/s 2021-10-08T19:28:05.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88820-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:05.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:05.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:28:05.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:05.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:05.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/665842087' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:28:05.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:05.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: osdmap e82: 8 total, 8 up, 8 in 2021-10-08T19:28:05.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-4"}]: dispatch 2021-10-08T19:28:05.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:05.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:28:05.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-10-08T19:28:05.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:05.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-6", "pg_num": 4}]: dispatch 2021-10-08T19:28:05.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:05.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-4"}]': finished 2021-10-08T19:28:05.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:05.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: pgmap v91: 644 pgs: 128 unknown, 64 creating+peering, 452 active+clean; 145 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 13 MiB/s wr, 5 op/s 2021-10-08T19:28:05.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88820-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:05.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:05.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:28:05.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:05.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:05.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/665842087' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:28:05.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:05.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: osdmap e82: 8 total, 8 up, 8 in 2021-10-08T19:28:05.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-4"}]: dispatch 2021-10-08T19:28:05.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:05.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:28:05.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-10-08T19:28:05.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:05.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-6", "pg_num": 4}]: dispatch 2021-10-08T19:28:05.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:05.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-4"}]': finished 2021-10-08T19:28:05.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:05.839 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:05.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:28:05.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:05.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-6", "pg_num": 4}]': finished 2021-10-08T19:28:05.840 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: osdmap e83: 8 total, 8 up, 8 in 2021-10-08T19:28:05.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:05.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3680728920' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:05.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3182421879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.841 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.842 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.842 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:28:05.842 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:28:05.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:05.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:28:05.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:05.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-6", "pg_num": 4}]': finished 2021-10-08T19:28:05.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: osdmap e83: 8 total, 8 up, 8 in 2021-10-08T19:28:05.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:05.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3680728920' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:05.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3182421879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.844 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:28:05.845 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:28:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: pgmap v91: 644 pgs: 128 unknown, 64 creating+peering, 452 active+clean; 145 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 13 MiB/s wr, 5 op/s 2021-10-08T19:28:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88820-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:28:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3729473720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/665842087' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:28:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1526368853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: osdmap e82: 8 total, 8 up, 8 in 2021-10-08T19:28:05.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-4"}]: dispatch 2021-10-08T19:28:05.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]: dispatch 2021-10-08T19:28:05.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:28:05.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2507045991' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-10-08T19:28:05.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]: dispatch 2021-10-08T19:28:05.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-6", "pg_num": 4}]: dispatch 2021-10-08T19:28:05.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:05.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-4"}]': finished 2021-10-08T19:28:05.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88784-7"}]': finished 2021-10-08T19:28:05.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:05.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:28:05.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88769-6"}]': finished 2021-10-08T19:28:05.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88820-6", "pg_num": 4}]': finished 2021-10-08T19:28:05.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: osdmap e83: 8 total, 8 up, 8 in 2021-10-08T19:28:05.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:05.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3680728920' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.874 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]: dispatch 2021-10-08T19:28:05.875 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3182421879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.875 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.876 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:05.876 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1399922023' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:28:05.876 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:28:06.549 INFO:tasks.workunit.client.0.smithi157.stdout:: "osd pool application enable","pool": "test-rados-api-smithi157-88552-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:06.550 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (9966 ms) 2021-10-08T19:28:06.550 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (18594 ms total) 2021-10-08T19:28:06.550 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: 2021-10-08T19:28:06.550 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [----------] Global test environment tear-down 2021-10-08T19:28:06.551 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (18594 ms total) 2021-10-08T19:28:06.551 INFO:tasks.workunit.client.0.smithi157.stdout: api_cmd: [ PASSED ] 4 tests. 2021-10-08T19:28:06.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: 10.1 deep-scrub ok 2021-10-08T19:28:06.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: pgmap v95: 632 pgs: 148 unknown, 64 creating+peering, 420 active+clean; 145 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:06.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:06.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:06.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:06.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:06.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:06.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:06.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:28:06.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: osdmap e84: 8 total, 8 up, 8 in 2021-10-08T19:28:06.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88820-4", "overlaypool": "test-rados-api-smithi157-88820-6"}]: dispatch 2021-10-08T19:28:06.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/636552291' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:06.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:06.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:06.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:06.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:06.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: 10.1 deep-scrub ok 2021-10-08T19:28:06.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: pgmap v95: 632 pgs: 148 unknown, 64 creating+peering, 420 active+clean; 145 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:06.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:06.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:06.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:06.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:06.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:06.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:06.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:28:06.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: osdmap e84: 8 total, 8 up, 8 in 2021-10-08T19:28:06.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88820-4", "overlaypool": "test-rados-api-smithi157-88820-6"}]: dispatch 2021-10-08T19:28:06.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/636552291' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:06.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:06.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:06.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:06.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:06.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:28:06 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:28:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: 10.1 deep-scrub ok 2021-10-08T19:28:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: pgmap v95: 632 pgs: 148 unknown, 64 creating+peering, 420 active+clean; 145 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:06.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:06.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:06.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:06.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1489190884' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-4", "tierpool": "test-rados-api-smithi157-88568-4-cache"}]': finished 2021-10-08T19:28:06.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:06.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:06.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88552-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:28:06.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: osdmap e84: 8 total, 8 up, 8 in 2021-10-08T19:28:06.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88820-4", "overlaypool": "test-rados-api-smithi157-88820-6"}]: dispatch 2021-10-08T19:28:06.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/636552291' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:06.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:06.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:06.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:06.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:07] "GET /metrics HTTP/1.1" 200 173633 "" "Prometheus/2.18.1" 2021-10-08T19:28:07.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:07 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:28:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:07.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:07.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:07.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88820-4", "overlaypool": "test-rados-api-smithi157-88820-6"}]': finished 2021-10-08T19:28:07.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:07.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:07.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:07.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: osdmap e85: 8 total, 8 up, 8 in 2021-10-08T19:28:07.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:07.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:07.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:07.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88820-6", "mode": "writeback"}]: dispatch 2021-10-08T19:28:07.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:07.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:07.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88795-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:07.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:07.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:07.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88820-4", "overlaypool": "test-rados-api-smithi157-88820-6"}]': finished 2021-10-08T19:28:07.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:07.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:07.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:07.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: osdmap e85: 8 total, 8 up, 8 in 2021-10-08T19:28:07.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:07.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:07.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:07.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88820-6", "mode": "writeback"}]: dispatch 2021-10-08T19:28:07.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:07.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:07.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88795-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:08.079 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: Running main() from gmock_main.cc 2021-10-08T19:28:08.079 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2021-10-08T19:28:08.079 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [----------] Global test environment set-up. 2021-10-08T19:28:08.080 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2021-10-08T19:28:08.080 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: seed 88541 2021-10-08T19:28:08.080 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2021-10-08T19:28:08.080 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (207 ms) 2021-10-08T19:28:08.080 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2021-10-08T19:28:08.081 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (6 ms) 2021-10-08T19:28:08.081 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2021-10-08T19:28:08.082 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1018 ms) 2021-10-08T19:28:08.082 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2021-10-08T19:28:08.082 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1038 ms) 2021-10-08T19:28:08.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2021-10-08T19:28:08.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (4 ms) 2021-10-08T19:28:08.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2021-10-08T19:28:08.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (3 ms) 2021-10-08T19:28:08.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2021-10-08T19:28:08.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (3 ms) 2021-10-08T19:28:08.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2021-10-08T19:28:08.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (2 ms) 2021-10-08T19:28:08.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2281 ms total) 2021-10-08T19:28:08.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: 2021-10-08T19:28:08.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2021-10-08T19:28:08.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2021-10-08T19:28:08.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1073 ms) 2021-10-08T19:28:08.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2021-10-08T19:28:08.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (8 ms) 2021-10-08T19:28:08.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2021-10-08T19:28:08.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1005 ms) 2021-10-08T19:28:08.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2021-10-08T19:28:08.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1004 ms) 2021-10-08T19:28:08.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2021-10-08T19:28:08.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (3 ms) 2021-10-08T19:28:08.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2021-10-08T19:28:08.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (4 ms) 2021-10-08T19:28:08.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2021-10-08T19:28:08.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (5 ms) 2021-10-08T19:28:08.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2021-10-08T19:28:08.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (3 ms) 2021-10-08T19:28:08.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3106 ms total) 2021-10-08T19:28:08.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: 2021-10-08T19:28:08.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [----------] Global test environment tear-down 2021-10-08T19:28:08.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (20202 ms total) 2021-10-08T19:28:08.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock_pp: [ PASSED ] 16 tests. 2021-10-08T19:28:08.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: Running main() from gmock_main.cc 2021-10-08T19:28:08.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2021-10-08T19:28:08.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [----------] Global test environment set-up. 2021-10-08T19:28:08.091 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [----------] 8 tests from LibRadosLock 2021-10-08T19:28:08.091 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2021-10-08T19:28:08.092 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (183 ms) 2021-10-08T19:28:08.092 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2021-10-08T19:28:08.092 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLock.LockShared (36 ms) 2021-10-08T19:28:08.092 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2021-10-08T19:28:08.092 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1011 ms) 2021-10-08T19:28:08.093 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2021-10-08T19:28:08.093 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1041 ms) 2021-10-08T19:28:08.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2021-10-08T19:28:08.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (3 ms) 2021-10-08T19:28:08.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2021-10-08T19:28:08.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLock.Unlock (3 ms) 2021-10-08T19:28:08.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2021-10-08T19:28:08.095 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (4 ms) 2021-10-08T19:28:08.095 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2021-10-08T19:28:08.095 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (3 ms) 2021-10-08T19:28:08.095 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [----------] 8 tests from LibRadosLock (2285 ms total) 2021-10-08T19:28:08.096 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: 2021-10-08T19:28:08.096 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2021-10-08T19:28:08.096 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2021-10-08T19:28:08.096 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1060 ms) 2021-10-08T19:28:08.096 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2021-10-08T19:28:08.097 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (6 ms) 2021-10-08T19:28:08.097 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2021-10-08T19:28:08.097 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1005 ms) 2021-10-08T19:28:08.097 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2021-10-08T19:28:08.098 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1006 ms) 2021-10-08T19:28:08.098 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2021-10-08T19:28:08.098 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (4 ms) 2021-10-08T19:28:08.098 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2021-10-08T19:28:08.099 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (4 ms) 2021-10-08T19:28:08.099 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2021-10-08T19:28:08.099 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (7 ms) 2021-10-08T19:28:08.099 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2021-10-08T19:28:08.099 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (5 ms) 2021-10-08T19:28:08.100 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3097 ms total) 2021-10-08T19:28:08.100 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: 2021-10-08T19:28:08.100 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [----------] Global test environment tear-down 2021-10-08T19:28:08.100 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (20214 ms total) 2021-10-08T19:28:08.101 INFO:tasks.workunit.client.0.smithi157.stdout: api_lock: [ PASSED ] 16 tests. 2021-10-08T19:28:08.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88820-4", "overlaypool": "test-rados-api-smithi157-88820-6"}]': finished 2021-10-08T19:28:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88675-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:08.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:08.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: osdmap e85: 8 total, 8 up, 8 in 2021-10-08T19:28:08.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/406561195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:08.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]: dispatch 2021-10-08T19:28:08.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]: dispatch 2021-10-08T19:28:08.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88820-6", "mode": "writeback"}]: dispatch 2021-10-08T19:28:08.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:08.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:08.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88795-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:09.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: pgmap v98: 520 pgs: 32 creating+peering, 32 unknown, 456 active+clean; 145 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.5 KiB/s wr, 2 op/s 2021-10-08T19:28:09.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:09.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:28:09.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:28:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:09.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:09.088 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:09.088 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:09.089 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:09.089 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88820-6", "mode": "writeback"}]': finished 2021-10-08T19:28:09.089 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88795-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:09.090 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: osdmap e86: 8 total, 8 up, 8 in 2021-10-08T19:28:09.090 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3267771834' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.091 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.091 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1696427300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.092 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.092 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88795-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:09.094 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: pgmap v98: 520 pgs: 32 creating+peering, 32 unknown, 456 active+clean; 145 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.5 KiB/s wr, 2 op/s 2021-10-08T19:28:09.095 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:09.095 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:28:09.095 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:28:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:09.096 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:09.098 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:09.098 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:09.099 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:09.099 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88820-6", "mode": "writeback"}]': finished 2021-10-08T19:28:09.100 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88795-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:09.100 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: osdmap e86: 8 total, 8 up, 8 in 2021-10-08T19:28:09.100 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3267771834' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.101 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.101 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1696427300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.102 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.102 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88795-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:09.118 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:28:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:09.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: pgmap v98: 520 pgs: 32 creating+peering, 32 unknown, 456 active+clean; 145 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.5 KiB/s wr, 2 op/s 2021-10-08T19:28:09.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:09.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:28:09.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:28:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:09.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:09.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:09.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88536-10"}]': finished 2021-10-08T19:28:09.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2024568760' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88541-10"}]': finished 2021-10-08T19:28:09.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88820-6", "mode": "writeback"}]': finished 2021-10-08T19:28:09.123 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88795-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:09.123 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: osdmap e86: 8 total, 8 up, 8 in 2021-10-08T19:28:09.124 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3267771834' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.124 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.125 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1696427300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.125 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:09.126 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88795-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: pool 'test-rados-api-smithi157-88496-3' is full (reached quota's max_bytes: 4 KiB) 2021-10-08T19:28:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:28:10.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:10.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:10.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: osdmap e87: 8 total, 8 up, 8 in 2021-10-08T19:28:10.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/331999199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:10.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:10.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:10.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:10.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:10.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: pool 'test-rados-api-smithi157-88496-3' is full (reached quota's max_bytes: 4 KiB) 2021-10-08T19:28:10.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:28:10.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:10.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:10.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: osdmap e87: 8 total, 8 up, 8 in 2021-10-08T19:28:10.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/331999199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:10.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:10.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:10.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:10.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:10.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: pool 'test-rados-api-smithi157-88496-3' is full (reached quota's max_bytes: 4 KiB) 2021-10-08T19:28:10.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:28:10.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:10.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:10.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: osdmap e87: 8 total, 8 up, 8 in 2021-10-08T19:28:10.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/331999199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:10.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:10.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:11.250 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2021-10-08T19:28:11.250 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2021-10-08T19:28:11.251 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2021-10-08T19:28:11.251 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2021-10-08T19:28:11.251 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2021-10-08T19:28:11.251 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: notify 2021-10-08T19:28:11.251 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1158 ms) 2021-10-08T19:28:11.252 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2021-10-08T19:28:11.252 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (9 ms) 2021-10-08T19:28:11.252 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1167 ms total) 2021-10-08T19:28:11.252 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: 2021-10-08T19:28:11.253 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2021-10-08T19:28:11.253 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2021-10-08T19:28:11.253 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: notify 2021-10-08T19:28:11.254 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (7 ms) 2021-10-08T19:28:11.254 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2021-10-08T19:28:11.254 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: notify 2021-10-08T19:28:11.254 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3604 ms) 2021-10-08T19:28:11.255 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2021-10-08T19:28:11.255 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (21 ms) 2021-10-08T19:28:11.256 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2021-10-08T19:28:11.256 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (5 ms) 2021-10-08T19:28:11.257 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2021-10-08T19:28:11.257 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880463207488 notify_id 369367187459 notifier_gid 15255 2021-10-08T19:28:11.257 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (5 ms) 2021-10-08T19:28:11.257 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2021-10-08T19:28:11.258 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880463207488 notify_id 369367187458 notifier_gid 15255 2021-10-08T19:28:11.258 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (12 ms) 2021-10-08T19:28:11.258 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2021-10-08T19:28:11.258 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880463983568 notify_id 369367187460 notifier_gid 15255 2021-10-08T19:28:11.259 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (9 ms) 2021-10-08T19:28:11.259 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2021-10-08T19:28:11.259 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880463983568 notify_id 369367187457 notifier_gid 15255 2021-10-08T19:28:11.259 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (10 ms) 2021-10-08T19:28:11.260 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2021-10-08T19:28:11.260 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880475384576 notify_id 369367187459 notifier_gid 15255 2021-10-08T19:28:11.260 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (9 ms) 2021-10-08T19:28:11.260 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2021-10-08T19:28:11.260 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880475384576 notify_id 369367187458 notifier_gid 15255 2021-10-08T19:28:11.261 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (12 ms) 2021-10-08T19:28:11.261 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2021-10-08T19:28:11.261 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: trying... 2021-10-08T19:28:11.261 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880475384576 notify_id 369367187461 notifier_gid 15255 2021-10-08T19:28:11.262 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: timed out 2021-10-08T19:28:11.262 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: flushing 2021-10-08T19:28:11.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[32847]: pgmap v101: 488 pgs: 32 creating+peering, 96 unknown, 360 active+clean; 145 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:28:11.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88795-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88795-12"}]': finished 2021-10-08T19:28:11.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:11.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[32847]: osdmap e88: 8 total, 8 up, 8 in 2021-10-08T19:28:11.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3703861338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:11.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[42114]: pgmap v101: 488 pgs: 32 creating+peering, 96 unknown, 360 active+clean; 145 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:28:11.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88795-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88795-12"}]': finished 2021-10-08T19:28:11.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:11.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[42114]: osdmap e88: 8 total, 8 up, 8 in 2021-10-08T19:28:11.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3703861338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:11.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:11 smithi196 ceph-mon[34258]: pgmap v101: 488 pgs: 32 creating+peering, 96 unknown, 360 active+clean; 145 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:28:11.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88795-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88795-12"}]': finished 2021-10-08T19:28:11.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:11 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:11.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:11 smithi196 ceph-mon[34258]: osdmap e88: 8 total, 8 up, 8 in 2021-10-08T19:28:11.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3703861338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:11 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:11 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:11.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[32847]: osdmap e89: 8 total, 8 up, 8 in 2021-10-08T19:28:12.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/437822838' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1350763945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[32847]: pgmap v104: 592 pgs: 96 creating+peering, 496 active+clean; 145 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2021-10-08T19:28:12.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:12.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[42114]: osdmap e89: 8 total, 8 up, 8 in 2021-10-08T19:28:12.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/437822838' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1350763945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[42114]: pgmap v104: 592 pgs: 96 creating+peering, 496 active+clean; 145 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2021-10-08T19:28:12.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:12.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88687-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:12 smithi196 ceph-mon[34258]: osdmap e89: 8 total, 8 up, 8 in 2021-10-08T19:28:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/437822838' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1350763945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:12 smithi196 ceph-mon[34258]: pgmap v104: 592 pgs: 96 creating+peering, 496 active+clean; 145 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2021-10-08T19:28:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:13.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:13.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:13.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: osdmap e90: 8 total, 8 up, 8 in 2021-10-08T19:28:13.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:13.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:13.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:13.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:13.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88795-12"}]': finished 2021-10-08T19:28:13.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:13.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: osdmap e91: 8 total, 8 up, 8 in 2021-10-08T19:28:13.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:13.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:13.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:13.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: osdmap e90: 8 total, 8 up, 8 in 2021-10-08T19:28:13.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:13.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:13.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:13.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:13.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88795-12"}]': finished 2021-10-08T19:28:13.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:13.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: osdmap e91: 8 total, 8 up, 8 in 2021-10-08T19:28:13.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:13.838 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:13.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:13.839 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:13.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:13.839 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:13.508Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:28:13.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: osdmap e90: 8 total, 8 up, 8 in 2021-10-08T19:28:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:13.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:13.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:13.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:13.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88795-12"}]': finished 2021-10-08T19:28:13.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:13.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: osdmap e91: 8 total, 8 up, 8 in 2021-10-08T19:28:13.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88795-12"}]: dispatch 2021-10-08T19:28:14.649 INFO:tasks.workunit.client.0.smithi157.stdout: api_wa api_watch_notify: Running main() from gmock_main.cc 2021-10-08T19:28:14.649 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2021-10-08T19:28:14.649 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [----------] Global test environment set-up. 2021-10-08T19:28:14.650 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2021-10-08T19:28:14.650 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2021-10-08T19:28:14.650 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify_test_cb 2021-10-08T19:28:14.650 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (223 ms) 2021-10-08T19:28:14.651 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2021-10-08T19:28:14.651 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-10-08T19:28:14.651 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94844604740896 err -107 2021-10-08T19:28:14.651 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1008 ms) 2021-10-08T19:28:14.652 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2021-10-08T19:28:14.652 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-10-08T19:28:14.652 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94844604841248 err -107 2021-10-08T19:28:14.652 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1007 ms) 2021-10-08T19:28:14.653 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2021-10-08T19:28:14.653 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_cb from 14874 notify_id 322122547200 cookie 94844604857776 2021-10-08T19:28:14.653 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (5 ms) 2021-10-08T19:28:14.653 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2021-10-08T19:28:14.654 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_cb from 14874 notify_id 322122547200 cookie 94844604873680 2021-10-08T19:28:14.654 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (3 ms) 2021-10-08T19:28:14.654 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2021-10-08T19:28:14.654 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_cb from 14874 notify_id 322122547201 cookie 94844604873680 2021-10-08T19:28:14.654 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (5 ms) 2021-10-08T19:28:14.655 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2021-10-08T19:28:14.655 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_cb from 14874 notify_id 322122547200 cookie 94844604873680 2021-10-08T19:28:14.655 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_cb from 14874 notify_id 322122547200 cookie 94844604908816 2021-10-08T19:28:14.655 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (4 ms) 2021-10-08T19:28:14.656 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2021-10-08T19:28:14.656 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_cb from 14874 notify_id 322122547200 cookie 94844604908816 2021-10-08T19:28:14.656 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_cb from 14874 notify_id 326417514497 cookie 94844604908816 2021-10-08T19:28:14.656 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3004 ms) 2021-10-08T19:28:14.656 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2021-10-08T19:28:14.657 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: waiting up to 64 for osd to time us out ... 2021-10-08T19:28:14.657 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94844604908816 err -107 2021-10-08T19:28:14.657 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_cb from 14874 notify_id 356482285571 cookie 94844604908816 2021-10-08T19:28:14.657 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5011 ms) 2021-10-08T19:28:14.658 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2021-10-08T19:28:14.658 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2021-10-08T19:28:14.658 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94844604894720 err -107 2021-10-08T19:28:14.658 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1014 ms) 2021-10-08T19:28:14.658 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11284 ms total) 2021-10-08T19:28:14.659 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: 2021-10-08T19:28:14.659 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2021-10-08T19:28:14.659 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2021-10-08T19:28:14.659 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: watch_notify_test_cb 2021-10-08T19:28:14.659 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1295 ms) 2021-10-08T19:28:14.660 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1295 ms total) 2021-10-08T19:28:14.660 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: 2021-10-08T19:28:14.660 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [----------] Global test environment tear-down 2021-10-08T19:28:14.660 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (26709 ms total) 2021-10-08T19:28:14.661 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify: [ PASSED ] 11 tests. 2021-10-08T19:28:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: pgmap v107: 488 pgs: 32 unknown, 456 active+clean; 145 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2021-10-08T19:28:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88795-12"}]': finished 2021-10-08T19:28:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2492933519' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: osdmap e92: 8 total, 8 up, 8 in 2021-10-08T19:28:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:15.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:15.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: pgmap v107: 488 pgs: 32 unknown, 456 active+clean; 145 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2021-10-08T19:28:15.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:15.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:15.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88795-12"}]': finished 2021-10-08T19:28:15.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:15.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2492933519' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:15.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:15.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: osdmap e92: 8 total, 8 up, 8 in 2021-10-08T19:28:15.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:15.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: pgmap v107: 488 pgs: 32 unknown, 456 active+clean; 145 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2021-10-08T19:28:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/290326745' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88795-12"}]': finished 2021-10-08T19:28:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:15.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2492933519' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:15.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:15.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: osdmap e92: 8 total, 8 up, 8 in 2021-10-08T19:28:15.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:16.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:16.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2256103808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:28:16.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-7"}]': finished 2021-10-08T19:28:16.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2256103808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:16.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:16.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: osdmap e93: 8 total, 8 up, 8 in 2021-10-08T19:28:16.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4101630074' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:16.088 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:16.088 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:16.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:16.090 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2256103808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.090 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.090 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:28:16.091 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-7"}]': finished 2021-10-08T19:28:16.092 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2256103808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:16.092 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:16.092 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: osdmap e93: 8 total, 8 up, 8 in 2021-10-08T19:28:16.093 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4101630074' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.093 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.093 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:16.093 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:16.094 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2256103808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:28:16.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-7"}]': finished 2021-10-08T19:28:16.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2256103808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88964-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:16.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:16.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: osdmap e93: 8 total, 8 up, 8 in 2021-10-08T19:28:16.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4101630074' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:16.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:16.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:16.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:16.360 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: Running main() from gmock_main.cc 2021-10-08T19:28:16.361 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2021-10-08T19:28:16.361 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [----------] Global test environment set-up. 2021-10-08T19:28:16.361 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2021-10-08T19:28:16.361 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2021-10-08T19:28:16.362 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2021-10-08T19:28:16.362 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2021-10-08T19:28:16.362 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: 2021-10-08T19:28:16.362 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2021-10-08T19:28:16.362 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2021-10-08T19:28:16.363 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (8587 ms) 2021-10-08T19:28:16.363 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2021-10-08T19:28:16.363 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (4349 ms) 2021-10-08T19:28:16.363 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2021-10-08T19:28:16.364 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (2782 ms) 2021-10-08T19:28:16.364 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2021-10-08T19:28:16.365 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3322 ms) 2021-10-08T19:28:16.365 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2021-10-08T19:28:16.365 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3155 ms) 2021-10-08T19:28:16.365 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2021-10-08T19:28:16.366 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3264 ms) 2021-10-08T19:28:16.366 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2021-10-08T19:28:16.366 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (2897 ms) 2021-10-08T19:28:16.366 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (28356 ms total) 2021-10-08T19:28:16.367 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: 2021-10-08T19:28:16.367 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [----------] Global test environment tear-down 2021-10-08T19:28:16.367 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (28356 ms total) 2021-10-08T19:28:16.367 INFO:tasks.workunit.client.0.smithi157.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2021-10-08T19:28:16.619 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2021-10-08T19:28:16.620 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [----------] Global test environment set-up. 2021-10-08T19:28:16.620 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [----------] 4 tests from LibRadosService 2021-10-08T19:28:16.620 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2021-10-08T19:28:16.621 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5424 ms) 2021-10-08T19:28:16.621 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2021-10-08T19:28:16.621 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [ OK ] LibRadosService.RegisterLate (13 ms) 2021-10-08T19:28:16.621 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2021-10-08T19:28:16.621 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: cluster: 2021-10-08T19:28:16.622 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: id: 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:28:16.622 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: health: HEALTH_OK 2021-10-08T19:28:16.623 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.623 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: services: 2021-10-08T19:28:16.623 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: mon: 3 daemons, quorum a,c,b (age -719328628) 2021-10-08T19:28:16.623 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: mgr: y(active, since 2m), standbys: x 2021-10-08T19:28:16.623 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 3m) 2021-10-08T19:28:16.624 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2021-10-08T19:28:16.624 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.624 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: data: 2021-10-08T19:28:16.624 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: pools: 6 pools, 132 pgs 2021-10-08T19:28:16.625 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: objects: 194 objects, 582 KiB 2021-10-08T19:28:16.625 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: usage: 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:16.625 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: pgs: 132 active+clean 2021-10-08T19:28:16.625 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.626 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: io: 2021-10-08T19:28:16.626 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2021-10-08T19:28:16.626 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.626 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.627 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: cluster: 2021-10-08T19:28:16.627 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: id: 906d7a14-286c-11ec-8c25-001a4aab830c 2021-10-08T19:28:16.627 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: health: HEALTH_OK 2021-10-08T19:28:16.627 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: services: 2021-10-08T19:28:16.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: mon: 3 daemons, quorum a,c,b (age 1356074164) 2021-10-08T19:28:16.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: mgr: y(active, since 2m), standbys: x 2021-10-08T19:28:16.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 3m) 2021-10-08T19:28:16.628 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2021-10-08T19:28:16.629 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: laundry: 1 daemon active (1 hosts) 2021-10-08T19:28:16.629 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2021-10-08T19:28:16.629 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.629 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: data: 2021-10-08T19:28:16.629 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: pools: 30 pools, 900 pgs 2021-10-08T19:28:16.630 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: objects: 194 objects, 582 KiB 2021-10-08T19:28:16.630 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: usage: 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:16.630 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: pgs: 80.333% pgs unknown 2021-10-08T19:28:16.630 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 5.000% pgs not active 2021-10-08T19:28:16.631 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 723 unknown 2021-10-08T19:28:16.631 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 132 active+clean 2021-10-08T19:28:16.631 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 45 creating+peering 2021-10-08T19:28:16.631 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.631 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.632 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [ OK ] LibRadosService.StatusFormat (3037 ms) 2021-10-08T19:28:16.632 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [ RUN ] LibRadosService.Status 2021-10-08T19:28:16.632 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [ OK ] LibRadosService.Status (20152 ms) 2021-10-08T19:28:16.632 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [----------] 4 tests from LibRadosService (28626 ms total) 2021-10-08T19:28:16.633 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: 2021-10-08T19:28:16.633 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [----------] Global test environment tear-down 2021-10-08T19:28:16.633 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [==========] 4 tests from 1 test suite ran. (28626 ms total) 2021-10-08T19:28:16.633 INFO:tasks.workunit.client.0.smithi157.stdout: api_service: [ PASSED ] 4 tests. 2021-10-08T19:28:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: pgmap v110: 552 pgs: 128 unknown, 424 active+clean; 145 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:28:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: osdmap e94: 8 total, 8 up, 8 in 2021-10-08T19:28:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:17.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:17.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:17.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: pgmap v110: 552 pgs: 128 unknown, 424 active+clean; 145 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:28:17.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: osdmap e94: 8 total, 8 up, 8 in 2021-10-08T19:28:17.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:17.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:17.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:17.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:17.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:17.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:28:16 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:28:17.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: pgmap v110: 552 pgs: 128 unknown, 424 active+clean; 145 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:17.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:17.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:28:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: osdmap e94: 8 total, 8 up, 8 in 2021-10-08T19:28:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7"}]: dispatch 2021-10-08T19:28:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:17.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:17.123 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:17.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:17.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7"}]': finished 2021-10-08T19:28:17.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:17.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[32847]: osdmap e95: 8 total, 8 up, 8 in 2021-10-08T19:28:17.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2558925619' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:17.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:17.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:17.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:17.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7"}]': finished 2021-10-08T19:28:17.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:17.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[42114]: osdmap e95: 8 total, 8 up, 8 in 2021-10-08T19:28:17.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2558925619' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:17.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:17.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:17.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:17.834 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:17] "GET /metrics HTTP/1.1" 200 173633 "" "Prometheus/2.18.1" 2021-10-08T19:28:18.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:17 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:18.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-7"}]': finished 2021-10-08T19:28:18.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:18.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:17 smithi196 ceph-mon[34258]: osdmap e95: 8 total, 8 up, 8 in 2021-10-08T19:28:18.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:18.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2558925619' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:18.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:18.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:18.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:19.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:28:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:19.462 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2021-10-08T19:28:19.462 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [----------] Global test environment set-up. 2021-10-08T19:28:19.462 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2021-10-08T19:28:19.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2021-10-08T19:28:19.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5922 ms) 2021-10-08T19:28:19.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2021-10-08T19:28:19.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (25 ms) 2021-10-08T19:28:19.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2021-10-08T19:28:19.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20019 ms) 2021-10-08T19:28:19.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2021-10-08T19:28:19.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: attempt 0 of 20 2021-10-08T19:28:19.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5494 ms) 2021-10-08T19:28:19.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (31460 ms total) 2021-10-08T19:28:19.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: 2021-10-08T19:28:19.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [----------] Global test environment tear-down 2021-10-08T19:28:19.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (31460 ms total) 2021-10-08T19:28:19.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_service_pp: [ PASSED ] 4 tests. 2021-10-08T19:28:19.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:19 smithi157 ceph-mon[32847]: pgmap v113: 456 pgs: 32 unknown, 424 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2 op/s 2021-10-08T19:28:19.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:19.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:19 smithi157 ceph-mon[32847]: osdmap e96: 8 total, 8 up, 8 in 2021-10-08T19:28:19.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2401999170' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:19.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:19 smithi157 ceph-mon[42114]: pgmap v113: 456 pgs: 32 unknown, 424 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2 op/s 2021-10-08T19:28:19.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:19.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:19 smithi157 ceph-mon[42114]: osdmap e96: 8 total, 8 up, 8 in 2021-10-08T19:28:19.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2401999170' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:19.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:19 smithi196 ceph-mon[34258]: pgmap v113: 456 pgs: 32 unknown, 424 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2 op/s 2021-10-08T19:28:19.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:19.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:19 smithi196 ceph-mon[34258]: osdmap e96: 8 total, 8 up, 8 in 2021-10-08T19:28:19.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2401999170' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:20.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:20.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/326452718' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:28:20.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:28:20.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-9"}]': finished 2021-10-08T19:28:20.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:20.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: osdmap e97: 8 total, 8 up, 8 in 2021-10-08T19:28:20.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: pgmap v116: 464 pgs: 104 unknown, 360 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-10-08T19:28:20.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:20.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88820-4"}]: dispatch 2021-10-08T19:28:20.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:20.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:20.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/326452718' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:28:20.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:28:20.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-9"}]': finished 2021-10-08T19:28:20.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:20.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: osdmap e97: 8 total, 8 up, 8 in 2021-10-08T19:28:20.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: pgmap v116: 464 pgs: 104 unknown, 360 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-10-08T19:28:20.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:20.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88820-4"}]: dispatch 2021-10-08T19:28:20.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/326452718' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:28:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:28:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-9"}]': finished 2021-10-08T19:28:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: osdmap e97: 8 total, 8 up, 8 in 2021-10-08T19:28:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: pgmap v116: 464 pgs: 104 unknown, 360 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-10-08T19:28:20.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:20.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88820-4"}]: dispatch 2021-10-08T19:28:21.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:21.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:21.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88820-4"}]': finished 2021-10-08T19:28:21.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: osdmap e98: 8 total, 8 up, 8 in 2021-10-08T19:28:21.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6"}]: dispatch 2021-10-08T19:28:21.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4095246922' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:21.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:21.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:21.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:21.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:21.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:21.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:21.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88820-4"}]': finished 2021-10-08T19:28:21.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: osdmap e98: 8 total, 8 up, 8 in 2021-10-08T19:28:21.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6"}]: dispatch 2021-10-08T19:28:21.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4095246922' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:21.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:21.842 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:21.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:21.843 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88573-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:21.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:21.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88820-4"}]': finished 2021-10-08T19:28:21.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: osdmap e98: 8 total, 8 up, 8 in 2021-10-08T19:28:21.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6"}]: dispatch 2021-10-08T19:28:21.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4095246922' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:21.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:21.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:21.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:21.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6"}]': finished 2021-10-08T19:28:22.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:22.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:22.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: osdmap e99: 8 total, 8 up, 8 in 2021-10-08T19:28:22.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/625420384' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:22.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:22.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:22.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:22.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:28:22.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:28:22.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi157-88820-6", "pool2": "test-rados-api-smithi157-88820-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:28:22.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: pgmap v119: 528 pgs: 64 creating+peering, 464 active+clean; 145 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2021-10-08T19:28:22.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:22.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:22.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6"}]': finished 2021-10-08T19:28:22.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:22.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:22.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: osdmap e99: 8 total, 8 up, 8 in 2021-10-08T19:28:22.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/625420384' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:22.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:22.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:22.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:22.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:28:22.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:28:22.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi157-88820-6", "pool2": "test-rados-api-smithi157-88820-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:28:22.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: pgmap v119: 528 pgs: 64 creating+peering, 464 active+clean; 145 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2021-10-08T19:28:22.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88820-4", "tierpool": "test-rados-api-smithi157-88820-6"}]': finished 2021-10-08T19:28:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:22.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: osdmap e99: 8 total, 8 up, 8 in 2021-10-08T19:28:22.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/625420384' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:22.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:22.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:22.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:22.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:28:22.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:28:22.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi157-88820-6", "pool2": "test-rados-api-smithi157-88820-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:28:22.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: pgmap v119: 528 pgs: 64 creating+peering, 464 active+clean; 145 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2021-10-08T19:28:22.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:23.554 INFO:tasks.workunit.client.0.smithi157.stdout:tch_notify_pp: flushed 2021-10-08T19:28:23.554 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3024 ms) 2021-10-08T19:28:23.554 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2021-10-08T19:28:23.555 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: trying... 2021-10-08T19:28:23.555 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880475384576 notify_id 377957122052 notifier_gid 15255 2021-10-08T19:28:23.555 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: timed out 2021-10-08T19:28:23.556 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: flushing 2021-10-08T19:28:23.556 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: flushed 2021-10-08T19:28:23.557 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3034 ms) 2021-10-08T19:28:23.557 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2021-10-08T19:28:23.557 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: List watches 2021-10-08T19:28:23.557 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: notify2 2021-10-08T19:28:23.558 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880475384576 notify_id 395136991237 notifier_gid 15255 2021-10-08T19:28:23.558 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: notify2 done 2021-10-08T19:28:23.559 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: watch_check 2021-10-08T19:28:23.559 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: unwatch2 2021-10-08T19:28:23.559 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: flushing 2021-10-08T19:28:23.560 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: done 2021-10-08T19:28:23.560 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3065 ms) 2021-10-08T19:28:23.560 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2021-10-08T19:28:23.560 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: List watches 2021-10-08T19:28:23.561 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: notify2 2021-10-08T19:28:23.561 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: handle_notify cookie 93880475384576 notify_id 408021893126 notifier_gid 15255 2021-10-08T19:28:23.561 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: notify2 done 2021-10-08T19:28:23.561 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: watch_check 2021-10-08T19:28:23.562 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: unwatch2 2021-10-08T19:28:23.562 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: flushing 2021-10-08T19:28:23.562 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: done 2021-10-08T19:28:23.562 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3042 ms) 2021-10-08T19:28:23.563 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (15859 ms total) 2021-10-08T19:28:23.563 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: 2021-10-08T19:28:23.563 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2021-10-08T19:28:23.563 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (35595 ms total) 2021-10-08T19:28:23.564 INFO:tasks.workunit.client.0.smithi157.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2021-10-08T19:28:23.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-9"}]': finished 2021-10-08T19:28:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache", "force_nonempty":""}]': finished 2021-10-08T19:28:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi157-88820-6", "pool2": "test-rados-api-smithi157-88820-6", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:28:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: osdmap e100: 8 total, 8 up, 8 in 2021-10-08T19:28:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88573-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-9", "mode": "writeback"}]: dispatch 2021-10-08T19:28:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88573-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-9", "mode": "writeback"}]: dispatch 2021-10-08T19:28:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:23.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:23.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-9"}]': finished 2021-10-08T19:28:23.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache", "force_nonempty":""}]': finished 2021-10-08T19:28:23.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi157-88820-6", "pool2": "test-rados-api-smithi157-88820-6", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:28:23.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: osdmap e100: 8 total, 8 up, 8 in 2021-10-08T19:28:23.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88573-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:23.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-9", "mode": "writeback"}]: dispatch 2021-10-08T19:28:23.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88573-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:23.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-9", "mode": "writeback"}]: dispatch 2021-10-08T19:28:23.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:23.834 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:23.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:23.834 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:23.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:23.834 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:23.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:28:23.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-9"}]': finished 2021-10-08T19:28:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache", "force_nonempty":""}]': finished 2021-10-08T19:28:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/917685507' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi157-88820-6", "pool2": "test-rados-api-smithi157-88820-6", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:28:23.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: osdmap e100: 8 total, 8 up, 8 in 2021-10-08T19:28:23.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88573-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:23.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-9", "mode": "writeback"}]: dispatch 2021-10-08T19:28:23.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88573-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:23.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-9", "mode": "writeback"}]: dispatch 2021-10-08T19:28:23.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:24.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:24.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88573-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:24.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-9", "mode": "writeback"}]': finished 2021-10-08T19:28:24.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: osdmap e101: 8 total, 8 up, 8 in 2021-10-08T19:28:24.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache"}]: dispatch 2021-10-08T19:28:24.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache"}]: dispatch 2021-10-08T19:28:24.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2366662265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:24.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: pgmap v122: 460 pgs: 32 unknown, 32 creating+peering, 396 active+clean; 145 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 0 op/s 2021-10-08T19:28:24.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:24.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:24.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:24.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:24.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache"}]': finished 2021-10-08T19:28:24.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2366662265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:24.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:28:24.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[42114]: osdmap e102: 8 total, 8 up, 8 in 2021-10-08T19:28:24.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:24.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88573-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:24.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-9", "mode": "writeback"}]': finished 2021-10-08T19:28:24.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: osdmap e101: 8 total, 8 up, 8 in 2021-10-08T19:28:24.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache"}]: dispatch 2021-10-08T19:28:24.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache"}]: dispatch 2021-10-08T19:28:24.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2366662265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:24.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: pgmap v122: 460 pgs: 32 unknown, 32 creating+peering, 396 active+clean; 145 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 0 op/s 2021-10-08T19:28:24.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:24.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:24.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:24.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:24.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache"}]': finished 2021-10-08T19:28:24.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2366662265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:24.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:28:24.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:24 smithi157 ceph-mon[32847]: osdmap e102: 8 total, 8 up, 8 in 2021-10-08T19:28:24.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:24.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88573-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:24.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-9", "mode": "writeback"}]': finished 2021-10-08T19:28:24.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: osdmap e101: 8 total, 8 up, 8 in 2021-10-08T19:28:24.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/767829902' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache"}]: dispatch 2021-10-08T19:28:24.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache"}]: dispatch 2021-10-08T19:28:24.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2366662265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:24.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: pgmap v122: 460 pgs: 32 unknown, 32 creating+peering, 396 active+clean; 145 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 0 op/s 2021-10-08T19:28:24.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:24.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:24.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:24.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:24.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88573-8", "tierpool":"test-rados-api-smithi157-88573-8-cache"}]': finished 2021-10-08T19:28:24.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2366662265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:24.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:28:24.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:24 smithi196 ceph-mon[34258]: osdmap e102: 8 total, 8 up, 8 in 2021-10-08T19:28:25.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:25.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:25.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4199884122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:25.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:25.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:25.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:25.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9"}]': finished 2021-10-08T19:28:25.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:25.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[32847]: osdmap e103: 8 total, 8 up, 8 in 2021-10-08T19:28:25.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:25.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:25.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4199884122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:25.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:25.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:25.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:25.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9"}]': finished 2021-10-08T19:28:25.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:25.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:25 smithi157 ceph-mon[42114]: osdmap e103: 8 total, 8 up, 8 in 2021-10-08T19:28:25.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:25.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9"}]: dispatch 2021-10-08T19:28:25.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4199884122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:25.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:25.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:25.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:25 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:25.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-9"}]': finished 2021-10-08T19:28:25.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:25.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:25 smithi196 ceph-mon[34258]: osdmap e103: 8 total, 8 up, 8 in 2021-10-08T19:28:26.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: Running main() from gmock_main.cc 2021-10-08T19:28:26.604 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [==========] Running 7 tests from 1 test suite. 2021-10-08T19:28:26.605 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [----------] Global test environment set-up. 2021-10-08T19:28:26.605 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [----------] 7 tests from LibRadosPools 2021-10-08T19:28:26.605 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2021-10-08T19:28:26.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ OK ] LibRadosPools.PoolList (8692 ms) 2021-10-08T19:28:26.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2021-10-08T19:28:26.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (4358 ms) 2021-10-08T19:28:26.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2021-10-08T19:28:26.606 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (2763 ms) 2021-10-08T19:28:26.607 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2021-10-08T19:28:26.607 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (4350 ms) 2021-10-08T19:28:26.608 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2021-10-08T19:28:26.608 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5420 ms) 2021-10-08T19:28:26.609 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2021-10-08T19:28:26.610 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5183 ms) 2021-10-08T19:28:26.610 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2021-10-08T19:28:26.610 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (7805 ms) 2021-10-08T19:28:26.611 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [----------] 7 tests from LibRadosPools (38571 ms total) 2021-10-08T19:28:26.611 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: 2021-10-08T19:28:26.611 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [----------] Global test environment tear-down 2021-10-08T19:28:26.611 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [==========] 7 tests from 1 test suite ran. (38571 ms total) 2021-10-08T19:28:26.611 INFO:tasks.workunit.client.0.smithi157.stdout: api_pool: [ PASSED ] 7 tests. 2021-10-08T19:28:26.612 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:26 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:28:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:27.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:28:26 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:28:27.540 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[32847]: pgmap v125: 428 pgs: 32 unknown, 396 active+clean; 145 MiB data, 659 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:27.540 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:27.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:27.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:28:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:27.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:27.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[32847]: osdmap e104: 8 total, 8 up, 8 in 2021-10-08T19:28:27.542 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3849078255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:27.542 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:27.542 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:27.543 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:27] "GET /metrics HTTP/1.1" 200 167322 "" "Prometheus/2.18.1" 2021-10-08T19:28:27.543 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[42114]: pgmap v125: 428 pgs: 32 unknown, 396 active+clean; 145 MiB data, 659 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:27.543 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:27.543 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:27.544 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:28:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:27.544 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:27.544 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[42114]: osdmap e104: 8 total, 8 up, 8 in 2021-10-08T19:28:27.544 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3849078255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:27.544 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:27.545 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:27.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:27 smithi196 ceph-mon[34258]: pgmap v125: 428 pgs: 32 unknown, 396 active+clean; 145 MiB data, 659 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:28:27.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:27 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:27.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:27 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:27.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:27 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:28:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:27.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:27.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:27 smithi196 ceph-mon[34258]: osdmap e104: 8 total, 8 up, 8 in 2021-10-08T19:28:27.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3849078255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:27.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:27 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:27.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:28:28.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:28:28.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:28:28.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:28:28.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:28:28.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:28:28.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:28:28.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:28:28.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:28:28.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:28:28.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:28:28.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:28:28.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:28:28.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:28:28.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:28:28.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:28:28.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:28:28.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:28:28.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:28:28.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:28:28.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: 10.5 deep-scrub ok 2021-10-08T19:28:28.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:28.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:28.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: osdmap e105: 8 total, 8 up, 8 in 2021-10-08T19:28:28.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3942338197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[32847]: pgmap v128: 428 pgs: 64 unknown, 32 creating+peering, 332 active+clean; 146 MiB data, 692 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 257 KiB/s wr, 4 op/s 2021-10-08T19:28:28.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:28:28.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:28:28.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:28:28.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:28:28.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:28:28.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:28:28.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:28:28.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:28:28.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:28:28.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:28:28.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:28:28.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:28:28.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:28:28.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:28:28.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:28:28.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:28:28.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:28:28.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:28:28.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:28:28.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:28:28.342 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: 10.5 deep-scrub ok 2021-10-08T19:28:28.342 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:28.342 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:28.342 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: osdmap e105: 8 total, 8 up, 8 in 2021-10-08T19:28:28.343 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3942338197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.343 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.343 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.343 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.343 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:28 smithi157 ceph-mon[42114]: pgmap v128: 428 pgs: 64 unknown, 32 creating+peering, 332 active+clean; 146 MiB data, 692 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 257 KiB/s wr, 4 op/s 2021-10-08T19:28:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:28:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.0"}]: dispatch 2021-10-08T19:28:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:28:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.1"}]: dispatch 2021-10-08T19:28:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:28:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.2"}]: dispatch 2021-10-08T19:28:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:28:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.3"}]: dispatch 2021-10-08T19:28:28.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:28:28.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.4"}]: dispatch 2021-10-08T19:28:28.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:28:28.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.5"}]: dispatch 2021-10-08T19:28:28.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:28:28.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.6"}]: dispatch 2021-10-08T19:28:28.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:28:28.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.7"}]: dispatch 2021-10-08T19:28:28.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:28:28.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.8"}]: dispatch 2021-10-08T19:28:28.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:28:28.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "10.9"}]: dispatch 2021-10-08T19:28:28.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: 10.5 deep-scrub ok 2021-10-08T19:28:28.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:28.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:28.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: osdmap e105: 8 total, 8 up, 8 in 2021-10-08T19:28:28.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3942338197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:28.623 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:28 smithi196 ceph-mon[34258]: pgmap v128: 428 pgs: 64 unknown, 32 creating+peering, 332 active+clean; 146 MiB data, 692 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 257 KiB/s wr, 4 op/s 2021-10-08T19:28:29.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:28:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:29.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[32847]: 10.0 deep-scrub ok 2021-10-08T19:28:29.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:29.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:29.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:29.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[32847]: osdmap e106: 8 total, 8 up, 8 in 2021-10-08T19:28:29.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[32847]: 10.2 deep-scrub ok 2021-10-08T19:28:29.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[42114]: 10.0 deep-scrub ok 2021-10-08T19:28:29.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:29.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:29.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:29.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[42114]: osdmap e106: 8 total, 8 up, 8 in 2021-10-08T19:28:29.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:29 smithi157 ceph-mon[42114]: 10.2 deep-scrub ok 2021-10-08T19:28:29.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:29 smithi196 ceph-mon[34258]: 10.0 deep-scrub ok 2021-10-08T19:28:29.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:29.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:29.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:29.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:29 smithi196 ceph-mon[34258]: osdmap e106: 8 total, 8 up, 8 in 2021-10-08T19:28:29.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:29 smithi196 ceph-mon[34258]: 10.2 deep-scrub ok 2021-10-08T19:28:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: 10.7 deep-scrub ok 2021-10-08T19:28:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: 10.3 deep-scrub ok 2021-10-08T19:28:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: osdmap e107: 8 total, 8 up, 8 in 2021-10-08T19:28:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2844554437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:30.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:30.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:30.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:30.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[32847]: pgmap v131: 388 pgs: 64 unknown, 324 active+clean; 146 MiB data, 692 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 2 op/s 2021-10-08T19:28:30.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: 10.7 deep-scrub ok 2021-10-08T19:28:30.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: 10.3 deep-scrub ok 2021-10-08T19:28:30.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:30.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: osdmap e107: 8 total, 8 up, 8 in 2021-10-08T19:28:30.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:30.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:30.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2844554437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:30.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:30.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:30.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:30.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:30 smithi157 ceph-mon[42114]: pgmap v131: 388 pgs: 64 unknown, 324 active+clean; 146 MiB data, 692 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 2 op/s 2021-10-08T19:28:30.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: 10.7 deep-scrub ok 2021-10-08T19:28:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: 10.3 deep-scrub ok 2021-10-08T19:28:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: osdmap e107: 8 total, 8 up, 8 in 2021-10-08T19:28:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2844554437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:30.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:30.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:30 smithi196 ceph-mon[34258]: pgmap v131: 388 pgs: 64 unknown, 324 active+clean; 146 MiB data, 692 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 2 op/s 2021-10-08T19:28:31.499 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (11556 ms) 2021-10-08T19:28:31.499 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (11556 ms total) 2021-10-08T19:28:31.499 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:28:31.500 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2021-10-08T19:28:31.500 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2021-10-08T19:28:31.500 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2021-10-08T19:28:31.500 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2021-10-08T19:28:31.501 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMisc.Exec (2 ms) 2021-10-08T19:28:31.501 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2021-10-08T19:28:31.501 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (4 ms) 2021-10-08T19:28:31.501 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2021-10-08T19:28:31.501 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (2 ms) 2021-10-08T19:28:31.502 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2021-10-08T19:28:31.502 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4082 ms) 2021-10-08T19:28:31.502 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2021-10-08T19:28:31.502 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2021-10-08T19:28:31.503 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2021-10-08T19:28:31.503 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2021-10-08T19:28:31.503 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2021-10-08T19:28:31.503 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (25076 ms) 2021-10-08T19:28:31.503 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] 8 tests from LibRadosMisc (29166 ms total) 2021-10-08T19:28:31.504 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: 2021-10-08T19:28:31.504 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [----------] Global test environment tear-down 2021-10-08T19:28:31.504 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [==========] 11 tests from 4 test suites ran. (43618 ms total) 2021-10-08T19:28:31.504 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc: [ PASSED ] 11 tests. 2021-10-08T19:28:31.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:31.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]': finished 2021-10-08T19:28:31.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:31.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:31.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: osdmap e108: 8 total, 8 up, 8 in 2021-10-08T19:28:31.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:31.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:31.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3699240886' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:31.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:31.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:31.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:31.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:31.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:31.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:31.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:31.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:31.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]': finished 2021-10-08T19:28:31.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:31.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:31.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: osdmap e108: 8 total, 8 up, 8 in 2021-10-08T19:28:31.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:31.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:31.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3699240886' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:31.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:31.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:31.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:31.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:31.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:31.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:31.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:31.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:31.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-9"}]': finished 2021-10-08T19:28:31.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:31.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:31.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: osdmap e108: 8 total, 8 up, 8 in 2021-10-08T19:28:31.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3964624974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:31.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:31.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3699240886' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:31.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:31.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]: dispatch 2021-10-08T19:28:31.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:31.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:31.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:31.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:31.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:32.315 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:32.315 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3699240886' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:32.315 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-11"}]': finished 2021-10-08T19:28:32.316 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]': finished 2021-10-08T19:28:32.316 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: osdmap e109: 8 total, 8 up, 8 in 2021-10-08T19:28:32.316 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-11", "mode": "writeback"}]: dispatch 2021-10-08T19:28:32.316 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-11", "mode": "writeback"}]: dispatch 2021-10-08T19:28:32.317 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.317 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: pgmap v134: 356 pgs: 356 active+clean; 217 MiB data, 899 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 2 op/s 2021-10-08T19:28:32.317 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:32.317 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.318 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.318 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:32.318 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.318 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:32.319 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:32.319 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:32.319 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3699240886' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:32.319 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-11"}]': finished 2021-10-08T19:28:32.320 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]': finished 2021-10-08T19:28:32.321 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: osdmap e109: 8 total, 8 up, 8 in 2021-10-08T19:28:32.321 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-11", "mode": "writeback"}]: dispatch 2021-10-08T19:28:32.321 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-11", "mode": "writeback"}]: dispatch 2021-10-08T19:28:32.321 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.322 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: pgmap v134: 356 pgs: 356 active+clean; 217 MiB data, 899 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 2 op/s 2021-10-08T19:28:32.322 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:32.322 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.322 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.322 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:32.323 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.323 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:32.323 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:32.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:32 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:32.314Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:32.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:32 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:32.314Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:32.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:32 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:32.315Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:28:32.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:32.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3699240886' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:32.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-11"}]': finished 2021-10-08T19:28:32.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-9"}]': finished 2021-10-08T19:28:32.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: osdmap e109: 8 total, 8 up, 8 in 2021-10-08T19:28:32.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-11", "mode": "writeback"}]: dispatch 2021-10-08T19:28:32.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-11", "mode": "writeback"}]: dispatch 2021-10-08T19:28:32.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: pgmap v134: 356 pgs: 356 active+clean; 217 MiB data, 899 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 2 op/s 2021-10-08T19:28:32.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:32.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:32.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:32.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:32.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:33.510 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: 10.1 deep-scrub ok 2021-10-08T19:28:33.510 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: 10.6 deep-scrub ok 2021-10-08T19:28:33.511 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:33.511 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:33.511 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-11", "mode": "writeback"}]': finished 2021-10-08T19:28:33.511 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-10-08T19:28:33.512 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:33.512 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: osdmap e110: 8 total, 8 up, 8 in 2021-10-08T19:28:33.512 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:33.512 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:33.513 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2807952266' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:33.513 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: 10.1 deep-scrub ok 2021-10-08T19:28:33.513 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: 10.6 deep-scrub ok 2021-10-08T19:28:33.513 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:33.514 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:33.514 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-11", "mode": "writeback"}]': finished 2021-10-08T19:28:33.514 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-10-08T19:28:33.514 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:33.515 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: osdmap e110: 8 total, 8 up, 8 in 2021-10-08T19:28:33.515 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:33.515 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:33.515 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2807952266' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:33.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: 10.1 deep-scrub ok 2021-10-08T19:28:33.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: 10.6 deep-scrub ok 2021-10-08T19:28:33.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:33.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:33.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-11", "mode": "writeback"}]': finished 2021-10-08T19:28:33.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-10-08T19:28:33.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88675-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:33.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: osdmap e110: 8 total, 8 up, 8 in 2021-10-08T19:28:33.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:33.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:33.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2807952266' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:33.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:33.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:33.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:28:34.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: 10.4 deep-scrub ok 2021-10-08T19:28:34.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:28:34.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: pgmap v137: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 899 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 3 op/s 2021-10-08T19:28:34.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2807952266' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:34.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:28:34.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: osdmap e111: 8 total, 8 up, 8 in 2021-10-08T19:28:34.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/783263360' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:34.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:34.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:34.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:34.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:28:34.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: 10.4 deep-scrub ok 2021-10-08T19:28:34.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:28:34.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: pgmap v137: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 899 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 3 op/s 2021-10-08T19:28:34.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2807952266' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:34.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:28:34.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: osdmap e111: 8 total, 8 up, 8 in 2021-10-08T19:28:34.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/783263360' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:34.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:34.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:34.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:34.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:28:34.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: 10.4 deep-scrub ok 2021-10-08T19:28:34.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:28:34.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: pgmap v137: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 899 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 3 op/s 2021-10-08T19:28:34.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2807952266' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:34.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:28:34.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: osdmap e111: 8 total, 8 up, 8 in 2021-10-08T19:28:34.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/783263360' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:34.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:34.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:34.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:28:34.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:34.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:28:35.732 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: 10.8 deep-scrub ok 2021-10-08T19:28:35.733 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: 10.9 deep-scrub ok 2021-10-08T19:28:35.734 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-14"}]': finished 2021-10-08T19:28:35.734 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:35.735 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:28:35.735 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:28:35.736 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: osdmap e112: 8 total, 8 up, 8 in 2021-10-08T19:28:35.736 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:35.736 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:35.737 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:28:35.738 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:35.738 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:35.739 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: 10.8 deep-scrub ok 2021-10-08T19:28:35.740 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: 10.9 deep-scrub ok 2021-10-08T19:28:35.740 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-14"}]': finished 2021-10-08T19:28:35.740 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:35.741 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:28:35.741 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:28:35.741 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: osdmap e112: 8 total, 8 up, 8 in 2021-10-08T19:28:35.742 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:35.742 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:35.742 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:28:35.742 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:35.743 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:35.743 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:35 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:28:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: 10.8 deep-scrub ok 2021-10-08T19:28:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: 10.9 deep-scrub ok 2021-10-08T19:28:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88675-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88675-14"}]': finished 2021-10-08T19:28:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:35.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:28:35.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:28:35.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: osdmap e112: 8 total, 8 up, 8 in 2021-10-08T19:28:35.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:35.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:35.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:28:35.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:35.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11"}]: dispatch 2021-10-08T19:28:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:28:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11"}]': finished 2021-10-08T19:28:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: osdmap e113: 8 total, 8 up, 8 in 2021-10-08T19:28:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1887129627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: pgmap v140: 364 pgs: 40 unknown, 324 active+clean; 217 MiB data, 899 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:37.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:37.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:28:37.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:28:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:37.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1887129627' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:37.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: osdmap e114: 8 total, 8 up, 8 in 2021-10-08T19:28:37.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:37.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2303269434' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:37.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:28:37.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11"}]': finished 2021-10-08T19:28:37.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: osdmap e113: 8 total, 8 up, 8 in 2021-10-08T19:28:37.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:37.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1887129627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: pgmap v140: 364 pgs: 40 unknown, 324 active+clean; 217 MiB data, 899 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:37.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:37.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:37.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:37.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:37.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:37.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:28:37.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:28:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:37.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1887129627' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:37.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: osdmap e114: 8 total, 8 up, 8 in 2021-10-08T19:28:37.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:37.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2303269434' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:28:36 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:28:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:28:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi157-88528-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:28:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-11"}]': finished 2021-10-08T19:28:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: osdmap e113: 8 total, 8 up, 8 in 2021-10-08T19:28:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1887129627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: pgmap v140: 364 pgs: 40 unknown, 324 active+clean; 217 MiB data, 899 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:37.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:37.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:37.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:28:37.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:28:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:37.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1887129627' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:37.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: osdmap e114: 8 total, 8 up, 8 in 2021-10-08T19:28:37.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:37.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2303269434' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:37] "GET /metrics HTTP/1.1" 200 162979 "" "Prometheus/2.18.1" 2021-10-08T19:28:37.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:37.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:37.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[42114]: osdmap e115: 8 total, 8 up, 8 in 2021-10-08T19:28:37.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:37.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[32847]: osdmap e115: 8 total, 8 up, 8 in 2021-10-08T19:28:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:37.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:37.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:37 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:37 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:37 smithi196 ceph-mon[34258]: osdmap e115: 8 total, 8 up, 8 in 2021-10-08T19:28:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:37 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[32847]: pgmap v143: 364 pgs: 32 creating+peering, 32 unknown, 300 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 8.2 KiB/s wr, 11 op/s; 31 B/s, 0 objects/s recovering 2021-10-08T19:28:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pg_num_actual", "val": "31"}]': finished 2021-10-08T19:28:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[32847]: osdmap e116: 8 total, 8 up, 8 in 2021-10-08T19:28:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2812768768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:39.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[42114]: pgmap v143: 364 pgs: 32 creating+peering, 32 unknown, 300 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 8.2 KiB/s wr, 11 op/s; 31 B/s, 0 objects/s recovering 2021-10-08T19:28:39.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:39.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:39.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:39.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pg_num_actual", "val": "31"}]': finished 2021-10-08T19:28:39.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[42114]: osdmap e116: 8 total, 8 up, 8 in 2021-10-08T19:28:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2812768768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:39.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:28:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:38 smithi196 ceph-mon[34258]: pgmap v143: 364 pgs: 32 creating+peering, 32 unknown, 300 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 8.2 KiB/s wr, 11 op/s; 31 B/s, 0 objects/s recovering 2021-10-08T19:28:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:38 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2021-10-08T19:28:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:38 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:38 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pg_num_actual", "val": "31"}]': finished 2021-10-08T19:28:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:38 smithi196 ceph-mon[34258]: osdmap e116: 8 total, 8 up, 8 in 2021-10-08T19:28:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2812768768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:40.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2812768768' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:40.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[32847]: osdmap e117: 8 total, 8 up, 8 in 2021-10-08T19:28:40.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/209535543' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:40.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:40.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:40.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[32847]: pgmap v146: 396 pgs: 96 unknown, 300 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 8.2 KiB/s wr, 11 op/s; 31 B/s, 0 objects/s recovering 2021-10-08T19:28:40.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2812768768' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:40.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[42114]: osdmap e117: 8 total, 8 up, 8 in 2021-10-08T19:28:40.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/209535543' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:40.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:40.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:40.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:40 smithi157 ceph-mon[42114]: pgmap v146: 396 pgs: 96 unknown, 300 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 8.2 KiB/s wr, 11 op/s; 31 B/s, 0 objects/s recovering 2021-10-08T19:28:40.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2812768768' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:40.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:40 smithi196 ceph-mon[34258]: osdmap e117: 8 total, 8 up, 8 in 2021-10-08T19:28:40.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/209535543' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:40.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:40.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:40.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:40 smithi196 ceph-mon[34258]: pgmap v146: 396 pgs: 96 unknown, 300 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 8.2 KiB/s wr, 11 op/s; 31 B/s, 0 objects/s recovering 2021-10-08T19:28:41.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:41.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:41 smithi157 ceph-mon[32847]: osdmap e118: 8 total, 8 up, 8 in 2021-10-08T19:28:41.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:41.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:41.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:41 smithi157 ceph-mon[42114]: osdmap e118: 8 total, 8 up, 8 in 2021-10-08T19:28:41.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:41.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:41.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:41 smithi196 ceph-mon[34258]: osdmap e118: 8 total, 8 up, 8 in 2021-10-08T19:28:41.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:42.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[42114]: osdmap e119: 8 total, 8 up, 8 in 2021-10-08T19:28:42.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2924430540' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:42.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:42.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:42.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[42114]: pgmap v149: 363 pgs: 32 creating+peering, 331 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 104 KiB/s wr, 102 op/s 2021-10-08T19:28:42.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[32847]: osdmap e119: 8 total, 8 up, 8 in 2021-10-08T19:28:42.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2924430540' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:42.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:42.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:42.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:42 smithi157 ceph-mon[32847]: pgmap v149: 363 pgs: 32 creating+peering, 331 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 104 KiB/s wr, 102 op/s 2021-10-08T19:28:42.581 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:42 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:42.315Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:42.581 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:42 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:42.315Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:42.581 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:42 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:42.315Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:28:42.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:42 smithi196 ceph-mon[34258]: osdmap e119: 8 total, 8 up, 8 in 2021-10-08T19:28:42.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2924430540' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:42.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:42.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:42.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:42 smithi196 ceph-mon[34258]: pgmap v149: 363 pgs: 32 creating+peering, 331 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 104 KiB/s wr, 102 op/s 2021-10-08T19:28:43.485 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:43.485 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[32847]: osdmap e120: 8 total, 8 up, 8 in 2021-10-08T19:28:43.486 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:43.486 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/67563952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:43.487 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:43.487 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:43.488 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:43.490 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:43.490 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[42114]: osdmap e120: 8 total, 8 up, 8 in 2021-10-08T19:28:43.491 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:43.491 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/67563952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:43.491 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:43.491 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:43.492 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:43.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:43.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:43.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:43.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:28:43.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:43.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:43 smithi196 ceph-mon[34258]: osdmap e120: 8 total, 8 up, 8 in 2021-10-08T19:28:43.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:43.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/67563952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:43.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:43.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:43.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:28:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[32847]: osdmap e121: 8 total, 8 up, 8 in 2021-10-08T19:28:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:28:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:44.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:28:44.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[32847]: pgmap v152: 355 pgs: 32 unknown, 323 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 96 KiB/s wr, 100 op/s 2021-10-08T19:28:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[42114]: osdmap e121: 8 total, 8 up, 8 in 2021-10-08T19:28:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:28:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:28:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:44 smithi157 ceph-mon[42114]: pgmap v152: 355 pgs: 32 unknown, 323 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 96 KiB/s wr, 100 op/s 2021-10-08T19:28:44.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:28:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:44 smithi196 ceph-mon[34258]: osdmap e121: 8 total, 8 up, 8 in 2021-10-08T19:28:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:28:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:28:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:44 smithi196 ceph-mon[34258]: pgmap v152: 355 pgs: 32 unknown, 323 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 96 KiB/s wr, 100 op/s 2021-10-08T19:28:45.500 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: Running main() from gmock_main.cc 2021-10-08T19:28:45.500 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [==========] Running 12 tests from 4 test suites. 2021-10-08T19:28:45.501 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] Global test environment set-up. 2021-10-08T19:28:45.501 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2021-10-08T19:28:45.501 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2021-10-08T19:28:45.501 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2609 ms) 2021-10-08T19:28:45.502 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2021-10-08T19:28:45.502 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (3050 ms) 2021-10-08T19:28:45.502 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2021-10-08T19:28:45.502 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (1770 ms) 2021-10-08T19:28:45.502 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2021-10-08T19:28:45.503 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (1328 ms) 2021-10-08T19:28:45.503 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (8757 ms total) 2021-10-08T19:28:45.503 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: 2021-10-08T19:28:45.504 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged 2021-10-08T19:28:45.504 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2021-10-08T19:28:45.505 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4438 ms) 2021-10-08T19:28:45.505 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2021-10-08T19:28:45.505 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (3868 ms) 2021-10-08T19:28:45.507 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged (8306 ms total) 2021-10-08T19:28:45.507 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: 2021-10-08T19:28:45.508 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2021-10-08T19:28:45.508 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2021-10-08T19:28:45.509 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (3034 ms) 2021-10-08T19:28:45.509 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2021-10-08T19:28:45.510 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (1992 ms) 2021-10-08T19:28:45.510 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2021-10-08T19:28:45.511 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (1975 ms) 2021-10-08T19:28:45.511 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2021-10-08T19:28:45.511 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2052 ms) 2021-10-08T19:28:45.512 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (9053 ms total) 2021-10-08T19:28:45.512 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: 2021-10-08T19:28:45.513 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2021-10-08T19:28:45.513 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2021-10-08T19:28:45.514 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4008 ms) 2021-10-08T19:28:45.514 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2021-10-08T19:28:45.514 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4007 ms) 2021-10-08T19:28:45.515 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8015 ms total) 2021-10-08T19:28:45.515 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: 2021-10-08T19:28:45.516 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [----------] Global test environment tear-down 2021-10-08T19:28:45.516 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [==========] 12 tests from 4 test suites ran. (57589 ms total) 2021-10-08T19:28:45.517 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots: [ PASSED ] 12 tests. 2021-10-08T19:28:45.518 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:28:45.519 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88958 2021-10-08T19:28:45.526 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88958 2021-10-08T19:28:45.526 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:28:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88515 2021-10-08T19:28:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88515 2021-10-08T19:28:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:28:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88814 2021-10-08T19:28:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88814 2021-10-08T19:28:45.528 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:28:45.528 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88625 2021-10-08T19:28:45.528 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88625 2021-10-08T19:28:45.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:45.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]': finished 2021-10-08T19:28:45.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-13"}]': finished 2021-10-08T19:28:45.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: osdmap e122: 8 total, 8 up, 8 in 2021-10-08T19:28:45.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:45.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:45.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-13", "mode": "writeback"}]: dispatch 2021-10-08T19:28:45.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:45.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-13", "mode": "writeback"}]: dispatch 2021-10-08T19:28:45.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2635027037' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:45.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:45.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:45.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]': finished 2021-10-08T19:28:45.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-13"}]': finished 2021-10-08T19:28:45.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: osdmap e122: 8 total, 8 up, 8 in 2021-10-08T19:28:45.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:45.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:45.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-13", "mode": "writeback"}]: dispatch 2021-10-08T19:28:45.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:45.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-13", "mode": "writeback"}]: dispatch 2021-10-08T19:28:45.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2635027037' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:45.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:45.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88675-14"}]': finished 2021-10-08T19:28:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-13"}]': finished 2021-10-08T19:28:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: osdmap e122: 8 total, 8 up, 8 in 2021-10-08T19:28:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1869066799' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-13", "mode": "writeback"}]: dispatch 2021-10-08T19:28:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]: dispatch 2021-10-08T19:28:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-13", "mode": "writeback"}]: dispatch 2021-10-08T19:28:45.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2635027037' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:45.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:46.755 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:46.755 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]': finished 2021-10-08T19:28:46.755 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-13", "mode": "writeback"}]': finished 2021-10-08T19:28:46.755 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:46.756 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: osdmap e123: 8 total, 8 up, 8 in 2021-10-08T19:28:46.756 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:46.756 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4057888429' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:46.756 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: pgmap v155: 387 pgs: 64 unknown, 323 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:46.757 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:28:46.757 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:28:46.757 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:28:46.757 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:28:46.757 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:28:46.758 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:28:46.758 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:28:46.759 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:28:46.759 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:28:46.759 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:28:46.759 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: 94.6 scrub ok 2021-10-08T19:28:46.759 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4057888429' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:46.760 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: osdmap e124: 8 total, 8 up, 8 in 2021-10-08T19:28:46.760 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:46.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:46.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]': finished 2021-10-08T19:28:46.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-13", "mode": "writeback"}]': finished 2021-10-08T19:28:46.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:46.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: osdmap e123: 8 total, 8 up, 8 in 2021-10-08T19:28:46.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:46.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4057888429' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:46.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: pgmap v155: 387 pgs: 64 unknown, 323 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:46.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:28:46.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:28:46.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:28:46.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:28:46.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:28:46.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:28:46.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:28:46.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:28:46.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:28:46.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:28:46.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: 94.6 scrub ok 2021-10-08T19:28:46.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4057888429' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:46.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: osdmap e124: 8 total, 8 up, 8 in 2021-10-08T19:28:46.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:46.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:28:46.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88675-14"}]': finished 2021-10-08T19:28:46.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-13", "mode": "writeback"}]': finished 2021-10-08T19:28:46.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:46.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: osdmap e123: 8 total, 8 up, 8 in 2021-10-08T19:28:46.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:46.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4057888429' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:46.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: pgmap v155: 387 pgs: 64 unknown, 323 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:46.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:28:46.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:28:46.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:28:46.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:28:46.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:28:46.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:28:46.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:28:46.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:28:46.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:28:46.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:28:46.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: 94.6 scrub ok 2021-10-08T19:28:46.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4057888429' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:46.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: osdmap e124: 8 total, 8 up, 8 in 2021-10-08T19:28:46.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:47.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:28:46 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:28:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:47] "GET /metrics HTTP/1.1" 200 162979 "" "Prometheus/2.18.1" 2021-10-08T19:28:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:28:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:28:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:28:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:28:47.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:28:47.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:28:47.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:28:47.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:28:47.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:28:47.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:28:47.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:47.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: osdmap e125: 8 total, 8 up, 8 in 2021-10-08T19:28:47.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:47.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3565432113' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:47.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:47.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:28:47.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:28:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:28:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:28:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:28:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:28:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:28:47.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:28:47.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:28:47.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:28:47.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:47.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: osdmap e125: 8 total, 8 up, 8 in 2021-10-08T19:28:47.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:47.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3565432113' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:47.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:47.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:28:47.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:28:47.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:28:47.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:28:47.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:28:47.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:28:47.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:28:47.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:28:47.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:28:47.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:28:47.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:47.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: osdmap e125: 8 total, 8 up, 8 in 2021-10-08T19:28:47.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:47.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3565432113' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:47.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:48.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[32847]: pgmap v158: 355 pgs: 32 unknown, 323 active+clean; 217 MiB data, 924 MiB used, 714 GiB / 715 GiB avail; 57 KiB/s rd, 25 KiB/s wr, 101 op/s 2021-10-08T19:28:48.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[32847]: 94.0 scrub ok 2021-10-08T19:28:48.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:48.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[32847]: osdmap e126: 8 total, 8 up, 8 in 2021-10-08T19:28:48.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:48.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3347034123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:48.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:48.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[42114]: pgmap v158: 355 pgs: 32 unknown, 323 active+clean; 217 MiB data, 924 MiB used, 714 GiB / 715 GiB avail; 57 KiB/s rd, 25 KiB/s wr, 101 op/s 2021-10-08T19:28:48.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[42114]: 94.0 scrub ok 2021-10-08T19:28:48.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:48.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[42114]: osdmap e126: 8 total, 8 up, 8 in 2021-10-08T19:28:48.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:48.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3347034123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:48.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:48 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:48.866 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:28:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:48.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:48 smithi196 ceph-mon[34258]: pgmap v158: 355 pgs: 32 unknown, 323 active+clean; 217 MiB data, 924 MiB used, 714 GiB / 715 GiB avail; 57 KiB/s rd, 25 KiB/s wr, 101 op/s 2021-10-08T19:28:48.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:48 smithi196 ceph-mon[34258]: 94.0 scrub ok 2021-10-08T19:28:48.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:48 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:48.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:48 smithi196 ceph-mon[34258]: osdmap e126: 8 total, 8 up, 8 in 2021-10-08T19:28:48.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:48.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3347034123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:48.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:48 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:49.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[42114]: 94.8 scrub ok 2021-10-08T19:28:49.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[42114]: 94.3 scrub ok 2021-10-08T19:28:49.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[42114]: 94.1 scrub ok 2021-10-08T19:28:49.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[42114]: 94.4 scrub ok 2021-10-08T19:28:49.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:49.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[42114]: osdmap e127: 8 total, 8 up, 8 in 2021-10-08T19:28:49.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:49.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[32847]: 94.8 scrub ok 2021-10-08T19:28:49.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[32847]: 94.3 scrub ok 2021-10-08T19:28:49.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[32847]: 94.1 scrub ok 2021-10-08T19:28:49.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[32847]: 94.4 scrub ok 2021-10-08T19:28:49.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:49.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[32847]: osdmap e127: 8 total, 8 up, 8 in 2021-10-08T19:28:49.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:49.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:49 smithi196 ceph-mon[34258]: 94.8 scrub ok 2021-10-08T19:28:49.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:49 smithi196 ceph-mon[34258]: 94.3 scrub ok 2021-10-08T19:28:49.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:49 smithi196 ceph-mon[34258]: 94.1 scrub ok 2021-10-08T19:28:49.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:49 smithi196 ceph-mon[34258]: 94.4 scrub ok 2021-10-08T19:28:49.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:49.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:49 smithi196 ceph-mon[34258]: osdmap e127: 8 total, 8 up, 8 in 2021-10-08T19:28:49.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:51.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: pgmap v161: 323 pgs: 32 unknown, 291 active+clean; 217 MiB data, 924 MiB used, 714 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 91 op/s 2021-10-08T19:28:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:51.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:51.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: 94.2 scrub ok 2021-10-08T19:28:51.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:51.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: osdmap e128: 8 total, 8 up, 8 in 2021-10-08T19:28:51.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:51.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3788331679' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:51.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:51.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: pgmap v161: 323 pgs: 32 unknown, 291 active+clean; 217 MiB data, 924 MiB used, 714 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 91 op/s 2021-10-08T19:28:51.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:51.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:51.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: 94.2 scrub ok 2021-10-08T19:28:51.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:51.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: osdmap e128: 8 total, 8 up, 8 in 2021-10-08T19:28:51.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:51.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3788331679' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:51.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: pgmap v161: 323 pgs: 32 unknown, 291 active+clean; 217 MiB data, 924 MiB used, 714 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 91 op/s 2021-10-08T19:28:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:51.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:51.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: 94.2 scrub ok 2021-10-08T19:28:51.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:51.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: osdmap e128: 8 total, 8 up, 8 in 2021-10-08T19:28:51.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:51.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:28:51.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3788331679' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:51.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[32847]: pgmap v164: 355 pgs: 20 creating+peering, 12 unknown, 323 active+clean; 217 MiB data, 904 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:52.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:52.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[32847]: osdmap e129: 8 total, 8 up, 8 in 2021-10-08T19:28:52.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:52.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3813678472' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[42114]: pgmap v164: 355 pgs: 20 creating+peering, 12 unknown, 323 active+clean; 217 MiB data, 904 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:52.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:52.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[42114]: osdmap e129: 8 total, 8 up, 8 in 2021-10-08T19:28:52.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:52.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3813678472' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.581 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:52 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:52.315Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:52.581 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:52 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:52.315Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:52.582 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:52 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:52.315Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:28:52.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:52 smithi196 ceph-mon[34258]: pgmap v164: 355 pgs: 20 creating+peering, 12 unknown, 323 active+clean; 217 MiB data, 904 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:52 smithi196 ceph-mon[34258]: osdmap e129: 8 total, 8 up, 8 in 2021-10-08T19:28:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:52.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3813678472' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-14"}]': finished 2021-10-08T19:28:53.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3813678472' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:53 smithi157 ceph-mon[42114]: osdmap e130: 8 total, 8 up, 8 in 2021-10-08T19:28:53.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:53.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:53.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:53.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:28:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:28:53.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:28:53.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-14"}]': finished 2021-10-08T19:28:53.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3813678472' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:53 smithi157 ceph-mon[32847]: osdmap e130: 8 total, 8 up, 8 in 2021-10-08T19:28:53.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-14"}]': finished 2021-10-08T19:28:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3813678472' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:53 smithi196 ceph-mon[34258]: osdmap e130: 8 total, 8 up, 8 in 2021-10-08T19:28:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:54.520 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:54 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:28:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:54.520 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[32847]: osdmap e131: 8 total, 8 up, 8 in 2021-10-08T19:28:54.521 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2626576223' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.521 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.521 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[32847]: pgmap v167: 331 pgs: 40 unknown, 291 active+clean; 217 MiB data, 904 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:54.522 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:54.522 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:54.523 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[42114]: osdmap e131: 8 total, 8 up, 8 in 2021-10-08T19:28:54.523 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2626576223' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.523 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.524 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[42114]: pgmap v167: 331 pgs: 40 unknown, 291 active+clean; 217 MiB data, 904 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:54.524 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:54.524 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:54 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:54.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:54 smithi196 ceph-mon[34258]: osdmap e131: 8 total, 8 up, 8 in 2021-10-08T19:28:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2626576223' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:54 smithi196 ceph-mon[34258]: pgmap v167: 331 pgs: 40 unknown, 291 active+clean; 217 MiB data, 904 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:54 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:28:55.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:55.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:28:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:55.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:55.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[32847]: osdmap e132: 8 total, 8 up, 8 in 2021-10-08T19:28:55.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/484867793' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:55.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:55.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:28:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:55.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:55.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[42114]: osdmap e132: 8 total, 8 up, 8 in 2021-10-08T19:28:55.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/484867793' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:55.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:55 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:28:55.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:55 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:28:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:55.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:55.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:55 smithi196 ceph-mon[34258]: osdmap e132: 8 total, 8 up, 8 in 2021-10-08T19:28:55.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/484867793' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:56.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.541 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:56 smithi157 ceph-mon[32847]: osdmap e133: 8 total, 8 up, 8 in 2021-10-08T19:28:56.542 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:56 smithi157 ceph-mon[32847]: pgmap v170: 331 pgs: 40 unknown, 291 active+clean; 217 MiB data, 904 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:56.542 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:56.820 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.821 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:56 smithi196 ceph-mon[34258]: osdmap e133: 8 total, 8 up, 8 in 2021-10-08T19:28:56.821 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:56 smithi196 ceph-mon[34258]: pgmap v170: 331 pgs: 40 unknown, 291 active+clean; 217 MiB data, 904 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:56.821 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:56.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:56 smithi157 ceph-mon[42114]: osdmap e133: 8 total, 8 up, 8 in 2021-10-08T19:28:56.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:56 smithi157 ceph-mon[42114]: pgmap v170: 331 pgs: 40 unknown, 291 active+clean; 217 MiB data, 904 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:28:56.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:57.116 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:28:56 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:28:57.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:28:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:57] "GET /metrics HTTP/1.1" 200 160890 "" "Prometheus/2.18.1" 2021-10-08T19:28:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[32847]: osdmap e134: 8 total, 8 up, 8 in 2021-10-08T19:28:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/525048404' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:57.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-10-08T19:28:57.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:57.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:57.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[42114]: osdmap e134: 8 total, 8 up, 8 in 2021-10-08T19:28:57.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/525048404' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:57.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:57.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:57.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-10-08T19:28:57.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:57.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:57.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:57 smithi196 ceph-mon[34258]: osdmap e134: 8 total, 8 up, 8 in 2021-10-08T19:28:57.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/525048404' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:57.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:57.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:57 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:57.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-10-08T19:28:57.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:57.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:58.867 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:28:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:28:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:58.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/525048404' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: osdmap e135: 8 total, 8 up, 8 in 2021-10-08T19:28:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/990729276' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:58.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2"}]: dispatch 2021-10-08T19:28:58.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:58.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:58.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: pgmap v173: 363 pgs: 32 unknown, 32 creating+peering, 299 active+clean; 217 MiB data, 900 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:28:58.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:58.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/990729276' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:58.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:58.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:58 smithi196 ceph-mon[34258]: osdmap e136: 8 total, 8 up, 8 in 2021-10-08T19:28:59.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/525048404' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: osdmap e135: 8 total, 8 up, 8 in 2021-10-08T19:28:59.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/990729276' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:59.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2"}]: dispatch 2021-10-08T19:28:59.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:59.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:59.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: pgmap v173: 363 pgs: 32 unknown, 32 creating+peering, 299 active+clean; 217 MiB data, 900 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:28:59.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:59.061 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/990729276' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.061 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.061 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[42114]: osdmap e136: 8 total, 8 up, 8 in 2021-10-08T19:28:59.061 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/525048404' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.062 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.062 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: osdmap e135: 8 total, 8 up, 8 in 2021-10-08T19:28:59.062 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/990729276' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:59.062 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2"}]: dispatch 2021-10-08T19:28:59.063 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:59.063 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:59.063 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: pgmap v173: 363 pgs: 32 unknown, 32 creating+peering, 299 active+clean; 217 MiB data, 900 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:28:59.063 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:59.064 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/990729276' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.064 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.064 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:58 smithi157 ceph-mon[32847]: osdmap e136: 8 total, 8 up, 8 in 2021-10-08T19:29:00.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: 94.5 scrub ok 2021-10-08T19:29:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:00.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:00.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:00.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:29:00.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: osdmap e137: 8 total, 8 up, 8 in 2021-10-08T19:29:00.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/756064098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:00.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:00.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: 94.5 scrub ok 2021-10-08T19:29:00.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:00.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:00.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:00.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:00.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:00.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:29:00.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: osdmap e137: 8 total, 8 up, 8 in 2021-10-08T19:29:00.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/756064098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:00.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:28:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:00.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: 94.5 scrub ok 2021-10-08T19:29:00.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:00.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:00.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:29:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: osdmap e137: 8 total, 8 up, 8 in 2021-10-08T19:29:00.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/756064098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:00.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:28:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:01.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: pgmap v176: 331 pgs: 32 unknown, 299 active+clean; 217 MiB data, 900 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:29:01.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: 94.9 scrub ok 2021-10-08T19:29:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:29:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: osdmap e138: 8 total, 8 up, 8 in 2021-10-08T19:29:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/639753907' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: pgmap v176: 331 pgs: 32 unknown, 299 active+clean; 217 MiB data, 900 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:29:01.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:01.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: 94.9 scrub ok 2021-10-08T19:29:01.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:01.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:29:01.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: osdmap e138: 8 total, 8 up, 8 in 2021-10-08T19:29:01.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:01.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:01.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/639753907' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: pgmap v176: 331 pgs: 32 unknown, 299 active+clean; 217 MiB data, 900 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:29:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: 94.9 scrub ok 2021-10-08T19:29:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:29:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: osdmap e138: 8 total, 8 up, 8 in 2021-10-08T19:29:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2430560742' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/639753907' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:02.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:02.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[32847]: 94.7 scrub ok 2021-10-08T19:29:02.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:29:02.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:02.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[32847]: osdmap e139: 8 total, 8 up, 8 in 2021-10-08T19:29:02.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:02.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[42114]: 94.7 scrub ok 2021-10-08T19:29:02.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:29:02.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:02.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:01 smithi157 ceph-mon[42114]: osdmap e139: 8 total, 8 up, 8 in 2021-10-08T19:29:02.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:01 smithi196 ceph-mon[34258]: 94.7 scrub ok 2021-10-08T19:29:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi157-88558-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:29:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:01 smithi196 ceph-mon[34258]: osdmap e139: 8 total, 8 up, 8 in 2021-10-08T19:29:02.461 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2021-10-08T19:29:02.461 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] Global test environment set-up. 2021-10-08T19:29:02.461 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2021-10-08T19:29:02.462 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2021-10-08T19:29:02.462 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2021-10-08T19:29:02.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-10-08T19:29:02.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: 2021-10-08T19:29:02.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2021-10-08T19:29:02.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: seed 88558 2021-10-08T19:29:02.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2021-10-08T19:29:02.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (9 ms) 2021-10-08T19:29:02.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2021-10-08T19:29:02.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (121 ms) 2021-10-08T19:29:02.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2021-10-08T19:29:02.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (5 ms) 2021-10-08T19:29:02.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2021-10-08T19:29:02.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (5 ms) 2021-10-08T19:29:02.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2021-10-08T19:29:02.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (6 ms) 2021-10-08T19:29:02.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2021-10-08T19:29:02.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (1 ms) 2021-10-08T19:29:02.467 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2021-10-08T19:29:02.467 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (1 ms) 2021-10-08T19:29:02.467 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2021-10-08T19:29:02.467 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (4 ms) 2021-10-08T19:29:02.468 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2021-10-08T19:29:02.468 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (1 ms) 2021-10-08T19:29:02.468 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2021-10-08T19:29:02.468 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (6 ms) 2021-10-08T19:29:02.469 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2021-10-08T19:29:02.469 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (1 ms) 2021-10-08T19:29:02.469 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2021-10-08T19:29:02.469 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (4 ms) 2021-10-08T19:29:02.470 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2021-10-08T19:29:02.470 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (5 ms) 2021-10-08T19:29:02.470 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2021-10-08T19:29:02.470 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: osd_max_attr_size = 0 2021-10-08T19:29:02.470 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2021-10-08T19:29:02.471 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (1612 ms) 2021-10-08T19:29:02.471 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2021-10-08T19:29:02.471 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (452 ms) 2021-10-08T19:29:02.471 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2021-10-08T19:29:02.472 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: waiting for initial deep scrubs... 2021-10-08T19:29:02.472 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: done waiting, doing copies 2021-10-08T19:29:02.473 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: waiting for final deep scrubs... 2021-10-08T19:29:02.473 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: done waiting 2021-10-08T19:29:02.473 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60745 ms) 2021-10-08T19:29:02.473 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2021-10-08T19:29:02.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (6 ms) 2021-10-08T19:29:02.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2021-10-08T19:29:02.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (2 ms) 2021-10-08T19:29:02.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2021-10-08T19:29:02.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4216 ms) 2021-10-08T19:29:02.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2021-10-08T19:29:02.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2021-10-08T19:29:02.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2021-10-08T19:29:02.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2021-10-08T19:29:02.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2021-10-08T19:29:02.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2021-10-08T19:29:02.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:02 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:29:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:02.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:02 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:02.315Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:02.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:02 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:02.315Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:02.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:02 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:02.315Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:29:03.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: pgmap v179: 331 pgs: 13 creating+activating, 318 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:29:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: osdmap e140: 8 total, 8 up, 8 in 2021-10-08T19:29:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3201903226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:03.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:03.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:03.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: pgmap v179: 331 pgs: 13 creating+activating, 318 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:29:03.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:03.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:03.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: osdmap e140: 8 total, 8 up, 8 in 2021-10-08T19:29:03.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3201903226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:03.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:03.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:03.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: pgmap v179: 331 pgs: 13 creating+activating, 318 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:29:03.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:03.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:03.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: osdmap e140: 8 total, 8 up, 8 in 2021-10-08T19:29:03.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3201903226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:03.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:03.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:03.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:03.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:03.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:03.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:29:03.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:29:03.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:29:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:03.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:03.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:03.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]': finished 2021-10-08T19:29:03.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:03.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: osdmap e141: 8 total, 8 up, 8 in 2021-10-08T19:29:03.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:03.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3197642700' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:29:03.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:29:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:03.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:03.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:03.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]': finished 2021-10-08T19:29:03.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:03.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: osdmap e141: 8 total, 8 up, 8 in 2021-10-08T19:29:03.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:03.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:03.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3197642700' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:04.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:29:04.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:29:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:04.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:04.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-14"}]': finished 2021-10-08T19:29:04.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:04.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: osdmap e141: 8 total, 8 up, 8 in 2021-10-08T19:29:04.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:04.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2541921569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:04.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]: dispatch 2021-10-08T19:29:04.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3197642700' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:04.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[32847]: pgmap v182: 323 pgs: 64 unknown, 259 active+clean; 592 KiB data, 887 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:05.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[32847]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:05.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]': finished 2021-10-08T19:29:05.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:05.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[32847]: osdmap e142: 8 total, 8 up, 8 in 2021-10-08T19:29:05.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:05.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:05.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[42114]: pgmap v182: 323 pgs: 64 unknown, 259 active+clean; 592 KiB data, 887 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:05.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:05.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[42114]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:05.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]': finished 2021-10-08T19:29:05.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:05.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[42114]: osdmap e142: 8 total, 8 up, 8 in 2021-10-08T19:29:05.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:05.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:04 smithi196 ceph-mon[34258]: pgmap v182: 323 pgs: 64 unknown, 259 active+clean; 592 KiB data, 887 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:04 smithi196 ceph-mon[34258]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:05.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-14"}]': finished 2021-10-08T19:29:05.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:05.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:04 smithi196 ceph-mon[34258]: osdmap e142: 8 total, 8 up, 8 in 2021-10-08T19:29:05.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:05.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:06.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-24"}]': finished 2021-10-08T19:29:06.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:06.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: osdmap e143: 8 total, 8 up, 8 in 2021-10-08T19:29:06.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/675542725' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[42114]: pgmap v185: 299 pgs: 40 unknown, 259 active+clean; 592 KiB data, 887 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:06.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.337 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:06.337 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.337 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.337 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-24"}]': finished 2021-10-08T19:29:06.338 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:06.338 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: osdmap e143: 8 total, 8 up, 8 in 2021-10-08T19:29:06.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/675542725' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.339 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:05 smithi157 ceph-mon[32847]: pgmap v185: 299 pgs: 40 unknown, 259 active+clean; 592 KiB data, 887 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:06.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-24"}]': finished 2021-10-08T19:29:06.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88687-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:06.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: osdmap e143: 8 total, 8 up, 8 in 2021-10-08T19:29:06.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:06.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/675542725' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:05 smithi196 ceph-mon[34258]: pgmap v185: 299 pgs: 40 unknown, 259 active+clean; 592 KiB data, 887 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:07.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:29:06 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:29:07.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:07.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/675542725' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:07.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:06 smithi196 ceph-mon[34258]: osdmap e144: 8 total, 8 up, 8 in 2021-10-08T19:29:07.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/754640484' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:07.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:07.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:06 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:07.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/675542725' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:07.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[32847]: osdmap e144: 8 total, 8 up, 8 in 2021-10-08T19:29:07.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/754640484' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:07.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:07.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:07.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:07.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:07.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/675542725' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:07.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[42114]: osdmap e144: 8 total, 8 up, 8 in 2021-10-08T19:29:07.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/754640484' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:07.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:07.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:07.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:06 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:07] "GET /metrics HTTP/1.1" 200 160824 "" "Prometheus/2.18.1" 2021-10-08T19:29:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-19"}]': finished 2021-10-08T19:29:08.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:08.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:08.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[32847]: osdmap e145: 8 total, 8 up, 8 in 2021-10-08T19:29:08.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:08.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[32847]: pgmap v188: 339 pgs: 42 creating+peering, 30 unknown, 267 active+clean; 592 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:08.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:08.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-19"}]': finished 2021-10-08T19:29:08.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:08.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:08.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[42114]: osdmap e145: 8 total, 8 up, 8 in 2021-10-08T19:29:08.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:08.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:07 smithi157 ceph-mon[42114]: pgmap v188: 339 pgs: 42 creating+peering, 30 unknown, 267 active+clean; 592 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88687-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88687-19"}]': finished 2021-10-08T19:29:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88488-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:08.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:07 smithi196 ceph-mon[34258]: osdmap e145: 8 total, 8 up, 8 in 2021-10-08T19:29:08.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:08.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:07 smithi196 ceph-mon[34258]: pgmap v188: 339 pgs: 42 creating+peering, 30 unknown, 267 active+clean; 592 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:08.969 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:29:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:09.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:09.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[32847]: osdmap e146: 8 total, 8 up, 8 in 2021-10-08T19:29:09.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/442959385' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:09.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:09.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:09.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:09.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:09.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:09.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[42114]: osdmap e146: 8 total, 8 up, 8 in 2021-10-08T19:29:09.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/442959385' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:09.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:09.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:09.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:08 smithi196 ceph-mon[34258]: osdmap e146: 8 total, 8 up, 8 in 2021-10-08T19:29:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/442959385' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:09.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:09.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:10.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/442959385' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:10.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:10.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[32847]: osdmap e147: 8 total, 8 up, 8 in 2021-10-08T19:29:10.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:10.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[32847]: pgmap v191: 307 pgs: 40 unknown, 267 active+clean; 592 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:10.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:10.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/442959385' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:10.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:10.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[42114]: osdmap e147: 8 total, 8 up, 8 in 2021-10-08T19:29:10.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:10.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[42114]: pgmap v191: 307 pgs: 40 unknown, 267 active+clean; 592 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:10.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/442959385' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:10 smithi196 ceph-mon[34258]: osdmap e147: 8 total, 8 up, 8 in 2021-10-08T19:29:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:10.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:10 smithi196 ceph-mon[34258]: pgmap v191: 307 pgs: 40 unknown, 267 active+clean; 592 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:10.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:11.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:11 smithi157 ceph-mon[32847]: osdmap e148: 8 total, 8 up, 8 in 2021-10-08T19:29:11.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:11.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:11.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:11 smithi157 ceph-mon[42114]: osdmap e148: 8 total, 8 up, 8 in 2021-10-08T19:29:11.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:11.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:11.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:11 smithi196 ceph-mon[34258]: osdmap e148: 8 total, 8 up, 8 in 2021-10-08T19:29:11.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:11.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:12.578 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:12 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:12.315Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:12.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:12 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:12.315Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:12.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:12 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:12.316Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:29:12.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-25"}]': finished 2021-10-08T19:29:12.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-24"}]': finished 2021-10-08T19:29:12.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[32847]: osdmap e149: 8 total, 8 up, 8 in 2021-10-08T19:29:12.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:12.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2581782564' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[32847]: pgmap v194: 307 pgs: 40 creating+peering, 267 active+clean; 592 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-10-08T19:29:12.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:12.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-25"}]': finished 2021-10-08T19:29:12.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-24"}]': finished 2021-10-08T19:29:12.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[42114]: osdmap e149: 8 total, 8 up, 8 in 2021-10-08T19:29:12.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:12.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2581782564' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[42114]: pgmap v194: 307 pgs: 40 creating+peering, 267 active+clean; 592 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-10-08T19:29:12.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-25"}]': finished 2021-10-08T19:29:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-24"}]': finished 2021-10-08T19:29:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:12 smithi196 ceph-mon[34258]: osdmap e149: 8 total, 8 up, 8 in 2021-10-08T19:29:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-24"}]: dispatch 2021-10-08T19:29:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2581782564' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:12 smithi196 ceph-mon[34258]: pgmap v194: 307 pgs: 40 creating+peering, 267 active+clean; 592 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-10-08T19:29:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:13.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-24"}]': finished 2021-10-08T19:29:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:13 smithi157 ceph-mon[32847]: osdmap e150: 8 total, 8 up, 8 in 2021-10-08T19:29:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:13.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-24"}]': finished 2021-10-08T19:29:13.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:13.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:13 smithi157 ceph-mon[42114]: osdmap e150: 8 total, 8 up, 8 in 2021-10-08T19:29:13.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:13.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:13.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:13.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:13.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:13.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:13.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:29:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3720390816' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-24"}]': finished 2021-10-08T19:29:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:13 smithi196 ceph-mon[34258]: osdmap e150: 8 total, 8 up, 8 in 2021-10-08T19:29:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:14.812 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: osdmap e151: 8 total, 8 up, 8 in 2021-10-08T19:29:14.813 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:14.813 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/305343409' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.813 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: pgmap v197: 299 pgs: 32 unknown, 267 active+clean; 592 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-10-08T19:29:14.813 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:14.814 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-25"}]': finished 2021-10-08T19:29:14.814 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/305343409' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:14.814 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: osdmap e152: 8 total, 8 up, 8 in 2021-10-08T19:29:14.814 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:14.814 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3457370697' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: osdmap e151: 8 total, 8 up, 8 in 2021-10-08T19:29:14.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:14.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/305343409' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: pgmap v197: 299 pgs: 32 unknown, 267 active+clean; 592 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-10-08T19:29:14.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:14.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-25"}]': finished 2021-10-08T19:29:14.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/305343409' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:14.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: osdmap e152: 8 total, 8 up, 8 in 2021-10-08T19:29:14.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:14.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3457370697' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: osdmap e151: 8 total, 8 up, 8 in 2021-10-08T19:29:14.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:14.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/305343409' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: pgmap v197: 299 pgs: 32 unknown, 267 active+clean; 592 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-10-08T19:29:14.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:14.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-25"}]': finished 2021-10-08T19:29:14.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/305343409' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:14.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: osdmap e152: 8 total, 8 up, 8 in 2021-10-08T19:29:14.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-25"}]: dispatch 2021-10-08T19:29:14.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3457370697' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:16.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-25"}]': finished 2021-10-08T19:29:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3457370697' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:15 smithi157 ceph-mon[32847]: osdmap e153: 8 total, 8 up, 8 in 2021-10-08T19:29:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-25"}]': finished 2021-10-08T19:29:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3457370697' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:15 smithi157 ceph-mon[42114]: osdmap e153: 8 total, 8 up, 8 in 2021-10-08T19:29:16.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3629244632' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-25"}]': finished 2021-10-08T19:29:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3457370697' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:15 smithi196 ceph-mon[34258]: osdmap e153: 8 total, 8 up, 8 in 2021-10-08T19:29:17.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: pgmap v200: 299 pgs: 32 unknown, 267 active+clean; 592 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:17.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:17.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: osdmap e154: 8 total, 8 up, 8 in 2021-10-08T19:29:17.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2504666257' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:17.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: pgmap v200: 299 pgs: 32 unknown, 267 active+clean; 592 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:17.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:17.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:17.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:17.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: osdmap e154: 8 total, 8 up, 8 in 2021-10-08T19:29:17.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2504666257' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:17.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.116 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:29:16 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:29:17.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: pgmap v200: 299 pgs: 32 unknown, 267 active+clean; 592 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: osdmap e154: 8 total, 8 up, 8 in 2021-10-08T19:29:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2504666257' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:17.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:17.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:17] "GET /metrics HTTP/1.1" 200 160824 "" "Prometheus/2.18.1" 2021-10-08T19:29:17.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:17.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:17.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2504666257' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:17.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[42114]: osdmap e155: 8 total, 8 up, 8 in 2021-10-08T19:29:17.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2536931847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:17.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:17.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:17.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:17.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2504666257' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:17.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[32847]: osdmap e155: 8 total, 8 up, 8 in 2021-10-08T19:29:17.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2536931847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:17.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:17 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2504666257' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:17.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:17 smithi196 ceph-mon[34258]: osdmap e155: 8 total, 8 up, 8 in 2021-10-08T19:29:17.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2536931847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:17.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[32847]: pgmap v203: 331 pgs: 32 unknown, 32 creating+peering, 267 active+clean; 622 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2021-10-08T19:29:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:19.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-26"}]': finished 2021-10-08T19:29:19.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[32847]: osdmap e156: 8 total, 8 up, 8 in 2021-10-08T19:29:19.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[42114]: pgmap v203: 331 pgs: 32 unknown, 32 creating+peering, 267 active+clean; 622 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2021-10-08T19:29:19.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:19.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:19.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-26"}]': finished 2021-10-08T19:29:19.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:18 smithi157 ceph-mon[42114]: osdmap e156: 8 total, 8 up, 8 in 2021-10-08T19:29:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:18 smithi196 ceph-mon[34258]: pgmap v203: 331 pgs: 32 unknown, 32 creating+peering, 267 active+clean; 622 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2021-10-08T19:29:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:18 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-26"}]': finished 2021-10-08T19:29:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:18 smithi196 ceph-mon[34258]: osdmap e156: 8 total, 8 up, 8 in 2021-10-08T19:29:19.120 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:29:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:20.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:20.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[42114]: osdmap e157: 8 total, 8 up, 8 in 2021-10-08T19:29:20.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2616118822' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:20.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:20.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:20.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[32847]: osdmap e157: 8 total, 8 up, 8 in 2021-10-08T19:29:20.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2616118822' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:20.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:20.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:20.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:19 smithi196 ceph-mon[34258]: osdmap e157: 8 total, 8 up, 8 in 2021-10-08T19:29:20.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2616118822' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:20.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:21.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: pgmap v206: 307 pgs: 40 unknown, 267 active+clean; 622 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2021-10-08T19:29:21.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:21.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:21.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:21.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: osdmap e158: 8 total, 8 up, 8 in 2021-10-08T19:29:21.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:21.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:21.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:29:21.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:29:21.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:21.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:21.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/979735936' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: pgmap v206: 307 pgs: 40 unknown, 267 active+clean; 622 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2021-10-08T19:29:21.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:21.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:21.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:21.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: osdmap e158: 8 total, 8 up, 8 in 2021-10-08T19:29:21.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:21.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:21.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:29:21.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:29:21.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:21.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:21.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/979735936' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: pgmap v206: 307 pgs: 40 unknown, 267 active+clean; 622 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2021-10-08T19:29:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88558-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:21.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:21.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: osdmap e158: 8 total, 8 up, 8 in 2021-10-08T19:29:21.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:21.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:21.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:29:21.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13"}]: dispatch 2021-10-08T19:29:21.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:21.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:21.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/979735936' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:22.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:21 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:29:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]': finished 2021-10-08T19:29:22.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13"}]': finished 2021-10-08T19:29:22.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]': finished 2021-10-08T19:29:22.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:22.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: osdmap e159: 8 total, 8 up, 8 in 2021-10-08T19:29:22.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:22.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:22.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:22.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:22.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:22.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:22.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2021-10-08T19:29:22.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2021-10-08T19:29:22.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:22.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:22.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]': finished 2021-10-08T19:29:22.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13"}]': finished 2021-10-08T19:29:22.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]': finished 2021-10-08T19:29:22.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:22.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: osdmap e159: 8 total, 8 up, 8 in 2021-10-08T19:29:22.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:22.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:22.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:22.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:22.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:22.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:22.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2021-10-08T19:29:22.088 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:21 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2021-10-08T19:29:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88687-19"}]': finished 2021-10-08T19:29:22.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-13"}]': finished 2021-10-08T19:29:22.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-26"}]': finished 2021-10-08T19:29:22.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:22.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: osdmap e159: 8 total, 8 up, 8 in 2021-10-08T19:29:22.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/970686031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:22.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]: dispatch 2021-10-08T19:29:22.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1469394378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:22.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]: dispatch 2021-10-08T19:29:22.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:22.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:22.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:22.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2021-10-08T19:29:22.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:21 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2021-10-08T19:29:22.461 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP (67 api_aio: Running main() from gmock_main.cc 2021-10-08T19:29:22.462 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [==========] Running 40 tests from 2 test suites. 2021-10-08T19:29:22.462 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [----------] Global test environment set-up. 2021-10-08T19:29:22.462 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [----------] 24 tests from LibRadosAio 2021-10-08T19:29:22.462 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2021-10-08T19:29:22.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.TooBig (8722 ms) 2021-10-08T19:29:22.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2021-10-08T19:29:22.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (4352 ms) 2021-10-08T19:29:22.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2021-10-08T19:29:22.463 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (2792 ms) 2021-10-08T19:29:22.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2021-10-08T19:29:22.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3317 ms) 2021-10-08T19:29:22.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2021-10-08T19:29:22.464 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3160 ms) 2021-10-08T19:29:22.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2021-10-08T19:29:22.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3281 ms) 2021-10-08T19:29:22.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2021-10-08T19:29:22.465 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3832 ms) 2021-10-08T19:29:22.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2021-10-08T19:29:22.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3170 ms) 2021-10-08T19:29:22.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2021-10-08T19:29:22.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3055 ms) 2021-10-08T19:29:22.466 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2021-10-08T19:29:22.467 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2916 ms) 2021-10-08T19:29:22.467 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2021-10-08T19:29:22.467 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2982 ms) 2021-10-08T19:29:22.467 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2021-10-08T19:29:22.468 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3021 ms) 2021-10-08T19:29:22.468 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2021-10-08T19:29:22.468 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2975 ms) 2021-10-08T19:29:22.468 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2021-10-08T19:29:22.468 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3025 ms) 2021-10-08T19:29:22.469 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2021-10-08T19:29:22.469 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.Flush (2996 ms) 2021-10-08T19:29:22.469 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2021-10-08T19:29:22.469 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3043 ms) 2021-10-08T19:29:22.470 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2021-10-08T19:29:22.470 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (2998 ms) 2021-10-08T19:29:22.470 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2021-10-08T19:29:22.470 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3009 ms) 2021-10-08T19:29:22.471 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2021-10-08T19:29:22.471 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3007 ms) 2021-10-08T19:29:22.471 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2021-10-08T19:29:22.472 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3036 ms) 2021-10-08T19:29:22.472 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2021-10-08T19:29:22.472 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2888 ms) 2021-10-08T19:29:22.473 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2021-10-08T19:29:22.473 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3018 ms) 2021-10-08T19:29:22.473 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2021-10-08T19:29:22.473 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3018 ms) 2021-10-08T19:29:22.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2021-10-08T19:29:22.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2999 ms) 2021-10-08T19:29:22.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [----------] 24 tests from LibRadosAio (80612 ms total) 2021-10-08T19:29:22.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: 2021-10-08T19:29:22.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2021-10-08T19:29:22.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2021-10-08T19:29:22.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6983 ms) 2021-10-08T19:29:22.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2021-10-08T19:29:22.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6995 ms) 2021-10-08T19:29:22.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.Rou api_snapshots_pp: Running main() from gmock_main.cc 2021-10-08T19:29:22.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [==========] Running 18 tests from 4 test suites. 2021-10-08T19:29:22.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2021-10-08T19:29:22.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2021-10-08T19:29:22.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: seed 88687 2021-10-08T19:29:22.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2021-10-08T19:29:22.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (2876 ms) 2021-10-08T19:29:22.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2021-10-08T19:29:22.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2801 ms) 2021-10-08T19:29:22.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2021-10-08T19:29:22.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (1757 ms) 2021-10-08T19:29:22.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2021-10-08T19:29:22.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1586 ms) 2021-10-08T19:29:22.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2021-10-08T19:29:22.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3773 ms) 2021-10-08T19:29:22.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (12793 ms total) 2021-10-08T19:29:22.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: 2021-10-08T19:29:22.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP 2021-10-08T19:29:22.482 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2021-10-08T19:29:22.482 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (3944 ms) 2021-10-08T19:29:22.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2021-10-08T19:29:22.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (4075 ms) 2021-10-08T19:29:22.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2021-10-08T19:29:22.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6005 ms) 2021-10-08T19:29:22.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2021-10-08T19:29:22.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3997 ms) 2021-10-08T19:29:22.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2021-10-08T19:29:22.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2055 ms) 2021-10-08T19:29:22.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2021-10-08T19:29:22.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: deleting snap 23 in pool test-rados-api-smithi157-88687-7 2021-10-08T19:29:22.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: waiting for snaps to purge 2021-10-08T19:29:22.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17973 ms) 2021-10-08T19:29:22.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP (38050 ms total) 2021-10-08T19:29:22.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: 2021-10-08T19:29:22.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2021-10-08T19:29:22.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2021-10-08T19:29:22.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3009 ms) 2021-10-08T19:29:22.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2021-10-08T19:29:22.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2022 ms) 2021-10-08T19:29:22.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2021-10-08T19:29:22.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (1894 ms) 2021-10-08T19:29:22.488 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2021-10-08T19:29:22.488 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2014 ms) 2021-10-08T19:29:22.488 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8939 ms total) 2021-10-08T19:29:22.488 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: 2021-10-08T19:29:22.489 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2021-10-08T19:29:22.489 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2021-10-08T19:29:22.489 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4023 ms) 2021-10-08T19:29:22.490 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2021-10-08T19:29:22.490 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3960 ms) 2021-10-08T19:29:22.491 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2021-10-08T19:29:22.491 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3995 ms) 2021-10-08T19:29:22.491 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11978 ms total) 2021-10-08T19:29:22.492 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: 2021-10-08T19:29:22.492 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2021-10-08T19:29:22.492 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [==========] 18 tests from 4 test suites ran. (94553 ms total) 2021-10-08T19:29:22.493 INFO:tasks.workunit.client.0.smithi157.stdout: api_snapshots_pp: [ PASSED ] 18 tests. 2021-10-08T19:29:22.493 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:22.494 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88547 2021-10-08T19:29:22.494 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88547 2021-10-08T19:29:22.494 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:22.495 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88539 2021-10-08T19:29:22.495 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88539 2021-10-08T19:29:22.496 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:22.496 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88523 2021-10-08T19:29:22.496 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88523 2021-10-08T19:29:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: pgmap v209: 291 pgs: 291 active+clean; 585 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 18 op/s 2021-10-08T19:29:23.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:23.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:23.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]': finished 2021-10-08T19:29:23.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]': finished 2021-10-08T19:29:23.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:23.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "30"}]': finished 2021-10-08T19:29:23.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: osdmap e160: 8 total, 8 up, 8 in 2021-10-08T19:29:23.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:23.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:23.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:23.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:23.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: pgmap v209: 291 pgs: 291 active+clean; 585 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 18 op/s 2021-10-08T19:29:23.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:23.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:23.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]': finished 2021-10-08T19:29:23.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]': finished 2021-10-08T19:29:23.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:23.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "30"}]': finished 2021-10-08T19:29:23.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: osdmap e160: 8 total, 8 up, 8 in 2021-10-08T19:29:23.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:23.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:23.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:23.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:23.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: pgmap v209: 291 pgs: 291 active+clean; 585 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 18 op/s 2021-10-08T19:29:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88687-19"}]': finished 2021-10-08T19:29:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-26"}]': finished 2021-10-08T19:29:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88558-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88528-1", "var": "pgp_num_actual", "val": "30"}]': finished 2021-10-08T19:29:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: osdmap e160: 8 total, 8 up, 8 in 2021-10-08T19:29:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:23.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:23.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:23.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:23.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:23.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:29:24.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:29:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:29:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:24.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:24.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:24.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: pgmap v212: 291 pgs: 64 unknown, 227 active+clean; 585 KiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:24.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:24.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: osdmap e161: 8 total, 8 up, 8 in 2021-10-08T19:29:24.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1109133597' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:29:24.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:29:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:24.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:24.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:24.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:24.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: pgmap v212: 291 pgs: 64 unknown, 227 active+clean; 585 KiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:24.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:24.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: osdmap e161: 8 total, 8 up, 8 in 2021-10-08T19:29:24.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1109133597' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:29:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:29:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3850388199' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: pgmap v212: 291 pgs: 64 unknown, 227 active+clean; 585 KiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:24.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:24.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: osdmap e161: 8 total, 8 up, 8 in 2021-10-08T19:29:24.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1109133597' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:24.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[32847]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:25.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-36"}]': finished 2021-10-08T19:29:25.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[32847]: osdmap e162: 8 total, 8 up, 8 in 2021-10-08T19:29:25.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:25.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:25.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88528-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:25.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[42114]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:25.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-36"}]': finished 2021-10-08T19:29:25.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[42114]: osdmap e162: 8 total, 8 up, 8 in 2021-10-08T19:29:25.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:25.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:25.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88528-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:25.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:24 smithi196 ceph-mon[34258]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:25.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88558-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88558-36"}]': finished 2021-10-08T19:29:25.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:24 smithi196 ceph-mon[34258]: osdmap e162: 8 total, 8 up, 8 in 2021-10-08T19:29:25.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:25.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:25.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88528-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-27"}]': finished 2021-10-08T19:29:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88528-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[32847]: osdmap e163: 8 total, 8 up, 8 in 2021-10-08T19:29:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88528-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:27.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[32847]: pgmap v215: 244 pgs: 48 unknown, 196 active+clean; 583 KiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:27.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-27"}]': finished 2021-10-08T19:29:27.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88528-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:27.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[42114]: osdmap e163: 8 total, 8 up, 8 in 2021-10-08T19:29:27.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88528-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:27.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:27.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:27.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:26 smithi157 ceph-mon[42114]: pgmap v215: 244 pgs: 48 unknown, 196 active+clean; 583 KiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:27.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:26 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-27"}]': finished 2021-10-08T19:29:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88528-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:26 smithi196 ceph-mon[34258]: osdmap e163: 8 total, 8 up, 8 in 2021-10-08T19:29:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88528-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:27.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:27.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:26 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:27.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:26 smithi196 ceph-mon[34258]: pgmap v215: 244 pgs: 48 unknown, 196 active+clean; 583 KiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:27.118 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:29:26 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:29:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:27] "GET /metrics HTTP/1.1" 200 160833 "" "Prometheus/2.18.1" 2021-10-08T19:29:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: osdmap e164: 8 total, 8 up, 8 in 2021-10-08T19:29:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3670712891' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:27.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88528-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88528-2"}]': finished 2021-10-08T19:29:27.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-15"}]': finished 2021-10-08T19:29:27.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3670712891' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:27.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]': finished 2021-10-08T19:29:27.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: osdmap e165: 8 total, 8 up, 8 in 2021-10-08T19:29:27.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:27.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:27.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-15", "mode": "writeback"}]: dispatch 2021-10-08T19:29:27.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:27.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:27.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-15", "mode": "writeback"}]: dispatch 2021-10-08T19:29:27.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:27.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: osdmap e164: 8 total, 8 up, 8 in 2021-10-08T19:29:27.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:27.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:27.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:27.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3670712891' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:27.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:27.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:27.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88528-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88528-2"}]': finished 2021-10-08T19:29:27.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-15"}]': finished 2021-10-08T19:29:27.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3670712891' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:27.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]': finished 2021-10-08T19:29:27.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: osdmap e165: 8 total, 8 up, 8 in 2021-10-08T19:29:27.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:27.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:27.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-15", "mode": "writeback"}]: dispatch 2021-10-08T19:29:27.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:27.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:27.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-15", "mode": "writeback"}]: dispatch 2021-10-08T19:29:28.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:28.291 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: osdmap e164: 8 total, 8 up, 8 in 2021-10-08T19:29:28.292 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:28.292 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:28.292 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:28.292 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3670712891' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:28.293 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:28.293 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:28.293 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88528-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88528-2"}]': finished 2021-10-08T19:29:28.293 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-15"}]': finished 2021-10-08T19:29:28.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3670712891' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:28.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88558-36"}]': finished 2021-10-08T19:29:28.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: osdmap e165: 8 total, 8 up, 8 in 2021-10-08T19:29:28.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1293349811' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:28.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:28.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-15", "mode": "writeback"}]: dispatch 2021-10-08T19:29:28.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]: dispatch 2021-10-08T19:29:28.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:28.295 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-15", "mode": "writeback"}]: dispatch 2021-10-08T19:29:28.479 INFO:tasks.workunit.client.0.smithi157.stdout:202 ms total) 2021-10-08T19:29:28.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: 2021-10-08T19:29:28.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2021-10-08T19:29:28.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2021-10-08T19:29:28.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (96 ms) 2021-10-08T19:29:28.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (96 ms total) 2021-10-08T19:29:28.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: 2021-10-08T19:29:28.480 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2021-10-08T19:29:28.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2021-10-08T19:29:28.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (25 ms) 2021-10-08T19:29:28.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2021-10-08T19:29:28.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (2 ms) 2021-10-08T19:29:28.481 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (27 ms total) 2021-10-08T19:29:28.482 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: 2021-10-08T19:29:28.482 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2021-10-08T19:29:28.482 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2021-10-08T19:29:28.482 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (3 ms) 2021-10-08T19:29:28.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2021-10-08T19:29:28.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (1 ms) 2021-10-08T19:29:28.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (4 ms total) 2021-10-08T19:29:28.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: 2021-10-08T19:29:28.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2021-10-08T19:29:28.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2021-10-08T19:29:28.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (23 ms) 2021-10-08T19:29:28.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2021-10-08T19:29:28.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (4 ms) 2021-10-08T19:29:28.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (27 ms total) 2021-10-08T19:29:28.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: 2021-10-08T19:29:28.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2021-10-08T19:29:28.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2021-10-08T19:29:28.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1012 ms) 2021-10-08T19:29:28.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1012 ms total) 2021-10-08T19:29:28.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: 2021-10-08T19:29:28.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [----------] Global test environment tear-down 2021-10-08T19:29:28.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (100599 ms total) 2021-10-08T19:29:28.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_misc_pp: [ PASSED ] 31 tests. 2021-10-08T19:29:28.824 INFO:tasks.workunit.client.0.smithi157.stdout: cursor()=8:b29083e3:::5:head expected=8:b29083e3:::5:head 2021-10-08T19:29:28.825 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:b29083e3:::5:head -> 5 2021-10-08T19:29:28.825 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=5 expected=5 2021-10-08T19:29:28.825 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:89d3ae78:::11:head 2021-10-08T19:29:28.825 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:89d3ae78:::11:head expected=8:89d3ae78:::11:head 2021-10-08T19:29:28.826 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2021-10-08T19:29:28.826 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=11 expected=11 2021-10-08T19:29:28.826 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:863748b0:::15:head 2021-10-08T19:29:28.826 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:863748b0:::15:head expected=8:863748b0:::15:head 2021-10-08T19:29:28.827 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:863748b0:::15:head -> 15 2021-10-08T19:29:28.827 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=15 expected=15 2021-10-08T19:29:28.827 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:e960b815:::9:head 2021-10-08T19:29:28.827 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:e960b815:::9:head expected=8:e960b815:::9:head 2021-10-08T19:29:28.827 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:e960b815:::9:head -> 9 2021-10-08T19:29:28.828 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=9 expected=9 2021-10-08T19:29:28.828 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:6cac518f:::0:head 2021-10-08T19:29:28.828 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:6cac518f:::0:head expected=8:6cac518f:::0:head 2021-10-08T19:29:28.828 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:6cac518f:::0:head -> 0 2021-10-08T19:29:28.829 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=0 expected=0 2021-10-08T19:29:28.829 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:52ea6a34:::10:head 2021-10-08T19:29:28.829 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:52ea6a34:::10:head expected=8:52ea6a34:::10:head 2021-10-08T19:29:28.829 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2021-10-08T19:29:28.829 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=10 expected=10 2021-10-08T19:29:28.830 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:02547ec2:::1:head 2021-10-08T19:29:28.830 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:02547ec2:::1:head expected=8:02547ec2:::1:head 2021-10-08T19:29:28.835 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:02547ec2:::1:head -> 1 2021-10-08T19:29:28.835 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=1 expected=1 2021-10-08T19:29:28.835 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : seek to 8:62a1935d:::14:head 2021-10-08T19:29:28.836 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : cursor()=8:62a1935d:::14:head expected=8:62a1935d:::14:head 2021-10-08T19:29:28.836 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: > 8:62a1935d:::14:head -> 14 2021-10-08T19:29:28.836 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: : entry=14 expected=14 2021-10-08T19:29:28.837 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (172 ms) 2021-10-08T19:29:28.837 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2021-10-08T19:29:28.837 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (39072 ms) 2021-10-08T19:29:28.837 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2021-10-08T19:29:28.838 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: split 0/5 -> MIN 8:33333333::::head 2021-10-08T19:29:28.838 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: split 1/5 -> 8:33333333::::head 8:66666666::::head 2021-10-08T19:29:28.838 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: split 2/5 -> 8:66666666::::head 8:99999999::::head 2021-10-08T19:29:28.838 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: split 3/5 -> 8:99999999::::head 8:cccccccc::::head 2021-10-08T19:29:28.839 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: split 4/5 -> 8:cccccccc::::head MAX 2021-10-08T19:29:28.839 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (49714 ms) 2021-10-08T19:29:28.839 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [----------] 7 tests from LibRadosList (89216 ms total) 2021-10-08T19:29:28.839 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 2021-10-08T19:29:28.839 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [----------] 3 tests from LibRadosListEC 2021-10-08T19:29:28.840 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2021-10-08T19:29:28.840 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1311 ms) 2021-10-08T19:29:28.840 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2021-10-08T19:29:28.840 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: myset foo1,foo2,foo3 2021-10-08T19:29:28.840 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo1 2021-10-08T19:29:28.841 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo2 2021-10-08T19:29:28.841 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo3 2021-10-08T19:29:28.841 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: myset foo1,foo4,foo5 2021-10-08T19:29:28.841 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo4 2021-10-08T19:29:28.842 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo5 2021-10-08T19:29:28.842 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo1 2021-10-08T19:29:28.842 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: myset foo6,foo7 2021-10-08T19:29:28.843 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo7 2021-10-08T19:29:28.843 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: foo6 2021-10-08T19:29:28.843 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-10-08T19:29:28.843 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns1:foo4 2021-10-08T19:29:28.844 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns1:foo5 2021-10-08T19:29:28.844 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns2:foo7 2021-10-08T19:29:28.844 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns2:foo6 2021-10-08T19:29:28.844 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: ns1:foo1 2021-10-08T19:29:28.845 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: :foo1 2021-10-08T19:29:28.845 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: :foo2 2021-10-08T19:29:28.846 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: :foo3 2021-10-08T19:29:28.846 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (31 ms) 2021-10-08T19:29:28.846 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2021-10-08T19:29:28.846 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 1 0 2021-10-08T19:29:28.847 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 10 0 2021-10-08T19:29:28.847 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 13 0 2021-10-08T19:29:29.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:28 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:29:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[32847]: pgmap v218: 268 pgs: 19 creating+peering, 21 unknown, 228 active+clean; 583 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:29.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]': finished 2021-10-08T19:29:29.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]': finished 2021-10-08T19:29:29.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-15", "mode": "writeback"}]': finished 2021-10-08T19:29:29.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[32847]: osdmap e166: 8 total, 8 up, 8 in 2021-10-08T19:29:29.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:29.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:29.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[42114]: pgmap v218: 268 pgs: 19 creating+peering, 21 unknown, 228 active+clean; 583 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:29.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:29.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]': finished 2021-10-08T19:29:29.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]': finished 2021-10-08T19:29:29.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-15", "mode": "writeback"}]': finished 2021-10-08T19:29:29.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[42114]: osdmap e166: 8 total, 8 up, 8 in 2021-10-08T19:29:29.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:29.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:29.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:29:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:28 smithi196 ceph-mon[34258]: pgmap v218: 268 pgs: 19 creating+peering, 21 unknown, 228 active+clean; 583 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:28 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88558-36"}]': finished 2021-10-08T19:29:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-27"}]': finished 2021-10-08T19:29:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-15", "mode": "writeback"}]': finished 2021-10-08T19:29:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:28 smithi196 ceph-mon[34258]: osdmap e166: 8 total, 8 up, 8 in 2021-10-08T19:29:29.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4280792565' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:29.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]: dispatch 2021-10-08T19:29:30.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:30.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:29:30.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:29:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:30.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]': finished 2021-10-08T19:29:30.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: osdmap e167: 8 total, 8 up, 8 in 2021-10-08T19:29:30.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:30.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1230517586' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:30.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:30.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:30.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:30.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:30.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[42114]: pgmap v221: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:29:30.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:30.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:29:30.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:29:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:30.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]': finished 2021-10-08T19:29:30.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: osdmap e167: 8 total, 8 up, 8 in 2021-10-08T19:29:30.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:30.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1230517586' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:30.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:30.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:30.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:30.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:30.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:29 smithi157 ceph-mon[32847]: pgmap v221: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:29:30.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:30.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:29:30.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:29:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:30.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-27"}]': finished 2021-10-08T19:29:30.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: osdmap e167: 8 total, 8 up, 8 in 2021-10-08T19:29:30.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:30.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1230517586' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:30.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:30.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:30.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:30.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:30.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:29 smithi196 ceph-mon[34258]: pgmap v221: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:29:32.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88528-2"}]': finished 2021-10-08T19:29:32.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: osdmap e168: 8 total, 8 up, 8 in 2021-10-08T19:29:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:29:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:29:32.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:29:32.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88528-2"}]': finished 2021-10-08T19:29:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: osdmap e168: 8 total, 8 up, 8 in 2021-10-08T19:29:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:32.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:32.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:32.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:32.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:29:32.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:29:32.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:29:32.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88528-2"}]': finished 2021-10-08T19:29:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:32.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:32.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: osdmap e168: 8 total, 8 up, 8 in 2021-10-08T19:29:32.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:32.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88528-2"}]: dispatch 2021-10-08T19:29:32.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15"}]: dispatch 2021-10-08T19:29:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:29:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:29:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:29:32.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:33.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88528-2"}]': finished 2021-10-08T19:29:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[42114]: pgmap v224: 228 pgs: 228 active+clean; 583 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:29:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15"}]': finished 2021-10-08T19:29:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[42114]: osdmap e169: 8 total, 8 up, 8 in 2021-10-08T19:29:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-28"}]': finished 2021-10-08T19:29:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[42114]: osdmap e170: 8 total, 8 up, 8 in 2021-10-08T19:29:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2761116119' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2050949038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:33.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88528-2"}]': finished 2021-10-08T19:29:33.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[32847]: pgmap v224: 228 pgs: 228 active+clean; 583 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:29:33.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15"}]': finished 2021-10-08T19:29:33.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[32847]: osdmap e169: 8 total, 8 up, 8 in 2021-10-08T19:29:33.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-28"}]': finished 2021-10-08T19:29:33.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[32847]: osdmap e170: 8 total, 8 up, 8 in 2021-10-08T19:29:33.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2761116119' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2050949038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:32 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1096628378' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88528-2"}]': finished 2021-10-08T19:29:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:32 smithi196 ceph-mon[34258]: pgmap v224: 228 pgs: 228 active+clean; 583 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:29:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-15"}]': finished 2021-10-08T19:29:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:32 smithi196 ceph-mon[34258]: osdmap e169: 8 total, 8 up, 8 in 2021-10-08T19:29:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-28"}]': finished 2021-10-08T19:29:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:32 smithi196 ceph-mon[34258]: osdmap e170: 8 total, 8 up, 8 in 2021-10-08T19:29:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2761116119' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2050949038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2050949038' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:33.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:33.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[42114]: osdmap e171: 8 total, 8 up, 8 in 2021-10-08T19:29:33.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2761116119' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi157-88528-3","pool2":"test-rados-api-smithi157-88528-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-10-08T19:29:33.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi157-88528-3","pool2":"test-rados-api-smithi157-88528-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-10-08T19:29:33.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:33.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:33.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:33.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:33.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:33.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:29:33.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2050949038' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:33.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:33.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[32847]: osdmap e171: 8 total, 8 up, 8 in 2021-10-08T19:29:33.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2761116119' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi157-88528-3","pool2":"test-rados-api-smithi157-88528-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-10-08T19:29:33.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi157-88528-3","pool2":"test-rados-api-smithi157-88528-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-10-08T19:29:34.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:34.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2050949038' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:34.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88528-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:34.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:33 smithi196 ceph-mon[34258]: osdmap e171: 8 total, 8 up, 8 in 2021-10-08T19:29:34.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:34.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:34.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2761116119' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi157-88528-3","pool2":"test-rados-api-smithi157-88528-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-10-08T19:29:34.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi157-88528-3","pool2":"test-rados-api-smithi157-88528-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-10-08T19:29:34.473 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 7 0 2021-10-08T19:29:34.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 14 0 2021-10-08T19:29:34.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 0 0 2021-10-08T19:29:34.474 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 15 0 2021-10-08T19:29:34.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 11 0 2021-10-08T19:29:34.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 5 0 2021-10-08T19:29:34.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 8 0 2021-10-08T19:29:34.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 6 0 2021-10-08T19:29:34.475 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 3 0 2021-10-08T19:29:34.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 4 0 2021-10-08T19:29:34.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 12 0 2021-10-08T19:29:34.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 9 0 2021-10-08T19:29:34.476 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 2 0 2021-10-08T19:29:34.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-10-08T19:29:34.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (43 ms) 2021-10-08T19:29:34.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [----------] 3 tests from LibRadosListEC (1385 ms total) 2021-10-08T19:29:34.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 2021-10-08T19:29:34.477 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [----------] 1 test from LibRadosListNP 2021-10-08T19:29:34.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2021-10-08T19:29:34.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2752 ms) 2021-10-08T19:29:34.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [----------] 1 test from LibRadosListNP (2752 ms total) 2021-10-08T19:29:34.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: 2021-10-08T19:29:34.478 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [----------] Global test environment tear-down 2021-10-08T19:29:34.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [==========] 11 tests from 3 test suites ran. (106602 ms total) 2021-10-08T19:29:34.479 INFO:tasks.workunit.client.0.smithi157.stdout: api_list: [ PASSED ] 11 tests. 2021-10-08T19:29:34.480 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:34.480 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88792 2021-10-08T19:29:34.480 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88792 2021-10-08T19:29:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88775 2021-10-08T19:29:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88775 2021-10-08T19:29:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88966 2021-10-08T19:29:34.482 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88966 2021-10-08T19:29:34.482 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:34.482 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88491 2021-10-08T19:29:34.482 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88491 2021-10-08T19:29:34.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: Running main() from gmock_main.cc 2021-10-08T19:29:34.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [==========] Running 54 tests from 4 test suites. 2021-10-08T19:29:34.483 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] Global test environment set-up. 2021-10-08T19:29:34.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] 29 tests from LibRadosAio 2021-10-08T19:29:34.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2021-10-08T19:29:34.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (8725 ms) 2021-10-08T19:29:34.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2021-10-08T19:29:34.484 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (19758 ms) 2021-10-08T19:29:34.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2021-10-08T19:29:34.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (6195 ms) 2021-10-08T19:29:34.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2021-10-08T19:29:34.485 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (2959 ms) 2021-10-08T19:29:34.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2021-10-08T19:29:34.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3021 ms) 2021-10-08T19:29:34.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2021-10-08T19:29:34.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2946 ms) 2021-10-08T19:29:34.486 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2021-10-08T19:29:34.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3003 ms) 2021-10-08T19:29:34.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2021-10-08T19:29:34.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2999 ms) 2021-10-08T19:29:34.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2021-10-08T19:29:34.487 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3003 ms) 2021-10-08T19:29:34.488 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2021-10-08T19:29:34.488 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3020 ms) 2021-10-08T19:29:34.488 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2021-10-08T19:29:34.488 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3016 ms) 2021-10-08T19:29:34.488 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2021-10-08T19:29:34.489 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3020 ms) 2021-10-08T19:29:34.489 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2021-10-08T19:29:34.489 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3012 ms) 2021-10-08T19:29:34.489 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2021-10-08T19:29:34.490 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3020 ms) 2021-10-08T19:29:34.490 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2021-10-08T19:29:34.490 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3003 ms) 2021-10-08T19:29:34.490 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2021-10-08T19:29:34.490 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2908 ms) 2021-10-08T19:29:34.491 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2021-10-08T19:29:34.491 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3245 ms) 2021-10-08T19:29:34.491 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2021-10-08T19:29:34.491 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2775 ms) 2021-10-08T19:29:34.491 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2021-10-08T19:29:34.492 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3242 ms) 2021-10-08T19:29:34.493 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2021-10-08T19:29:34.493 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (2787 ms) 2021-10-08T19:29:34.493 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2021-10-08T19:29:34.493 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (2954 ms) 2021-10-08T19:29:34.494 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2021-10-08T19:29:34.495 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3006 ms) 2021-10-08T19:29:34.496 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2021-10-08T19:29:34.496 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2991 ms) 2021-10-08T19:29:34.496 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2021-10-08T19:29:34.496 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3000 ms) 2021-10-08T19:29:34.497 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2021-10-08T19:29:34.497 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripAppendPP (3003 ms) 2021-10-08T19:29:34.498 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2021-10-08T19:29:34.498 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3248 ms) 2021-10-08T19:29:34.498 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2021-10-08T19:29:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[32847]: pgmap v227: 300 pgs: 104 unknown, 196 active+clean; 583 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi157-88528-3","pool2":"test-rados-api-smithi157-88528-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-10-08T19:29:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[32847]: osdmap e172: 8 total, 8 up, 8 in 2021-10-08T19:29:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[42114]: pgmap v227: 300 pgs: 104 unknown, 196 active+clean; 583 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:35.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi157-88528-3","pool2":"test-rados-api-smithi157-88528-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-10-08T19:29:35.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[42114]: osdmap e172: 8 total, 8 up, 8 in 2021-10-08T19:29:35.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:35.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:35.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:34 smithi196 ceph-mon[34258]: pgmap v227: 300 pgs: 104 unknown, 196 active+clean; 583 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi157-88528-3","pool2":"test-rados-api-smithi157-88528-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-10-08T19:29:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:34 smithi196 ceph-mon[34258]: osdmap e172: 8 total, 8 up, 8 in 2021-10-08T19:29:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:36.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-28"}]': finished 2021-10-08T19:29:36.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:36.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: osdmap e173: 8 total, 8 up, 8 in 2021-10-08T19:29:36.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:36.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:36.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:36.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/530652960' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:36.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: pgmap v230: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 275 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:36.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:36.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:36.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:36.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:36.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-28"}]': finished 2021-10-08T19:29:36.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:36.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: osdmap e173: 8 total, 8 up, 8 in 2021-10-08T19:29:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/530652960' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: pgmap v230: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 275 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:36.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:36.849 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-28"}]': finished 2021-10-08T19:29:36.850 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:36.850 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: osdmap e173: 8 total, 8 up, 8 in 2021-10-08T19:29:36.850 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:36.850 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:36.851 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-28"}]: dispatch 2021-10-08T19:29:36.851 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/530652960' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:36.851 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: pgmap v230: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 275 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:36.851 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:36.852 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:36.852 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:36.852 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:37.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:29:36 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:29:37.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:37] "GET /metrics HTTP/1.1" 200 158593 "" "Prometheus/2.18.1" 2021-10-08T19:29:37.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-17"}]': finished 2021-10-08T19:29:37.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-28"}]': finished 2021-10-08T19:29:37.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/530652960' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:37.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: osdmap e174: 8 total, 8 up, 8 in 2021-10-08T19:29:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-17", "mode": "writeback"}]: dispatch 2021-10-08T19:29:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-17", "mode": "writeback"}]: dispatch 2021-10-08T19:29:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:37.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-17"}]': finished 2021-10-08T19:29:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-28"}]': finished 2021-10-08T19:29:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/530652960' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: osdmap e174: 8 total, 8 up, 8 in 2021-10-08T19:29:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-17", "mode": "writeback"}]: dispatch 2021-10-08T19:29:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-17", "mode": "writeback"}]: dispatch 2021-10-08T19:29:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:37.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:37.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:37.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:37 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:37.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-17"}]': finished 2021-10-08T19:29:37.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/524476880' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-28"}]': finished 2021-10-08T19:29:37.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/530652960' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:37.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: osdmap e174: 8 total, 8 up, 8 in 2021-10-08T19:29:37.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-17", "mode": "writeback"}]: dispatch 2021-10-08T19:29:37.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-17", "mode": "writeback"}]: dispatch 2021-10-08T19:29:37.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:37.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:37.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:37.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:37 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:39.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-17", "mode": "writeback"}]': finished 2021-10-08T19:29:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[32847]: osdmap e175: 8 total, 8 up, 8 in 2021-10-08T19:29:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[32847]: pgmap v233: 228 pgs: 228 active+clean; 583 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:39.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:39.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-17", "mode": "writeback"}]': finished 2021-10-08T19:29:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[42114]: osdmap e175: 8 total, 8 up, 8 in 2021-10-08T19:29:39.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:39.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:39.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[42114]: pgmap v233: 228 pgs: 228 active+clean; 583 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:39.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:39.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:39.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:29:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:38 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-17", "mode": "writeback"}]': finished 2021-10-08T19:29:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:38 smithi196 ceph-mon[34258]: osdmap e175: 8 total, 8 up, 8 in 2021-10-08T19:29:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:38 smithi196 ceph-mon[34258]: pgmap v233: 228 pgs: 228 active+clean; 583 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:40.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: osdmap e176: 8 total, 8 up, 8 in 2021-10-08T19:29:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1068852556' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:40.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-29"}]': finished 2021-10-08T19:29:40.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17"}]': finished 2021-10-08T19:29:40.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:40.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: osdmap e177: 8 total, 8 up, 8 in 2021-10-08T19:29:40.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1068852556' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88496-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:29:40.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88496-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:29:40.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: osdmap e176: 8 total, 8 up, 8 in 2021-10-08T19:29:40.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:40.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1068852556' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:40.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:40.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-29"}]': finished 2021-10-08T19:29:40.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17"}]': finished 2021-10-08T19:29:40.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:40.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: osdmap e177: 8 total, 8 up, 8 in 2021-10-08T19:29:40.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1068852556' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88496-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:29:40.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:39 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88496-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:29:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: osdmap e176: 8 total, 8 up, 8 in 2021-10-08T19:29:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1068852556' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17"}]: dispatch 2021-10-08T19:29:40.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:40.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-29"}]': finished 2021-10-08T19:29:40.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-17"}]': finished 2021-10-08T19:29:40.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:40.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: osdmap e177: 8 total, 8 up, 8 in 2021-10-08T19:29:40.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1068852556' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88496-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:29:40.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:39 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88496-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:29:41.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:40 smithi157 ceph-mon[32847]: pgmap v236: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:41.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88496-31", "var": "eio", "val": "true"}]': finished 2021-10-08T19:29:41.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:40 smithi157 ceph-mon[32847]: osdmap e178: 8 total, 8 up, 8 in 2021-10-08T19:29:41.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:40 smithi157 ceph-mon[42114]: pgmap v236: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:41.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88496-31", "var": "eio", "val": "true"}]': finished 2021-10-08T19:29:41.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:40 smithi157 ceph-mon[42114]: osdmap e178: 8 total, 8 up, 8 in 2021-10-08T19:29:41.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:40 smithi196 ceph-mon[34258]: pgmap v236: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:41.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi157-88496-31", "var": "eio", "val": "true"}]': finished 2021-10-08T19:29:41.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:40 smithi196 ceph-mon[34258]: osdmap e178: 8 total, 8 up, 8 in 2021-10-08T19:29:42.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[32847]: osdmap e179: 8 total, 8 up, 8 in 2021-10-08T19:29:42.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:42.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:42.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:42.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[32847]: pgmap v239: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 388 KiB/s wr, 389 op/s 2021-10-08T19:29:42.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[42114]: osdmap e179: 8 total, 8 up, 8 in 2021-10-08T19:29:42.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:42.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:42.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:42.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:42 smithi157 ceph-mon[42114]: pgmap v239: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 388 KiB/s wr, 389 op/s 2021-10-08T19:29:42.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:42 smithi196 ceph-mon[34258]: osdmap e179: 8 total, 8 up, 8 in 2021-10-08T19:29:42.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:42.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:42.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:42.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:42 smithi196 ceph-mon[34258]: pgmap v239: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 388 KiB/s wr, 389 op/s 2021-10-08T19:29:43.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-29"}]': finished 2021-10-08T19:29:43.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:43.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[32847]: osdmap e180: 8 total, 8 up, 8 in 2021-10-08T19:29:43.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:43.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:43.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:43.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-29"}]': finished 2021-10-08T19:29:43.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:43.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[42114]: osdmap e180: 8 total, 8 up, 8 in 2021-10-08T19:29:43.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:43.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:43.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:43.833 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:43.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:43.833 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:43.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:43.833 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:43.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:29:43.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-29"}]': finished 2021-10-08T19:29:43.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:43.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:43 smithi196 ceph-mon[34258]: osdmap e180: 8 total, 8 up, 8 in 2021-10-08T19:29:43.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-29"}]: dispatch 2021-10-08T19:29:43.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:43.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:44.785 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-29"}]': finished 2021-10-08T19:29:44.786 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:44.786 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: osdmap e181: 8 total, 8 up, 8 in 2021-10-08T19:29:44.786 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:44.787 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1198099545' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:44.787 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:44.787 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:44.787 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:44.787 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:44.788 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:44.788 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: pgmap v242: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:44.788 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-19"}]': finished 2021-10-08T19:29:44.788 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:44.789 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:44.789 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: osdmap e182: 8 total, 8 up, 8 in 2021-10-08T19:29:44.789 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-29"}]': finished 2021-10-08T19:29:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: osdmap e181: 8 total, 8 up, 8 in 2021-10-08T19:29:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1198099545' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:44.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: pgmap v242: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-19"}]': finished 2021-10-08T19:29:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:44.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:44.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: osdmap e182: 8 total, 8 up, 8 in 2021-10-08T19:29:44.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:44.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3124110059' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-29"}]': finished 2021-10-08T19:29:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: osdmap e181: 8 total, 8 up, 8 in 2021-10-08T19:29:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1198099545' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:44.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:44.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: pgmap v242: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-19"}]': finished 2021-10-08T19:29:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:44.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: osdmap e182: 8 total, 8 up, 8 in 2021-10-08T19:29:44.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-19", "mode": "writeback"}]: dispatch 2021-10-08T19:29:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-19", "mode": "writeback"}]: dispatch 2021-10-08T19:29:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:45 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:46.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-19", "mode": "writeback"}]: dispatch 2021-10-08T19:29:46.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-19", "mode": "writeback"}]: dispatch 2021-10-08T19:29:46.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:45 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:46.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-19", "mode": "writeback"}]: dispatch 2021-10-08T19:29:46.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-19", "mode": "writeback"}]: dispatch 2021-10-08T19:29:46.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:45 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: pgmap v245: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 307 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-19", "mode": "writeback"}]': finished 2021-10-08T19:29:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: osdmap e183: 8 total, 8 up, 8 in 2021-10-08T19:29:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:47.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:47.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-30"}]': finished 2021-10-08T19:29:47.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:47.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: osdmap e184: 8 total, 8 up, 8 in 2021-10-08T19:29:47.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:47.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:47.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2575906961' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:47.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: pgmap v245: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 307 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:47.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-19", "mode": "writeback"}]': finished 2021-10-08T19:29:47.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: osdmap e183: 8 total, 8 up, 8 in 2021-10-08T19:29:47.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:47.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:47.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-30"}]': finished 2021-10-08T19:29:47.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:47.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: osdmap e184: 8 total, 8 up, 8 in 2021-10-08T19:29:47.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:47.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:47.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2575906961' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:47.116 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:29:46 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:29:47.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: pgmap v245: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 307 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:47.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-19", "mode": "writeback"}]': finished 2021-10-08T19:29:47.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: osdmap e183: 8 total, 8 up, 8 in 2021-10-08T19:29:47.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:47.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:47.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-30"}]': finished 2021-10-08T19:29:47.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:47.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: osdmap e184: 8 total, 8 up, 8 in 2021-10-08T19:29:47.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:47.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19"}]: dispatch 2021-10-08T19:29:47.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2575906961' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:47.788 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:47] "GET /metrics HTTP/1.1" 200 158593 "" "Prometheus/2.18.1" 2021-10-08T19:29:48.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:48.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:48.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19"}]': finished 2021-10-08T19:29:48.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2575906961' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:48.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[32847]: osdmap e185: 8 total, 8 up, 8 in 2021-10-08T19:29:48.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:48.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:48.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19"}]': finished 2021-10-08T19:29:48.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2575906961' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:48.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:47 smithi157 ceph-mon[42114]: osdmap e185: 8 total, 8 up, 8 in 2021-10-08T19:29:48.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:47 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:47 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-19"}]': finished 2021-10-08T19:29:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2575906961' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:48.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:47 smithi196 ceph-mon[34258]: osdmap e185: 8 total, 8 up, 8 in 2021-10-08T19:29:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[32847]: pgmap v248: 268 pgs: 40 creating+peering, 228 active+clean; 583 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:29:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[32847]: osdmap e186: 8 total, 8 up, 8 in 2021-10-08T19:29:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3618957937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[42114]: pgmap v248: 268 pgs: 40 creating+peering, 228 active+clean; 583 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:29:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[42114]: osdmap e186: 8 total, 8 up, 8 in 2021-10-08T19:29:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3618957937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:49.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:49.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:29:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:48 smithi196 ceph-mon[34258]: pgmap v248: 268 pgs: 40 creating+peering, 228 active+clean; 583 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:29:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:48 smithi196 ceph-mon[34258]: osdmap e186: 8 total, 8 up, 8 in 2021-10-08T19:29:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3618957937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:48 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:50.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:49 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:29:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:50.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-30"}]': finished 2021-10-08T19:29:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: osdmap e187: 8 total, 8 up, 8 in 2021-10-08T19:29:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: pgmap v251: 292 pgs: 64 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:50.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:29:50.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:29:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:50.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:50.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-30"}]': finished 2021-10-08T19:29:50.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: osdmap e187: 8 total, 8 up, 8 in 2021-10-08T19:29:50.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:50.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: pgmap v251: 292 pgs: 64 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:50.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:50.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:29:50.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:50 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:29:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:50.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:50.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-30"}]': finished 2021-10-08T19:29:50.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: osdmap e187: 8 total, 8 up, 8 in 2021-10-08T19:29:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-30"}]: dispatch 2021-10-08T19:29:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: pgmap v251: 292 pgs: 64 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:50.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:50.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:29:50.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:50 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:29:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:51.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-30"}]': finished 2021-10-08T19:29:51.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:51.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: osdmap e188: 8 total, 8 up, 8 in 2021-10-08T19:29:51.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4202017032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:51.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:51.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:51.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:51.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:51.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:51.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-30"}]': finished 2021-10-08T19:29:51.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:51.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: osdmap e188: 8 total, 8 up, 8 in 2021-10-08T19:29:51.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4202017032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:51.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:51.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:51.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:51.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:51.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:51.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3425910550' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-30"}]': finished 2021-10-08T19:29:51.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:51.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: osdmap e188: 8 total, 8 up, 8 in 2021-10-08T19:29:51.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4202017032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:51.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:51.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:51.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:51.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:51.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:51.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:52.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:52.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:52.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:52.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[32847]: osdmap e189: 8 total, 8 up, 8 in 2021-10-08T19:29:52.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:52.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:52.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:52.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:52.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[32847]: pgmap v254: 324 pgs: 324 active+clean; 583 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:52.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:52.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:52.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:52.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[42114]: osdmap e189: 8 total, 8 up, 8 in 2021-10-08T19:29:52.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:52.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:52.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:52.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:52.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:52 smithi157 ceph-mon[42114]: pgmap v254: 324 pgs: 324 active+clean; 583 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:52.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:52 smithi196 ceph-mon[34258]: osdmap e189: 8 total, 8 up, 8 in 2021-10-08T19:29:52.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:52.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:52.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:52.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:52.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:52 smithi196 ceph-mon[34258]: pgmap v254: 324 pgs: 324 active+clean; 583 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:29:53.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-21"}]': finished 2021-10-08T19:29:53.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:53 smithi157 ceph-mon[32847]: osdmap e190: 8 total, 8 up, 8 in 2021-10-08T19:29:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-21", "mode": "writeback"}]: dispatch 2021-10-08T19:29:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-21", "mode": "writeback"}]: dispatch 2021-10-08T19:29:53.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-21"}]': finished 2021-10-08T19:29:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:53 smithi157 ceph-mon[42114]: osdmap e190: 8 total, 8 up, 8 in 2021-10-08T19:29:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-21", "mode": "writeback"}]: dispatch 2021-10-08T19:29:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-21", "mode": "writeback"}]: dispatch 2021-10-08T19:29:53.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:53.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:53.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:53.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:53.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:29:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:29:53.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:29:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-21"}]': finished 2021-10-08T19:29:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:53 smithi196 ceph-mon[34258]: osdmap e190: 8 total, 8 up, 8 in 2021-10-08T19:29:53.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-21", "mode": "writeback"}]: dispatch 2021-10-08T19:29:53.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-21", "mode": "writeback"}]: dispatch 2021-10-08T19:29:54.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:54.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-31"}]': finished 2021-10-08T19:29:54.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-21", "mode": "writeback"}]': finished 2021-10-08T19:29:54.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[32847]: osdmap e191: 8 total, 8 up, 8 in 2021-10-08T19:29:54.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:54.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:54.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[32847]: pgmap v257: 268 pgs: 8 unknown, 260 active+clean; 583 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:29:54.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:54.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-31"}]': finished 2021-10-08T19:29:54.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-21", "mode": "writeback"}]': finished 2021-10-08T19:29:54.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[42114]: osdmap e191: 8 total, 8 up, 8 in 2021-10-08T19:29:54.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:54.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:54.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:54 smithi157 ceph-mon[42114]: pgmap v257: 268 pgs: 8 unknown, 260 active+clean; 583 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:29:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:54 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-31"}]': finished 2021-10-08T19:29:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-21", "mode": "writeback"}]': finished 2021-10-08T19:29:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:54 smithi196 ceph-mon[34258]: osdmap e191: 8 total, 8 up, 8 in 2021-10-08T19:29:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:29:54.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:54 smithi196 ceph-mon[34258]: pgmap v257: 268 pgs: 8 unknown, 260 active+clean; 583 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:29:55.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:55 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:29:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:55.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:55.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[32847]: osdmap e192: 8 total, 8 up, 8 in 2021-10-08T19:29:55.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:55.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:55.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:55.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:55.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[42114]: osdmap e192: 8 total, 8 up, 8 in 2021-10-08T19:29:55.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:55.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:55.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:55 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:55.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:29:55.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:55 smithi196 ceph-mon[34258]: osdmap e192: 8 total, 8 up, 8 in 2021-10-08T19:29:55.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:55.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21"}]: dispatch 2021-10-08T19:29:55.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:55 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:29:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:29:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:29:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21"}]': finished 2021-10-08T19:29:57.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: osdmap e193: 8 total, 8 up, 8 in 2021-10-08T19:29:57.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2091355236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: pgmap v260: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 325 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:57.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2091355236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:57.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]': finished 2021-10-08T19:29:57.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: osdmap e194: 8 total, 8 up, 8 in 2021-10-08T19:29:57.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:29:57.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:29:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:57.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:57.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21"}]': finished 2021-10-08T19:29:57.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: osdmap e193: 8 total, 8 up, 8 in 2021-10-08T19:29:57.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2091355236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: pgmap v260: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 325 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:57.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2091355236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:57.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]': finished 2021-10-08T19:29:57.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: osdmap e194: 8 total, 8 up, 8 in 2021-10-08T19:29:57.341 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.342 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:29:56 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:29:57.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:29:57.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:29:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:57.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:57.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-21"}]': finished 2021-10-08T19:29:57.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: osdmap e193: 8 total, 8 up, 8 in 2021-10-08T19:29:57.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2091355236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.372 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: pgmap v260: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 325 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:57.372 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2091355236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:57.373 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-31"}]': finished 2021-10-08T19:29:57.373 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: osdmap e194: 8 total, 8 up, 8 in 2021-10-08T19:29:57.374 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2259731417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.374 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]: dispatch 2021-10-08T19:29:57.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:29:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:57] "GET /metrics HTTP/1.1" 200 160806 "" "Prometheus/2.18.1" 2021-10-08T19:29:58.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]': finished 2021-10-08T19:29:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: osdmap e195: 8 total, 8 up, 8 in 2021-10-08T19:29:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3249494023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:58.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[32847]: pgmap v263: 292 pgs: 64 unknown, 228 active+clean; 583 KiB data, 327 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:58.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:58.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]': finished 2021-10-08T19:29:58.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: osdmap e195: 8 total, 8 up, 8 in 2021-10-08T19:29:58.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3249494023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:58.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:58.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:58 smithi157 ceph-mon[42114]: pgmap v263: 292 pgs: 64 unknown, 228 active+clean; 583 KiB data, 327 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-31"}]': finished 2021-10-08T19:29:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: osdmap e195: 8 total, 8 up, 8 in 2021-10-08T19:29:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3249494023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:29:58.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:58.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:58.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:58 smithi196 ceph-mon[34258]: pgmap v263: 292 pgs: 64 unknown, 228 active+clean; 583 KiB data, 327 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:59.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:29:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:29:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:00.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[32847]: osdmap e196: 8 total, 8 up, 8 in 2021-10-08T19:30:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:00.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:00.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:00.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:00.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:00.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[42114]: osdmap e196: 8 total, 8 up, 8 in 2021-10-08T19:30:00.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:00.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:29:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:00.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:59 smithi196 ceph-mon[34258]: osdmap e196: 8 total, 8 up, 8 in 2021-10-08T19:30:00.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:00.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:29:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: pgmap v266: 324 pgs: 96 unknown, 228 active+clean; 583 KiB data, 327 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:30:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: osdmap e197: 8 total, 8 up, 8 in 2021-10-08T19:30:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3429950887' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2021-10-08T19:30:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2021-10-08T19:30:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:30:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:30:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-32"}]': finished 2021-10-08T19:30:01.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:01.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:01.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: osdmap e198: 8 total, 8 up, 8 in 2021-10-08T19:30:01.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:01.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:01.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: pgmap v266: 324 pgs: 96 unknown, 228 active+clean; 583 KiB data, 327 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:30:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: osdmap e197: 8 total, 8 up, 8 in 2021-10-08T19:30:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3429950887' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:01.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:01.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2021-10-08T19:30:01.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2021-10-08T19:30:01.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:30:01.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:30:01.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-32"}]': finished 2021-10-08T19:30:01.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:01.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:01.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: osdmap e198: 8 total, 8 up, 8 in 2021-10-08T19:30:01.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:01.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:01.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: pgmap v266: 324 pgs: 96 unknown, 228 active+clean; 583 KiB data, 327 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:30:01.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: osdmap e197: 8 total, 8 up, 8 in 2021-10-08T19:30:01.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3429950887' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:01.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:01.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:01.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:01.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2021-10-08T19:30:01.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2021-10-08T19:30:01.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:30:01.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:30:01.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-32"}]': finished 2021-10-08T19:30:01.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:01.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:01.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: osdmap e198: 8 total, 8 up, 8 in 2021-10-08T19:30:01.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:01.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:02.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-23"}]': finished 2021-10-08T19:30:02.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[32847]: osdmap e199: 8 total, 8 up, 8 in 2021-10-08T19:30:02.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-23", "mode": "writeback"}]: dispatch 2021-10-08T19:30:02.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-23", "mode": "writeback"}]: dispatch 2021-10-08T19:30:02.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/897143552' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[32847]: pgmap v269: 364 pgs: 32 creating+peering, 332 active+clean; 584 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:30:02.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-23"}]': finished 2021-10-08T19:30:02.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[42114]: osdmap e199: 8 total, 8 up, 8 in 2021-10-08T19:30:02.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-23", "mode": "writeback"}]: dispatch 2021-10-08T19:30:02.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-23", "mode": "writeback"}]: dispatch 2021-10-08T19:30:02.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/897143552' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:02 smithi157 ceph-mon[42114]: pgmap v269: 364 pgs: 32 creating+peering, 332 active+clean; 584 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:30:02.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-23"}]': finished 2021-10-08T19:30:02.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:02 smithi196 ceph-mon[34258]: osdmap e199: 8 total, 8 up, 8 in 2021-10-08T19:30:02.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-23", "mode": "writeback"}]: dispatch 2021-10-08T19:30:02.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-23", "mode": "writeback"}]: dispatch 2021-10-08T19:30:02.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/897143552' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:02 smithi196 ceph-mon[34258]: pgmap v269: 364 pgs: 32 creating+peering, 332 active+clean; 584 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:30:03.833 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:03.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:03.833 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:03.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:03.833 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:03.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:30:03.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:03.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-23", "mode": "writeback"}]': finished 2021-10-08T19:30:03.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:03.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[32847]: osdmap e200: 8 total, 8 up, 8 in 2021-10-08T19:30:03.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:03.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:03.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-23", "mode": "writeback"}]': finished 2021-10-08T19:30:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[42114]: osdmap e200: 8 total, 8 up, 8 in 2021-10-08T19:30:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:03.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:03.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:03 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-23", "mode": "writeback"}]': finished 2021-10-08T19:30:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:03 smithi196 ceph-mon[34258]: osdmap e200: 8 total, 8 up, 8 in 2021-10-08T19:30:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:03.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]': finished 2021-10-08T19:30:04.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[32847]: osdmap e201: 8 total, 8 up, 8 in 2021-10-08T19:30:04.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:04.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:04.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/214714445' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:04.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:04.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:04.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:04.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[32847]: pgmap v272: 388 pgs: 32 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:30:04.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]': finished 2021-10-08T19:30:04.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[42114]: osdmap e201: 8 total, 8 up, 8 in 2021-10-08T19:30:04.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:04.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:04.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/214714445' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:04.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:04.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:04.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:04.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:04 smithi157 ceph-mon[42114]: pgmap v272: 388 pgs: 32 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:30:04.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-32"}]': finished 2021-10-08T19:30:04.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:04 smithi196 ceph-mon[34258]: osdmap e201: 8 total, 8 up, 8 in 2021-10-08T19:30:04.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1742689470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]: dispatch 2021-10-08T19:30:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/214714445' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:04.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:04.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:04.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:04 smithi196 ceph-mon[34258]: pgmap v272: 388 pgs: 32 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:30:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]': finished 2021-10-08T19:30:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: osdmap e202: 8 total, 8 up, 8 in 2021-10-08T19:30:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:05.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:05.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:06.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]': finished 2021-10-08T19:30:06.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:06.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:06.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: osdmap e202: 8 total, 8 up, 8 in 2021-10-08T19:30:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:06.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:06.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-32"}]': finished 2021-10-08T19:30:06.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:06.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:06.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: osdmap e202: 8 total, 8 up, 8 in 2021-10-08T19:30:06.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:06.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23"}]: dispatch 2021-10-08T19:30:06.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:06.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:06 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23"}]': finished 2021-10-08T19:30:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:06 smithi196 ceph-mon[34258]: osdmap e203: 8 total, 8 up, 8 in 2021-10-08T19:30:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:06 smithi196 ceph-mon[34258]: pgmap v275: 356 pgs: 32 creating+peering, 324 active+clean; 584 KiB data, 338 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23"}]': finished 2021-10-08T19:30:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:07.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[32847]: osdmap e203: 8 total, 8 up, 8 in 2021-10-08T19:30:07.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:07.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:07.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[32847]: pgmap v275: 356 pgs: 32 creating+peering, 324 active+clean; 584 KiB data, 338 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:07.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:07.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-23"}]': finished 2021-10-08T19:30:07.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:07.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[42114]: osdmap e203: 8 total, 8 up, 8 in 2021-10-08T19:30:07.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:07.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:07.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:06 smithi157 ceph-mon[42114]: pgmap v275: 356 pgs: 32 creating+peering, 324 active+clean; 584 KiB data, 338 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:07.366 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:30:06 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:30:07.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:07 smithi157 ceph-mon[32847]: osdmap e204: 8 total, 8 up, 8 in 2021-10-08T19:30:07.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:07 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:07.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:07 smithi157 ceph-mon[42114]: osdmap e204: 8 total, 8 up, 8 in 2021-10-08T19:30:07.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:07 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:07.830 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:07] "GET /metrics HTTP/1.1" 200 162080 "" "Prometheus/2.18.1" 2021-10-08T19:30:07.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:07 smithi196 ceph-mon[34258]: osdmap e204: 8 total, 8 up, 8 in 2021-10-08T19:30:07.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:07 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-33"}]': finished 2021-10-08T19:30:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[32847]: osdmap e205: 8 total, 8 up, 8 in 2021-10-08T19:30:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[32847]: pgmap v278: 300 pgs: 40 unknown, 260 active+clean; 583 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:30:09.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-33"}]': finished 2021-10-08T19:30:09.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[42114]: osdmap e205: 8 total, 8 up, 8 in 2021-10-08T19:30:09.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:09.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:09.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:08 smithi157 ceph-mon[42114]: pgmap v278: 300 pgs: 40 unknown, 260 active+clean; 583 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:30:09.093 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:30:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:09.094 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-33"}]': finished 2021-10-08T19:30:09.094 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:08 smithi196 ceph-mon[34258]: osdmap e205: 8 total, 8 up, 8 in 2021-10-08T19:30:09.094 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:09.094 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:09.095 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:08 smithi196 ceph-mon[34258]: pgmap v278: 300 pgs: 40 unknown, 260 active+clean; 583 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:30:10.027 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:10.028 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:09 smithi196 ceph-mon[34258]: osdmap e206: 8 total, 8 up, 8 in 2021-10-08T19:30:10.028 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:09 smithi196 ceph-mon[34258]: osdmap e207: 8 total, 8 up, 8 in 2021-10-08T19:30:10.028 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:10.029 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:10.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:10.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[42114]: osdmap e206: 8 total, 8 up, 8 in 2021-10-08T19:30:10.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[42114]: osdmap e207: 8 total, 8 up, 8 in 2021-10-08T19:30:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:10.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:10.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[32847]: osdmap e206: 8 total, 8 up, 8 in 2021-10-08T19:30:10.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[32847]: osdmap e207: 8 total, 8 up, 8 in 2021-10-08T19:30:10.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:10.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: pgmap v281: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]': finished 2021-10-08T19:30:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: osdmap e208: 8 total, 8 up, 8 in 2021-10-08T19:30:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3338765439' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:11.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:11.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:11.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: pgmap v281: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]': finished 2021-10-08T19:30:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:11.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: osdmap e208: 8 total, 8 up, 8 in 2021-10-08T19:30:11.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:11.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:11.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3338765439' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:11.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:11.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:11.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: pgmap v281: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-33"}]': finished 2021-10-08T19:30:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: osdmap e208: 8 total, 8 up, 8 in 2021-10-08T19:30:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/372457271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:11.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3338765439' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:11.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:11.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]: dispatch 2021-10-08T19:30:11.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:12.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-25"}]': finished 2021-10-08T19:30:12.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]': finished 2021-10-08T19:30:12.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:12.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: osdmap e209: 8 total, 8 up, 8 in 2021-10-08T19:30:12.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-25", "mode": "writeback"}]: dispatch 2021-10-08T19:30:12.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-25", "mode": "writeback"}]: dispatch 2021-10-08T19:30:12.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:12.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:12.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:12.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:12 smithi196 ceph-mon[34258]: pgmap v284: 260 pgs: 260 active+clean; 583 KiB data, 351 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:12.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-25"}]': finished 2021-10-08T19:30:12.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]': finished 2021-10-08T19:30:12.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:12.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: osdmap e209: 8 total, 8 up, 8 in 2021-10-08T19:30:12.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-25", "mode": "writeback"}]: dispatch 2021-10-08T19:30:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-25", "mode": "writeback"}]: dispatch 2021-10-08T19:30:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:12.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[32847]: pgmap v284: 260 pgs: 260 active+clean; 583 KiB data, 351 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:12.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-25"}]': finished 2021-10-08T19:30:12.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-33"}]': finished 2021-10-08T19:30:12.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:12.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: osdmap e209: 8 total, 8 up, 8 in 2021-10-08T19:30:12.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-25", "mode": "writeback"}]: dispatch 2021-10-08T19:30:12.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-25", "mode": "writeback"}]: dispatch 2021-10-08T19:30:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:12 smithi157 ceph-mon[42114]: pgmap v284: 260 pgs: 260 active+clean; 583 KiB data, 351 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:13.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-25", "mode": "writeback"}]': finished 2021-10-08T19:30:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[32847]: osdmap e210: 8 total, 8 up, 8 in 2021-10-08T19:30:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:13.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:13.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:13.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:13.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-25", "mode": "writeback"}]': finished 2021-10-08T19:30:13.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:13.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[42114]: osdmap e210: 8 total, 8 up, 8 in 2021-10-08T19:30:13.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:13.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:13.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:13.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:13.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:13.833 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:13.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:13.833 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:13.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:30:14.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:13 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-25", "mode": "writeback"}]': finished 2021-10-08T19:30:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:13 smithi196 ceph-mon[34258]: osdmap e210: 8 total, 8 up, 8 in 2021-10-08T19:30:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:14.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:14.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: pgmap v287: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 351 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: osdmap e211: 8 total, 8 up, 8 in 2021-10-08T19:30:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4228291677' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-34"}]': finished 2021-10-08T19:30:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4228291677' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-42","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25"}]': finished 2021-10-08T19:30:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[32847]: osdmap e212: 8 total, 8 up, 8 in 2021-10-08T19:30:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: pgmap v287: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 351 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:15.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: osdmap e211: 8 total, 8 up, 8 in 2021-10-08T19:30:15.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4228291677' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:15.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:15.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:15.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:15.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-34"}]': finished 2021-10-08T19:30:15.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4228291677' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-42","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:15.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25"}]': finished 2021-10-08T19:30:15.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:14 smithi157 ceph-mon[42114]: osdmap e212: 8 total, 8 up, 8 in 2021-10-08T19:30:15.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: pgmap v287: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 351 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: osdmap e211: 8 total, 8 up, 8 in 2021-10-08T19:30:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4228291677' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25"}]: dispatch 2021-10-08T19:30:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-34"}]': finished 2021-10-08T19:30:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4228291677' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-42","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:15.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-25"}]': finished 2021-10-08T19:30:15.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:14 smithi196 ceph-mon[34258]: osdmap e212: 8 total, 8 up, 8 in 2021-10-08T19:30:16.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[32847]: osdmap e213: 8 total, 8 up, 8 in 2021-10-08T19:30:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[32847]: pgmap v290: 204 pgs: 8 unknown, 196 active+clean; 583 KiB data, 351 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:16.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:16.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[42114]: osdmap e213: 8 total, 8 up, 8 in 2021-10-08T19:30:16.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[42114]: pgmap v290: 204 pgs: 8 unknown, 196 active+clean; 583 KiB data, 351 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:16.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:16.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:16.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:16 smithi196 ceph-mon[34258]: osdmap e213: 8 total, 8 up, 8 in 2021-10-08T19:30:16.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:16 smithi196 ceph-mon[34258]: pgmap v290: 204 pgs: 8 unknown, 196 active+clean; 583 KiB data, 351 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:16.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:16.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:16.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:17.366 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:30:16 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:30:17.534 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:17 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:30:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:17.534 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:17] "GET /metrics HTTP/1.1" 200 162080 "" "Prometheus/2.18.1" 2021-10-08T19:30:17.792 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:17.792 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[32847]: osdmap e214: 8 total, 8 up, 8 in 2021-10-08T19:30:17.793 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:17.793 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:17.793 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:17.793 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:17.793 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:17.794 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:17.794 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:17.794 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:17.795 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[42114]: osdmap e214: 8 total, 8 up, 8 in 2021-10-08T19:30:17.795 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:17.796 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:17.796 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:17.796 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:17.796 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:17.796 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:17.797 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:17 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:18.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:18.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:17 smithi196 ceph-mon[34258]: osdmap e214: 8 total, 8 up, 8 in 2021-10-08T19:30:18.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:18.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:18.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:18.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:18.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:18.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:17 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:18.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:17 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:30:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:30:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-34"}]': finished 2021-10-08T19:30:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: pgmap v293: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 354 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:19.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: osdmap e215: 8 total, 8 up, 8 in 2021-10-08T19:30:19.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:19.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-43"}]': finished 2021-10-08T19:30:19.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-34"}]': finished 2021-10-08T19:30:19.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: osdmap e216: 8 total, 8 up, 8 in 2021-10-08T19:30:19.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:19.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:19.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:30:19.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:30:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:19.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-34"}]': finished 2021-10-08T19:30:19.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: pgmap v293: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 354 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:19.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:19.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: osdmap e215: 8 total, 8 up, 8 in 2021-10-08T19:30:19.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:19.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-43"}]': finished 2021-10-08T19:30:19.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-34"}]': finished 2021-10-08T19:30:19.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: osdmap e216: 8 total, 8 up, 8 in 2021-10-08T19:30:19.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:19.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:19.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:30:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:30:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:30:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-34"}]': finished 2021-10-08T19:30:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: pgmap v293: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 354 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: osdmap e215: 8 total, 8 up, 8 in 2021-10-08T19:30:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-34"}]: dispatch 2021-10-08T19:30:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-43"}]': finished 2021-10-08T19:30:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1270429841' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-34"}]': finished 2021-10-08T19:30:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: osdmap e216: 8 total, 8 up, 8 in 2021-10-08T19:30:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:19.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:19.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:19.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:20.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:20.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:20.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[32847]: osdmap e217: 8 total, 8 up, 8 in 2021-10-08T19:30:20.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:20.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:20.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:20.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:20.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[32847]: pgmap v296: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 354 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:20.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:20.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:20.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[42114]: osdmap e217: 8 total, 8 up, 8 in 2021-10-08T19:30:20.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:20.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:20.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:20.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:20.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:20 smithi157 ceph-mon[42114]: pgmap v296: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 354 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:20 smithi196 ceph-mon[34258]: osdmap e217: 8 total, 8 up, 8 in 2021-10-08T19:30:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:20 smithi196 ceph-mon[34258]: pgmap v296: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 354 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:21.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:21 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:30:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:21.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-27"}]': finished 2021-10-08T19:30:21.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[32847]: osdmap e218: 8 total, 8 up, 8 in 2021-10-08T19:30:21.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-27", "mode": "writeback"}]: dispatch 2021-10-08T19:30:21.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:21.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-27", "mode": "writeback"}]: dispatch 2021-10-08T19:30:21.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:21.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-27"}]': finished 2021-10-08T19:30:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[42114]: osdmap e218: 8 total, 8 up, 8 in 2021-10-08T19:30:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-27", "mode": "writeback"}]: dispatch 2021-10-08T19:30:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-27", "mode": "writeback"}]: dispatch 2021-10-08T19:30:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-27"}]': finished 2021-10-08T19:30:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:21 smithi196 ceph-mon[34258]: osdmap e218: 8 total, 8 up, 8 in 2021-10-08T19:30:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-27", "mode": "writeback"}]: dispatch 2021-10-08T19:30:21.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:21.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-27", "mode": "writeback"}]: dispatch 2021-10-08T19:30:21.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:22.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-35"}]': finished 2021-10-08T19:30:22.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-27", "mode": "writeback"}]': finished 2021-10-08T19:30:22.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]': finished 2021-10-08T19:30:22.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: osdmap e219: 8 total, 8 up, 8 in 2021-10-08T19:30:22.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:22.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:22.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:22.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:30:22.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:30:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:22.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[32847]: pgmap v299: 236 pgs: 6 creating+peering, 2 unknown, 228 active+clean; 583 KiB data, 356 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:30:22.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:22.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-35"}]': finished 2021-10-08T19:30:22.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-27", "mode": "writeback"}]': finished 2021-10-08T19:30:22.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]': finished 2021-10-08T19:30:22.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: osdmap e219: 8 total, 8 up, 8 in 2021-10-08T19:30:22.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:22.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:22.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:22.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:30:22.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:30:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:22.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:22 smithi157 ceph-mon[42114]: pgmap v299: 236 pgs: 6 creating+peering, 2 unknown, 228 active+clean; 583 KiB data, 356 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:30:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-35"}]': finished 2021-10-08T19:30:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-27", "mode": "writeback"}]': finished 2021-10-08T19:30:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-43"}]': finished 2021-10-08T19:30:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: osdmap e219: 8 total, 8 up, 8 in 2021-10-08T19:30:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3010950580' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]: dispatch 2021-10-08T19:30:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:22.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:30:22.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:30:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:22.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:22 smithi196 ceph-mon[34258]: pgmap v299: 236 pgs: 6 creating+peering, 2 unknown, 228 active+clean; 583 KiB data, 356 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:30:23.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]': finished 2021-10-08T19:30:23.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[42114]: osdmap e220: 8 total, 8 up, 8 in 2021-10-08T19:30:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:23.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:23.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:23.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:23.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:23.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:23.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:30:23.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]': finished 2021-10-08T19:30:23.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[32847]: osdmap e220: 8 total, 8 up, 8 in 2021-10-08T19:30:23.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:23.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:23.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:23.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:23.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:23 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-43"}]': finished 2021-10-08T19:30:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:23 smithi196 ceph-mon[34258]: osdmap e220: 8 total, 8 up, 8 in 2021-10-08T19:30:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:23.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:23.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:23.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:23.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:23 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:25.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:25.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:25.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[32847]: osdmap e221: 8 total, 8 up, 8 in 2021-10-08T19:30:25.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:25.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:25.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:25.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:25.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:25.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[32847]: pgmap v302: 228 pgs: 228 active+clean; 583 KiB data, 356 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:30:25.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:25.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:25.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[42114]: osdmap e221: 8 total, 8 up, 8 in 2021-10-08T19:30:25.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:25.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:25.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:25.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:25.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:25.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:24 smithi157 ceph-mon[42114]: pgmap v302: 228 pgs: 228 active+clean; 583 KiB data, 356 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:30:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:24 smithi196 ceph-mon[34258]: osdmap e221: 8 total, 8 up, 8 in 2021-10-08T19:30:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:25.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:25.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27"}]: dispatch 2021-10-08T19:30:25.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:25.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:25.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:24 smithi196 ceph-mon[34258]: pgmap v302: 228 pgs: 228 active+clean; 583 KiB data, 356 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:30:26.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:26.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27"}]': finished 2021-10-08T19:30:26.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]': finished 2021-10-08T19:30:26.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:26.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[42114]: osdmap e222: 8 total, 8 up, 8 in 2021-10-08T19:30:26.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:26.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-44"}]': finished 2021-10-08T19:30:26.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]': finished 2021-10-08T19:30:26.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[42114]: osdmap e223: 8 total, 8 up, 8 in 2021-10-08T19:30:26.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:26.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27"}]': finished 2021-10-08T19:30:26.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]': finished 2021-10-08T19:30:26.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:26.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[32847]: osdmap e222: 8 total, 8 up, 8 in 2021-10-08T19:30:26.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:26.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-44"}]': finished 2021-10-08T19:30:26.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]': finished 2021-10-08T19:30:26.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:25 smithi157 ceph-mon[32847]: osdmap e223: 8 total, 8 up, 8 in 2021-10-08T19:30:26.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:25 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:26.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-27"}]': finished 2021-10-08T19:30:26.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-35"}]': finished 2021-10-08T19:30:26.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3735700044' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:26.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:25 smithi196 ceph-mon[34258]: osdmap e222: 8 total, 8 up, 8 in 2021-10-08T19:30:26.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]: dispatch 2021-10-08T19:30:26.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-44"}]': finished 2021-10-08T19:30:26.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-35"}]': finished 2021-10-08T19:30:26.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:25 smithi196 ceph-mon[34258]: osdmap e223: 8 total, 8 up, 8 in 2021-10-08T19:30:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[32847]: pgmap v305: 204 pgs: 8 unknown, 196 active+clean; 583 KiB data, 356 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:27.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[32847]: osdmap e224: 8 total, 8 up, 8 in 2021-10-08T19:30:27.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:27.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:27.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:27.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[42114]: pgmap v305: 204 pgs: 8 unknown, 196 active+clean; 583 KiB data, 356 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:27.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:27.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:27.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:27.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:27.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[42114]: osdmap e224: 8 total, 8 up, 8 in 2021-10-08T19:30:27.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:27.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:27.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:26 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:27.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:30:26 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:30:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:26 smithi196 ceph-mon[34258]: pgmap v305: 204 pgs: 8 unknown, 196 active+clean; 583 KiB data, 356 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:27.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:27.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:27.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:27.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:27.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:26 smithi196 ceph-mon[34258]: osdmap e224: 8 total, 8 up, 8 in 2021-10-08T19:30:27.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:27.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:27.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:26 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:27] "GET /metrics HTTP/1.1" 200 157599 "" "Prometheus/2.18.1" 2021-10-08T19:30:27.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:27 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:27.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:27.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:27 smithi157 ceph-mon[42114]: osdmap e225: 8 total, 8 up, 8 in 2021-10-08T19:30:27.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:27 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:27 smithi157 ceph-mon[32847]: osdmap e225: 8 total, 8 up, 8 in 2021-10-08T19:30:27.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:28.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:27 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:28.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:28.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:27 smithi196 ceph-mon[34258]: osdmap e225: 8 total, 8 up, 8 in 2021-10-08T19:30:28.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:29.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[32847]: pgmap v308: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 357 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:30:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-36"}]': finished 2021-10-08T19:30:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-44"}]': finished 2021-10-08T19:30:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[32847]: osdmap e226: 8 total, 8 up, 8 in 2021-10-08T19:30:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[42114]: pgmap v308: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 357 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:30:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-36"}]': finished 2021-10-08T19:30:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-44"}]': finished 2021-10-08T19:30:29.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[42114]: osdmap e226: 8 total, 8 up, 8 in 2021-10-08T19:30:29.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:29.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:30:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:28 smithi196 ceph-mon[34258]: pgmap v308: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 357 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:30:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-36"}]': finished 2021-10-08T19:30:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-44"}]': finished 2021-10-08T19:30:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:28 smithi196 ceph-mon[34258]: osdmap e226: 8 total, 8 up, 8 in 2021-10-08T19:30:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-44"}]: dispatch 2021-10-08T19:30:30.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-44"}]': finished 2021-10-08T19:30:30.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[32847]: osdmap e227: 8 total, 8 up, 8 in 2021-10-08T19:30:30.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:30.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:30.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:30.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:30.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:30.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[32847]: pgmap v311: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 357 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:30.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-44"}]': finished 2021-10-08T19:30:30.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[42114]: osdmap e227: 8 total, 8 up, 8 in 2021-10-08T19:30:30.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:30.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:30.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:30.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:30.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:30.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:30 smithi157 ceph-mon[42114]: pgmap v311: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 357 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1625938453' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-44"}]': finished 2021-10-08T19:30:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:30 smithi196 ceph-mon[34258]: osdmap e227: 8 total, 8 up, 8 in 2021-10-08T19:30:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:30.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:30.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:30.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:30.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:30.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:30 smithi196 ceph-mon[34258]: pgmap v311: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 357 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:32.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: osdmap e228: 8 total, 8 up, 8 in 2021-10-08T19:30:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:30:32.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:30:32.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:30:32.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: osdmap e228: 8 total, 8 up, 8 in 2021-10-08T19:30:32.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:32.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:32.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:32.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:32.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:30:32.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:30:32.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:30:32.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: osdmap e228: 8 total, 8 up, 8 in 2021-10-08T19:30:32.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:32.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:32.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:32.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:30:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:30:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:30:32.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-29"}]': finished 2021-10-08T19:30:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-29", "mode": "writeback"}]: dispatch 2021-10-08T19:30:33.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: pgmap v314: 228 pgs: 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2021-10-08T19:30:33.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-36"}]': finished 2021-10-08T19:30:33.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: osdmap e229: 8 total, 8 up, 8 in 2021-10-08T19:30:33.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-29", "mode": "writeback"}]: dispatch 2021-10-08T19:30:33.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:33.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:33.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-45"}]': finished 2021-10-08T19:30:33.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-29", "mode": "writeback"}]': finished 2021-10-08T19:30:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-36"}]': finished 2021-10-08T19:30:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: osdmap e230: 8 total, 8 up, 8 in 2021-10-08T19:30:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-29"}]': finished 2021-10-08T19:30:33.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-29", "mode": "writeback"}]: dispatch 2021-10-08T19:30:33.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: pgmap v314: 228 pgs: 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2021-10-08T19:30:33.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-36"}]': finished 2021-10-08T19:30:33.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: osdmap e229: 8 total, 8 up, 8 in 2021-10-08T19:30:33.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-29", "mode": "writeback"}]: dispatch 2021-10-08T19:30:33.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:33.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:33.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-45"}]': finished 2021-10-08T19:30:33.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-29", "mode": "writeback"}]': finished 2021-10-08T19:30:33.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-36"}]': finished 2021-10-08T19:30:33.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: osdmap e230: 8 total, 8 up, 8 in 2021-10-08T19:30:33.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.090 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-29"}]': finished 2021-10-08T19:30:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-29", "mode": "writeback"}]: dispatch 2021-10-08T19:30:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: pgmap v314: 228 pgs: 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2021-10-08T19:30:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-36"}]': finished 2021-10-08T19:30:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: osdmap e229: 8 total, 8 up, 8 in 2021-10-08T19:30:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-29", "mode": "writeback"}]: dispatch 2021-10-08T19:30:33.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-36"}]: dispatch 2021-10-08T19:30:33.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:33.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-45"}]': finished 2021-10-08T19:30:33.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-29", "mode": "writeback"}]': finished 2021-10-08T19:30:33.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1371023359' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-36"}]': finished 2021-10-08T19:30:33.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: osdmap e230: 8 total, 8 up, 8 in 2021-10-08T19:30:33.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:33.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:33.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:33.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:33.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:33.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:33.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:30:34.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:34.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[32847]: osdmap e231: 8 total, 8 up, 8 in 2021-10-08T19:30:34.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:34.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:34.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[32847]: pgmap v317: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:30:34.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:34.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[42114]: osdmap e231: 8 total, 8 up, 8 in 2021-10-08T19:30:34.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:34.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:34.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:34 smithi157 ceph-mon[42114]: pgmap v317: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:30:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:34.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:34 smithi196 ceph-mon[34258]: osdmap e231: 8 total, 8 up, 8 in 2021-10-08T19:30:34.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:34.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:34.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:34 smithi196 ceph-mon[34258]: pgmap v317: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:30:35.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:35.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:35 smithi157 ceph-mon[32847]: osdmap e232: 8 total, 8 up, 8 in 2021-10-08T19:30:35.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:35.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:35.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:35.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:35 smithi157 ceph-mon[42114]: osdmap e232: 8 total, 8 up, 8 in 2021-10-08T19:30:35.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:35.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:35.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:35 smithi196 ceph-mon[34258]: osdmap e232: 8 total, 8 up, 8 in 2021-10-08T19:30:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:35.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:36.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-37"}]': finished 2021-10-08T19:30:36.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:36.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-45"}]': finished 2021-10-08T19:30:36.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: osdmap e233: 8 total, 8 up, 8 in 2021-10-08T19:30:36.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:36.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:36.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:36.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: pgmap v320: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:36.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:36.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:36.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:36.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-37"}]': finished 2021-10-08T19:30:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:36.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-45"}]': finished 2021-10-08T19:30:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: osdmap e233: 8 total, 8 up, 8 in 2021-10-08T19:30:36.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:36.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:36.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:36.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: pgmap v320: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:36.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:36.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:36.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:36.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:36.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-37"}]': finished 2021-10-08T19:30:36.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:36.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-45"}]': finished 2021-10-08T19:30:36.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: osdmap e233: 8 total, 8 up, 8 in 2021-10-08T19:30:36.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-45"}]: dispatch 2021-10-08T19:30:36.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:36.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29"}]: dispatch 2021-10-08T19:30:36.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: pgmap v320: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:37.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:30:36 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:30:37.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:37] "GET /metrics HTTP/1.1" 200 158668 "" "Prometheus/2.18.1" 2021-10-08T19:30:37.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:37.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-45"}]': finished 2021-10-08T19:30:37.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29"}]': finished 2021-10-08T19:30:37.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: osdmap e234: 8 total, 8 up, 8 in 2021-10-08T19:30:37.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:37.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:37.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-45"}]': finished 2021-10-08T19:30:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29"}]': finished 2021-10-08T19:30:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: osdmap e234: 8 total, 8 up, 8 in 2021-10-08T19:30:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:37.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:37.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:37.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:37.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:37.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:37.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:37 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:38.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2227051109' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-45"}]': finished 2021-10-08T19:30:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-29"}]': finished 2021-10-08T19:30:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: osdmap e234: 8 total, 8 up, 8 in 2021-10-08T19:30:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:38.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:38.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:37 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: osdmap e235: 8 total, 8 up, 8 in 2021-10-08T19:30:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: pgmap v323: 196 pgs: 196 active+clean; 4.6 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:30:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]': finished 2021-10-08T19:30:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: osdmap e236: 8 total, 8 up, 8 in 2021-10-08T19:30:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:39.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: osdmap e235: 8 total, 8 up, 8 in 2021-10-08T19:30:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: pgmap v323: 196 pgs: 196 active+clean; 4.6 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:30:39.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]': finished 2021-10-08T19:30:39.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: osdmap e236: 8 total, 8 up, 8 in 2021-10-08T19:30:39.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:39.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:39.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:30:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: osdmap e235: 8 total, 8 up, 8 in 2021-10-08T19:30:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: pgmap v323: 196 pgs: 196 active+clean; 4.6 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:30:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-37"}]': finished 2021-10-08T19:30:39.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: osdmap e236: 8 total, 8 up, 8 in 2021-10-08T19:30:39.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2061315279' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:39.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]: dispatch 2021-10-08T19:30:39.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-46"}]': finished 2021-10-08T19:30:40.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]': finished 2021-10-08T19:30:40.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:40.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: osdmap e237: 8 total, 8 up, 8 in 2021-10-08T19:30:40.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:40.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:40.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[32847]: pgmap v326: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:30:40.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-46"}]': finished 2021-10-08T19:30:40.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]': finished 2021-10-08T19:30:40.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:40.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: osdmap e237: 8 total, 8 up, 8 in 2021-10-08T19:30:40.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:40.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:40.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:40 smithi157 ceph-mon[42114]: pgmap v326: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:30:40.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-46"}]': finished 2021-10-08T19:30:40.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-37"}]': finished 2021-10-08T19:30:40.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:40.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: osdmap e237: 8 total, 8 up, 8 in 2021-10-08T19:30:40.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:40.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:40.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:40.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:40 smithi196 ceph-mon[34258]: pgmap v326: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:30:42.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:42.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:42.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[32847]: osdmap e238: 8 total, 8 up, 8 in 2021-10-08T19:30:42.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:42.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:42.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:42.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:42.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:42.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:42.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[42114]: osdmap e238: 8 total, 8 up, 8 in 2021-10-08T19:30:42.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:42.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:42.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:42.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:42.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:41 smithi196 ceph-mon[34258]: osdmap e238: 8 total, 8 up, 8 in 2021-10-08T19:30:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:42.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:42.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:42.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: pgmap v329: 228 pgs: 228 active+clean; 4.6 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-31"}]': finished 2021-10-08T19:30:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: osdmap e239: 8 total, 8 up, 8 in 2021-10-08T19:30:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-31", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-31", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:43.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-38"}]': finished 2021-10-08T19:30:43.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-31", "mode": "writeback"}]': finished 2021-10-08T19:30:43.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]': finished 2021-10-08T19:30:43.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: osdmap e240: 8 total, 8 up, 8 in 2021-10-08T19:30:43.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:43.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:43.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: pgmap v329: 228 pgs: 228 active+clean; 4.6 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:43.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-31"}]': finished 2021-10-08T19:30:43.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: osdmap e239: 8 total, 8 up, 8 in 2021-10-08T19:30:43.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-31", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-31", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:43.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-38"}]': finished 2021-10-08T19:30:43.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-31", "mode": "writeback"}]': finished 2021-10-08T19:30:43.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]': finished 2021-10-08T19:30:43.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: osdmap e240: 8 total, 8 up, 8 in 2021-10-08T19:30:43.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:43.088 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:43.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: pgmap v329: 228 pgs: 228 active+clean; 4.6 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-31"}]': finished 2021-10-08T19:30:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: osdmap e239: 8 total, 8 up, 8 in 2021-10-08T19:30:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-31", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-31", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:43.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-38"}]': finished 2021-10-08T19:30:43.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-31", "mode": "writeback"}]': finished 2021-10-08T19:30:43.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-46"}]': finished 2021-10-08T19:30:43.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: osdmap e240: 8 total, 8 up, 8 in 2021-10-08T19:30:43.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3198402937' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]: dispatch 2021-10-08T19:30:43.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:43.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:43.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:43.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:43.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:43.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:30:44.579 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:44 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:30:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:44.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]': finished 2021-10-08T19:30:44.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:44.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: osdmap e241: 8 total, 8 up, 8 in 2021-10-08T19:30:44.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:44.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:44.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:44.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:44.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: pgmap v332: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:44.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:44.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]': finished 2021-10-08T19:30:44.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:44.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: osdmap e241: 8 total, 8 up, 8 in 2021-10-08T19:30:44.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:44.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:44.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:44.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:44.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: pgmap v332: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:44.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:44 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:44.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-46"}]': finished 2021-10-08T19:30:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: osdmap e241: 8 total, 8 up, 8 in 2021-10-08T19:30:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31"}]: dispatch 2021-10-08T19:30:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: pgmap v332: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:44.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:44 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:45.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:30:45.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:30:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:45.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:45.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31"}]': finished 2021-10-08T19:30:45.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:45.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: osdmap e242: 8 total, 8 up, 8 in 2021-10-08T19:30:45.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:45.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:45.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:45.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:45.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:30:45.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:30:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:45.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:45.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31"}]': finished 2021-10-08T19:30:45.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:45.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: osdmap e242: 8 total, 8 up, 8 in 2021-10-08T19:30:45.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:45.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:45.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:45.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:30:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:30:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:45.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-31"}]': finished 2021-10-08T19:30:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: osdmap e242: 8 total, 8 up, 8 in 2021-10-08T19:30:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:45.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:45.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:46.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[32847]: pgmap v335: 196 pgs: 196 active+clean; 4.6 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:46.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]': finished 2021-10-08T19:30:46.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[32847]: osdmap e243: 8 total, 8 up, 8 in 2021-10-08T19:30:46.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:46.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:46.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[42114]: pgmap v335: 196 pgs: 196 active+clean; 4.6 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:46.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]': finished 2021-10-08T19:30:46.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[42114]: osdmap e243: 8 total, 8 up, 8 in 2021-10-08T19:30:46.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:46.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:46.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:46 smithi196 ceph-mon[34258]: pgmap v335: 196 pgs: 196 active+clean; 4.6 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:46.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-38"}]': finished 2021-10-08T19:30:46.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:46 smithi196 ceph-mon[34258]: osdmap e243: 8 total, 8 up, 8 in 2021-10-08T19:30:46.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1552171640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:46.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]: dispatch 2021-10-08T19:30:47.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:30:46 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:30:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:47] "GET /metrics HTTP/1.1" 200 158668 "" "Prometheus/2.18.1" 2021-10-08T19:30:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:47 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:30:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-47"}]': finished 2021-10-08T19:30:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]': finished 2021-10-08T19:30:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[32847]: osdmap e244: 8 total, 8 up, 8 in 2021-10-08T19:30:47.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:47.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:47.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:47.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:47.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-47"}]': finished 2021-10-08T19:30:47.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]': finished 2021-10-08T19:30:47.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[42114]: osdmap e244: 8 total, 8 up, 8 in 2021-10-08T19:30:47.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:47.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:47 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:47.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-47"}]': finished 2021-10-08T19:30:47.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-38"}]': finished 2021-10-08T19:30:47.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:47 smithi196 ceph-mon[34258]: osdmap e244: 8 total, 8 up, 8 in 2021-10-08T19:30:47.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:47.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:47.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:47.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:47 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: osdmap e245: 8 total, 8 up, 8 in 2021-10-08T19:30:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:49.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:49.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:30:49.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:30:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:49.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[32847]: pgmap v338: 236 pgs: 40 creating+peering, 196 active+clean; 4.6 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:49.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:49.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:49.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: osdmap e245: 8 total, 8 up, 8 in 2021-10-08T19:30:49.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:49.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:49.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:30:49.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:30:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:49.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:48 smithi157 ceph-mon[42114]: pgmap v338: 236 pgs: 40 creating+peering, 196 active+clean; 4.6 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:49.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:30:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: osdmap e245: 8 total, 8 up, 8 in 2021-10-08T19:30:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:30:49.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:30:49.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:30:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:49.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:48 smithi196 ceph-mon[34258]: pgmap v338: 236 pgs: 40 creating+peering, 196 active+clean; 4.6 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:50.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:50.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: osdmap e246: 8 total, 8 up, 8 in 2021-10-08T19:30:50.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:50.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:50.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-39"}]': finished 2021-10-08T19:30:50.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-33"}]': finished 2021-10-08T19:30:50.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]': finished 2021-10-08T19:30:50.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: osdmap e247: 8 total, 8 up, 8 in 2021-10-08T19:30:50.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-33", "mode": "writeback"}]: dispatch 2021-10-08T19:30:50.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-33", "mode": "writeback"}]: dispatch 2021-10-08T19:30:50.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:50.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: osdmap e246: 8 total, 8 up, 8 in 2021-10-08T19:30:50.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:50.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:50.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-39"}]': finished 2021-10-08T19:30:50.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-33"}]': finished 2021-10-08T19:30:50.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]': finished 2021-10-08T19:30:50.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: osdmap e247: 8 total, 8 up, 8 in 2021-10-08T19:30:50.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-33", "mode": "writeback"}]: dispatch 2021-10-08T19:30:50.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-33", "mode": "writeback"}]: dispatch 2021-10-08T19:30:50.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:50.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: osdmap e246: 8 total, 8 up, 8 in 2021-10-08T19:30:50.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:50.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:50.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-39"}]': finished 2021-10-08T19:30:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-33"}]': finished 2021-10-08T19:30:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-47"}]': finished 2021-10-08T19:30:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: osdmap e247: 8 total, 8 up, 8 in 2021-10-08T19:30:50.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1896702505' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]: dispatch 2021-10-08T19:30:50.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-33", "mode": "writeback"}]: dispatch 2021-10-08T19:30:50.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-33", "mode": "writeback"}]: dispatch 2021-10-08T19:30:51.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[32847]: pgmap v341: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:51.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]': finished 2021-10-08T19:30:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-33", "mode": "writeback"}]': finished 2021-10-08T19:30:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[32847]: osdmap e248: 8 total, 8 up, 8 in 2021-10-08T19:30:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:51.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[42114]: pgmap v341: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:51.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:51.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]': finished 2021-10-08T19:30:51.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-33", "mode": "writeback"}]': finished 2021-10-08T19:30:51.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[42114]: osdmap e248: 8 total, 8 up, 8 in 2021-10-08T19:30:51.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:50 smithi196 ceph-mon[34258]: pgmap v341: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:50 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:51.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-47"}]': finished 2021-10-08T19:30:51.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-33", "mode": "writeback"}]': finished 2021-10-08T19:30:51.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:50 smithi196 ceph-mon[34258]: osdmap e248: 8 total, 8 up, 8 in 2021-10-08T19:30:51.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:52.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:52.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:52.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[32847]: osdmap e249: 8 total, 8 up, 8 in 2021-10-08T19:30:52.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1836206391' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:52.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:52.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:52.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:52.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:52.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:52.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:52.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[42114]: osdmap e249: 8 total, 8 up, 8 in 2021-10-08T19:30:52.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1836206391' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:52.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:52.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:52.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:52.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:30:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:30:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:51 smithi196 ceph-mon[34258]: osdmap e249: 8 total, 8 up, 8 in 2021-10-08T19:30:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1836206391' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:52.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:52.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:52.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:52.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33"}]: dispatch 2021-10-08T19:30:53.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[32847]: pgmap v344: 260 pgs: 32 creating+peering, 228 active+clean; 4.6 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2021-10-08T19:30:53.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-48","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-39"}]': finished 2021-10-08T19:30:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33"}]': finished 2021-10-08T19:30:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[32847]: osdmap e250: 8 total, 8 up, 8 in 2021-10-08T19:30:53.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:53.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[42114]: pgmap v344: 260 pgs: 32 creating+peering, 228 active+clean; 4.6 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2021-10-08T19:30:53.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:53.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-48","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:53.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-39"}]': finished 2021-10-08T19:30:53.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33"}]': finished 2021-10-08T19:30:53.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[42114]: osdmap e250: 8 total, 8 up, 8 in 2021-10-08T19:30:53.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:52 smithi196 ceph-mon[34258]: pgmap v344: 260 pgs: 32 creating+peering, 228 active+clean; 4.6 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2021-10-08T19:30:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:52 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:53.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-48","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:53.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-39"}]': finished 2021-10-08T19:30:53.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-33"}]': finished 2021-10-08T19:30:53.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:52 smithi196 ceph-mon[34258]: osdmap e250: 8 total, 8 up, 8 in 2021-10-08T19:30:53.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-39"}]: dispatch 2021-10-08T19:30:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:53.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:53.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:30:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:30:53.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:30:54.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-39"}]': finished 2021-10-08T19:30:54.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: osdmap e251: 8 total, 8 up, 8 in 2021-10-08T19:30:54.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: pgmap v347: 196 pgs: 196 active+clean; 4.6 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:54.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:54.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:54.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-39"}]': finished 2021-10-08T19:30:54.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: osdmap e251: 8 total, 8 up, 8 in 2021-10-08T19:30:54.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: pgmap v347: 196 pgs: 196 active+clean; 4.6 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:54.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:54.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:54.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2368939071' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-39"}]': finished 2021-10-08T19:30:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: osdmap e251: 8 total, 8 up, 8 in 2021-10-08T19:30:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: pgmap v347: 196 pgs: 196 active+clean; 4.6 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:54.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:54.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:56.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:56.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[32847]: osdmap e252: 8 total, 8 up, 8 in 2021-10-08T19:30:56.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:56.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:56.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:56.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:56.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:56.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[42114]: osdmap e252: 8 total, 8 up, 8 in 2021-10-08T19:30:56.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:56.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:56.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:56.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88488-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:56 smithi196 ceph-mon[34258]: osdmap e252: 8 total, 8 up, 8 in 2021-10-08T19:30:56.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:56.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:56.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:56.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: pgmap v350: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 383 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: osdmap e253: 8 total, 8 up, 8 in 2021-10-08T19:30:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-49"}]': finished 2021-10-08T19:30:57.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-40"}]': finished 2021-10-08T19:30:57.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:57.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: osdmap e254: 8 total, 8 up, 8 in 2021-10-08T19:30:57.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:30:57.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:30:57.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: pgmap v350: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 383 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:57.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:57.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: osdmap e253: 8 total, 8 up, 8 in 2021-10-08T19:30:57.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:57.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:57.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-49"}]': finished 2021-10-08T19:30:57.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-40"}]': finished 2021-10-08T19:30:57.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:57.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: osdmap e254: 8 total, 8 up, 8 in 2021-10-08T19:30:57.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:30:57.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:30:57.368 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:30:56 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:30:57.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: pgmap v350: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 383 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:57.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:57.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: osdmap e253: 8 total, 8 up, 8 in 2021-10-08T19:30:57.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:57.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:57.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-49"}]': finished 2021-10-08T19:30:57.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88488-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88488-40"}]': finished 2021-10-08T19:30:57.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:57.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: osdmap e254: 8 total, 8 up, 8 in 2021-10-08T19:30:57.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:30:57.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:30:57.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:30:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:57] "GET /metrics HTTP/1.1" 200 158686 "" "Prometheus/2.18.1" 2021-10-08T19:30:58.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:58.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]': finished 2021-10-08T19:30:58.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[32847]: osdmap e255: 8 total, 8 up, 8 in 2021-10-08T19:30:58.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-35", "mode": "writeback"}]: dispatch 2021-10-08T19:30:58.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-35", "mode": "writeback"}]: dispatch 2021-10-08T19:30:58.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[32847]: pgmap v353: 244 pgs: 16 creating+peering, 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:58.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:58.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]': finished 2021-10-08T19:30:58.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[42114]: osdmap e255: 8 total, 8 up, 8 in 2021-10-08T19:30:58.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-35", "mode": "writeback"}]: dispatch 2021-10-08T19:30:58.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-35", "mode": "writeback"}]: dispatch 2021-10-08T19:30:58.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:58 smithi157 ceph-mon[42114]: pgmap v353: 244 pgs: 16 creating+peering, 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:58.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:58.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]': finished 2021-10-08T19:30:58.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:58 smithi196 ceph-mon[34258]: osdmap e255: 8 total, 8 up, 8 in 2021-10-08T19:30:58.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-35", "mode": "writeback"}]: dispatch 2021-10-08T19:30:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-35", "mode": "writeback"}]: dispatch 2021-10-08T19:30:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:58 smithi196 ceph-mon[34258]: pgmap v353: 244 pgs: 16 creating+peering, 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:58.868 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:30:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:30:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:59.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:59.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-35", "mode": "writeback"}]': finished 2021-10-08T19:30:59.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[32847]: osdmap e256: 8 total, 8 up, 8 in 2021-10-08T19:30:59.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:59.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:59.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:59.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:59.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-35", "mode": "writeback"}]': finished 2021-10-08T19:30:59.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[42114]: osdmap e256: 8 total, 8 up, 8 in 2021-10-08T19:30:59.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:59.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:59.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:30:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:59 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-35", "mode": "writeback"}]': finished 2021-10-08T19:30:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:59 smithi196 ceph-mon[34258]: osdmap e256: 8 total, 8 up, 8 in 2021-10-08T19:30:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:30:59.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:30:59.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:30:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:31:00.558 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ]ndTrip 2021-10-08T19:31:00.558 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7022 ms) 2021-10-08T19:31:00.558 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2021-10-08T19:31:00.559 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7013 ms) 2021-10-08T19:31:00.559 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2021-10-08T19:31:00.563 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7014 ms) 2021-10-08T19:31:00.563 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2021-10-08T19:31:00.563 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7030 ms) 2021-10-08T19:31:00.563 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2021-10-08T19:31:00.563 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7021 ms) 2021-10-08T19:31:00.564 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2021-10-08T19:31:00.564 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7034 ms) 2021-10-08T19:31:00.564 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2021-10-08T19:31:00.564 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6897 ms) 2021-10-08T19:31:00.565 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2021-10-08T19:31:00.565 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7018 ms) 2021-10-08T19:31:00.566 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2021-10-08T19:31:00.567 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7028 ms) 2021-10-08T19:31:00.567 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2021-10-08T19:31:00.567 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6966 ms) 2021-10-08T19:31:00.567 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2021-10-08T19:31:00.567 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6993 ms) 2021-10-08T19:31:00.568 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2021-10-08T19:31:00.568 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7024 ms) 2021-10-08T19:31:00.568 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2021-10-08T19:31:00.569 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7007 ms) 2021-10-08T19:31:00.569 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2021-10-08T19:31:00.569 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7031 ms) 2021-10-08T19:31:00.569 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112077 ms total) 2021-10-08T19:31:00.569 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: 2021-10-08T19:31:00.570 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [----------] Global test environment tear-down 2021-10-08T19:31:00.570 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [==========] 40 tests from 2 test suites ran. (192689 ms total) 2021-10-08T19:31:00.570 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio: [ PASSED ] 40 tests. 2021-10-08T19:31:00.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-49"}]': finished 2021-10-08T19:31:00.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]': finished 2021-10-08T19:31:00.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[32847]: osdmap e257: 8 total, 8 up, 8 in 2021-10-08T19:31:00.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:31:00.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:31:00.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:31:00.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[32847]: pgmap v356: 228 pgs: 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:00.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-49"}]': finished 2021-10-08T19:31:00.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]': finished 2021-10-08T19:31:00.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[42114]: osdmap e257: 8 total, 8 up, 8 in 2021-10-08T19:31:00.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:31:00.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:31:00.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:31:00.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:00 smithi157 ceph-mon[42114]: pgmap v356: 228 pgs: 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-49"}]': finished 2021-10-08T19:31:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88488-40"}]': finished 2021-10-08T19:31:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:00 smithi196 ceph-mon[34258]: osdmap e257: 8 total, 8 up, 8 in 2021-10-08T19:31:00.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-49"}]: dispatch 2021-10-08T19:31:00.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2595464830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:31:00.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]: dispatch 2021-10-08T19:31:00.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:00 smithi196 ceph-mon[34258]: pgmap v356: 228 pgs: 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:01.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-49"}]': finished 2021-10-08T19:31:01.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]': finished 2021-10-08T19:31:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: osdmap e258: 8 total, 8 up, 8 in 2021-10-08T19:31:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:01.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:01.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-49"}]': finished 2021-10-08T19:31:01.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]': finished 2021-10-08T19:31:01.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: osdmap e258: 8 total, 8 up, 8 in 2021-10-08T19:31:01.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:01.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:01.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1655892474' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-49"}]': finished 2021-10-08T19:31:01.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88488-40"}]': finished 2021-10-08T19:31:01.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: osdmap e258: 8 total, 8 up, 8 in 2021-10-08T19:31:01.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:01.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:01.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:02.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:02.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:02.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[32847]: osdmap e259: 8 total, 8 up, 8 in 2021-10-08T19:31:02.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:02.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:02.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:02.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:02.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[32847]: pgmap v359: 228 pgs: 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2021-10-08T19:31:02.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:02.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:02.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[42114]: osdmap e259: 8 total, 8 up, 8 in 2021-10-08T19:31:02.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:02.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:02.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:02.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:02.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:02 smithi157 ceph-mon[42114]: pgmap v359: 228 pgs: 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2021-10-08T19:31:02.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:02.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:02.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:02 smithi196 ceph-mon[34258]: osdmap e259: 8 total, 8 up, 8 in 2021-10-08T19:31:02.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:02.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:02.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:02.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:02.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:02 smithi196 ceph-mon[34258]: pgmap v359: 228 pgs: 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2021-10-08T19:31:03.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]': finished 2021-10-08T19:31:03.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:03 smithi157 ceph-mon[32847]: osdmap e260: 8 total, 8 up, 8 in 2021-10-08T19:31:03.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]': finished 2021-10-08T19:31:03.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:03 smithi157 ceph-mon[42114]: osdmap e260: 8 total, 8 up, 8 in 2021-10-08T19:31:03.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:03.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:03.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:03.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:03.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:03.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:31:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-35"}]': finished 2021-10-08T19:31:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:03 smithi196 ceph-mon[34258]: osdmap e260: 8 total, 8 up, 8 in 2021-10-08T19:31:04.817 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-50"}]': finished 2021-10-08T19:31:04.817 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:04 smithi196 ceph-mon[34258]: osdmap e261: 8 total, 8 up, 8 in 2021-10-08T19:31:04.817 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:04.818 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:04.818 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:04 smithi196 ceph-mon[34258]: pgmap v362: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2021-10-08T19:31:04.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-50"}]': finished 2021-10-08T19:31:04.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[32847]: osdmap e261: 8 total, 8 up, 8 in 2021-10-08T19:31:04.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:04.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[32847]: pgmap v362: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2021-10-08T19:31:04.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-50"}]': finished 2021-10-08T19:31:04.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[42114]: osdmap e261: 8 total, 8 up, 8 in 2021-10-08T19:31:04.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:04.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:04.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:04 smithi157 ceph-mon[42114]: pgmap v362: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2021-10-08T19:31:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:05 smithi196 ceph-mon[34258]: osdmap e262: 8 total, 8 up, 8 in 2021-10-08T19:31:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:05.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:06.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:06.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:05 smithi157 ceph-mon[42114]: osdmap e262: 8 total, 8 up, 8 in 2021-10-08T19:31:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:06.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:06.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:05 smithi157 ceph-mon[32847]: osdmap e262: 8 total, 8 up, 8 in 2021-10-08T19:31:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:06.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35"}]: dispatch 2021-10-08T19:31:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:06 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35"}]': finished 2021-10-08T19:31:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:06 smithi196 ceph-mon[34258]: osdmap e263: 8 total, 8 up, 8 in 2021-10-08T19:31:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:06.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:06 smithi196 ceph-mon[34258]: pgmap v365: 228 pgs: 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:07.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:07.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35"}]': finished 2021-10-08T19:31:07.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[42114]: osdmap e263: 8 total, 8 up, 8 in 2021-10-08T19:31:07.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:07.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:07.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[42114]: pgmap v365: 228 pgs: 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:07.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:07.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-35"}]': finished 2021-10-08T19:31:07.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[32847]: osdmap e263: 8 total, 8 up, 8 in 2021-10-08T19:31:07.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:07.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:07.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:06 smithi157 ceph-mon[32847]: pgmap v365: 228 pgs: 228 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:07.366 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:31:06 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:31:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:07] "GET /metrics HTTP/1.1" 200 157638 "" "Prometheus/2.18.1" 2021-10-08T19:31:07.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]': finished 2021-10-08T19:31:07.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:07 smithi157 ceph-mon[32847]: osdmap e264: 8 total, 8 up, 8 in 2021-10-08T19:31:07.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:07.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:07.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]': finished 2021-10-08T19:31:07.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:07 smithi157 ceph-mon[42114]: osdmap e264: 8 total, 8 up, 8 in 2021-10-08T19:31:07.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:07.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:07.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-50"}]': finished 2021-10-08T19:31:07.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:07 smithi196 ceph-mon[34258]: osdmap e264: 8 total, 8 up, 8 in 2021-10-08T19:31:07.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2889004291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:07.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]: dispatch 2021-10-08T19:31:08.867 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:31:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:08.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:08.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]': finished 2021-10-08T19:31:08.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: osdmap e265: 8 total, 8 up, 8 in 2021-10-08T19:31:08.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:08.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:08.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:08.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:08.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:08.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: pgmap v368: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 376 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:31:08.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:08.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:08.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:08 smithi196 ceph-mon[34258]: osdmap e266: 8 total, 8 up, 8 in 2021-10-08T19:31:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]': finished 2021-10-08T19:31:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: osdmap e265: 8 total, 8 up, 8 in 2021-10-08T19:31:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: pgmap v368: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 376 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:31:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:09.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:09.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[32847]: osdmap e266: 8 total, 8 up, 8 in 2021-10-08T19:31:09.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:09.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-50"}]': finished 2021-10-08T19:31:09.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: osdmap e265: 8 total, 8 up, 8 in 2021-10-08T19:31:09.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:09.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:09.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:09.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:09.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:09.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: pgmap v368: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 376 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:31:09.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:09.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:09.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:08 smithi157 ceph-mon[42114]: osdmap e266: 8 total, 8 up, 8 in 2021-10-08T19:31:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:10.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:10.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: osdmap e267: 8 total, 8 up, 8 in 2021-10-08T19:31:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: pgmap v371: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 376 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:31:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-51"}]': finished 2021-10-08T19:31:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-37"}]': finished 2021-10-08T19:31:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: osdmap e268: 8 total, 8 up, 8 in 2021-10-08T19:31:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-37", "mode": "writeback"}]: dispatch 2021-10-08T19:31:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-37", "mode": "writeback"}]: dispatch 2021-10-08T19:31:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: osdmap e267: 8 total, 8 up, 8 in 2021-10-08T19:31:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: pgmap v371: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 376 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:31:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-51"}]': finished 2021-10-08T19:31:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-37"}]': finished 2021-10-08T19:31:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: osdmap e268: 8 total, 8 up, 8 in 2021-10-08T19:31:11.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-37", "mode": "writeback"}]: dispatch 2021-10-08T19:31:11.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-37", "mode": "writeback"}]: dispatch 2021-10-08T19:31:11.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: osdmap e267: 8 total, 8 up, 8 in 2021-10-08T19:31:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: pgmap v371: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 376 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:31:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-51"}]': finished 2021-10-08T19:31:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-37"}]': finished 2021-10-08T19:31:11.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: osdmap e268: 8 total, 8 up, 8 in 2021-10-08T19:31:11.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-37", "mode": "writeback"}]: dispatch 2021-10-08T19:31:11.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-37", "mode": "writeback"}]: dispatch 2021-10-08T19:31:11.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:11 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:31:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:12.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:12.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:31:12.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:31:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:12.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:12.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-37", "mode": "writeback"}]': finished 2021-10-08T19:31:12.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[32847]: osdmap e269: 8 total, 8 up, 8 in 2021-10-08T19:31:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:12.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[32847]: pgmap v374: 236 pgs: 236 active+clean; 4.6 MiB data, 382 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:31:12.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:12.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:31:12.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:31:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:12.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:12.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-37", "mode": "writeback"}]': finished 2021-10-08T19:31:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[42114]: osdmap e269: 8 total, 8 up, 8 in 2021-10-08T19:31:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:12.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:12 smithi157 ceph-mon[42114]: pgmap v374: 236 pgs: 236 active+clean; 4.6 MiB data, 382 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:31:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:12 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:12 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:31:12.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:12 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:31:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:12 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-37", "mode": "writeback"}]': finished 2021-10-08T19:31:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:12 smithi196 ceph-mon[34258]: osdmap e269: 8 total, 8 up, 8 in 2021-10-08T19:31:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:12.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:12.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:12 smithi196 ceph-mon[34258]: pgmap v374: 236 pgs: 236 active+clean; 4.6 MiB data, 382 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:31:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:13.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:13.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:13.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:13.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:31:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:13.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[32847]: osdmap e270: 8 total, 8 up, 8 in 2021-10-08T19:31:13.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:13.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:13.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:13.831 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:13 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:31:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:13.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:13.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:13.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[42114]: osdmap e270: 8 total, 8 up, 8 in 2021-10-08T19:31:13.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:13.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:13.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:13 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:13.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:13 smithi196 ceph-mon[34258]: osdmap e270: 8 total, 8 up, 8 in 2021-10-08T19:31:13.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:13.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:13.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37"}]: dispatch 2021-10-08T19:31:14.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:14.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-51"}]': finished 2021-10-08T19:31:14.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37"}]': finished 2021-10-08T19:31:14.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[32847]: osdmap e271: 8 total, 8 up, 8 in 2021-10-08T19:31:14.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:14.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:14.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:31:14.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:31:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:14.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[32847]: pgmap v377: 228 pgs: 228 active+clean; 4.6 MiB data, 382 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:31:14.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:14.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-51"}]': finished 2021-10-08T19:31:14.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37"}]': finished 2021-10-08T19:31:14.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[42114]: osdmap e271: 8 total, 8 up, 8 in 2021-10-08T19:31:14.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:14.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:14.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:31:14.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:31:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:14.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:14 smithi157 ceph-mon[42114]: pgmap v377: 228 pgs: 228 active+clean; 4.6 MiB data, 382 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:31:14.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:14 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:14.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-51"}]': finished 2021-10-08T19:31:14.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-37"}]': finished 2021-10-08T19:31:14.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:14 smithi196 ceph-mon[34258]: osdmap e271: 8 total, 8 up, 8 in 2021-10-08T19:31:14.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-51"}]: dispatch 2021-10-08T19:31:14.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:14 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:14.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:14 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:31:14.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:14 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:31:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:14.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:14 smithi196 ceph-mon[34258]: pgmap v377: 228 pgs: 228 active+clean; 4.6 MiB data, 382 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:31:15.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-51"}]': finished 2021-10-08T19:31:15.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[32847]: osdmap e272: 8 total, 8 up, 8 in 2021-10-08T19:31:15.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:15.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:15.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-51"}]': finished 2021-10-08T19:31:15.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[42114]: osdmap e272: 8 total, 8 up, 8 in 2021-10-08T19:31:15.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:15.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:15.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1430502616' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-51"}]': finished 2021-10-08T19:31:15.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:15 smithi196 ceph-mon[34258]: osdmap e272: 8 total, 8 up, 8 in 2021-10-08T19:31:15.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:15.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:15.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:16.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:16.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[32847]: osdmap e273: 8 total, 8 up, 8 in 2021-10-08T19:31:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:16.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:16.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[32847]: pgmap v380: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 382 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:16.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:16.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[42114]: osdmap e273: 8 total, 8 up, 8 in 2021-10-08T19:31:16.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:16.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:16.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:16.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:16.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:16 smithi157 ceph-mon[42114]: pgmap v380: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 382 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:16.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:16.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:16 smithi196 ceph-mon[34258]: osdmap e273: 8 total, 8 up, 8 in 2021-10-08T19:31:16.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:16.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:16.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:16.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:16.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:16 smithi196 ceph-mon[34258]: pgmap v380: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 382 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:17.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:31:16 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:31:17.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:17] "GET /metrics HTTP/1.1" 200 157638 "" "Prometheus/2.18.1" 2021-10-08T19:31:17.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:17.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:17 smithi157 ceph-mon[32847]: osdmap e274: 8 total, 8 up, 8 in 2021-10-08T19:31:17.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:17.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:17 smithi157 ceph-mon[42114]: osdmap e274: 8 total, 8 up, 8 in 2021-10-08T19:31:17.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:17 smithi196 ceph-mon[34258]: osdmap e274: 8 total, 8 up, 8 in 2021-10-08T19:31:17.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:18.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:18.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-52"}]': finished 2021-10-08T19:31:18.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:18.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[32847]: osdmap e275: 8 total, 8 up, 8 in 2021-10-08T19:31:18.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:18.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:18.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[32847]: pgmap v383: 236 pgs: 8 unknown, 13 creating+peering, 14 creating+activating, 201 active+clean; 4.6 MiB data, 388 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:18.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:18.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-52"}]': finished 2021-10-08T19:31:18.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:18.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[42114]: osdmap e275: 8 total, 8 up, 8 in 2021-10-08T19:31:18.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:18.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:18.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:18 smithi157 ceph-mon[42114]: pgmap v383: 236 pgs: 8 unknown, 13 creating+peering, 14 creating+activating, 201 active+clean; 4.6 MiB data, 388 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:18.867 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:31:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:18.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:18.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-52"}]': finished 2021-10-08T19:31:18.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:18.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:18 smithi196 ceph-mon[34258]: osdmap e275: 8 total, 8 up, 8 in 2021-10-08T19:31:18.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:18.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:18.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:18 smithi196 ceph-mon[34258]: pgmap v383: 236 pgs: 8 unknown, 13 creating+peering, 14 creating+activating, 201 active+clean; 4.6 MiB data, 388 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:19.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-39"}]': finished 2021-10-08T19:31:19.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[32847]: osdmap e276: 8 total, 8 up, 8 in 2021-10-08T19:31:19.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-39", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-39", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[32847]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:19.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-39"}]': finished 2021-10-08T19:31:19.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[42114]: osdmap e276: 8 total, 8 up, 8 in 2021-10-08T19:31:19.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-39", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-39", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:19 smithi157 ceph-mon[42114]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:19.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-39"}]': finished 2021-10-08T19:31:19.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:19 smithi196 ceph-mon[34258]: osdmap e276: 8 total, 8 up, 8 in 2021-10-08T19:31:19.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-39", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-39", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:19 smithi196 ceph-mon[34258]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:20.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:20.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-39", "mode": "writeback"}]': finished 2021-10-08T19:31:20.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[32847]: osdmap e277: 8 total, 8 up, 8 in 2021-10-08T19:31:20.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:20.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:20.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:20.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:20.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[32847]: pgmap v386: 228 pgs: 13 creating+peering, 14 creating+activating, 201 active+clean; 4.6 MiB data, 388 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:20.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:20.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-39", "mode": "writeback"}]': finished 2021-10-08T19:31:20.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[42114]: osdmap e277: 8 total, 8 up, 8 in 2021-10-08T19:31:20.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:20.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:20.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:20.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:20.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:20 smithi157 ceph-mon[42114]: pgmap v386: 228 pgs: 13 creating+peering, 14 creating+activating, 201 active+clean; 4.6 MiB data, 388 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:20 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-39", "mode": "writeback"}]': finished 2021-10-08T19:31:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:20 smithi196 ceph-mon[34258]: osdmap e277: 8 total, 8 up, 8 in 2021-10-08T19:31:20.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:20.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:20.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:20 smithi196 ceph-mon[34258]: pgmap v386: 228 pgs: 13 creating+peering, 14 creating+activating, 201 active+clean; 4.6 MiB data, 388 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:21.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]': finished 2021-10-08T19:31:21.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:21.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[32847]: osdmap e278: 8 total, 8 up, 8 in 2021-10-08T19:31:21.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:21.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:21.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:21.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:21.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]': finished 2021-10-08T19:31:21.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[42114]: osdmap e278: 8 total, 8 up, 8 in 2021-10-08T19:31:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:21.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:21 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-52"}]': finished 2021-10-08T19:31:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:31:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:21 smithi196 ceph-mon[34258]: osdmap e278: 8 total, 8 up, 8 in 2021-10-08T19:31:21.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/680840982' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:21.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:21.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]: dispatch 2021-10-08T19:31:21.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:21 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39"}]: dispatch 2021-10-08T19:31:22.548 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [==========] Running 76 tests from 4 test suites. 2021-10-08T19:31:22.549 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] Global test environment set-up. 2021-10-08T19:31:22.549 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2021-10-08T19:31:22.549 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: seed 88568 2021-10-08T19:31:22.550 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2021-10-08T19:31:22.550 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (231 ms) 2021-10-08T19:31:22.550 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2021-10-08T19:31:22.550 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (12560 ms) 2021-10-08T19:31:22.551 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2021-10-08T19:31:22.551 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (24 ms) 2021-10-08T19:31:22.551 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (12815 ms total) 2021-10-08T19:31:22.551 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: 2021-10-08T19:31:22.551 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] 47 tests from LibRadosTwoPoolsPP 2021-10-08T19:31:22.552 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2021-10-08T19:31:22.552 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (7244 ms) 2021-10-08T19:31:22.552 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2021-10-08T19:31:22.552 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (7802 ms) 2021-10-08T19:31:22.553 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2021-10-08T19:31:22.553 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9983 ms) 2021-10-08T19:31:22.553 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2021-10-08T19:31:22.553 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: my_snaps [4] 2021-10-08T19:31:22.553 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: my_snaps [5,4] 2021-10-08T19:31:22.554 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: my_snaps [6,5,4] 2021-10-08T19:31:22.554 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: my_snaps [7,6,5,4] 2021-10-08T19:31:22.554 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: promoting some heads 2021-10-08T19:31:22.554 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: promoting from clones for snap 7 2021-10-08T19:31:22.555 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: promoting from clones for snap 6 2021-10-08T19:31:22.555 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: promoting from clones for snap 5 2021-10-08T19:31:22.555 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: promoting from clones for snap 4 2021-10-08T19:31:22.555 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: waiting for scrubs... 2021-10-08T19:31:22.555 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: done waiting 2021-10-08T19:31:22.556 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46020 ms) 2021-10-08T19:31:22.556 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2021-10-08T19:31:22.556 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (10015 ms) 2021-10-08T19:31:22.556 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2021-10-08T19:31:22.556 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (8008 ms) 2021-10-08T19:31:22.557 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2021-10-08T19:31:22.557 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8031 ms) 2021-10-08T19:31:22.557 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2021-10-08T19:31:22.557 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8038 ms) 2021-10-08T19:31:22.557 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2021-10-08T19:31:22.558 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10294 ms) 2021-10-08T19:31:22.558 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2021-10-08T19:31:22.558 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8660 ms) 2021-10-08T19:31:22.558 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2021-10-08T19:31:22.559 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10019 ms) 2021-10-08T19:31:22.559 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2021-10-08T19:31:22.559 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (11994 ms) 2021-10-08T19:31:22.559 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2021-10-08T19:31:22.560 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8234 ms) 2021-10-08T19:31:22.560 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2021-10-08T19:31:22.560 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7771 ms) 2021-10-08T19:31:22.560 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2021-10-08T19:31:22.561 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13068 ms) 2021-10-08T19:31:22.561 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2021-10-08T19:31:22.561 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7900 ms) 2021-10-08T19:31:22.561 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2021-10-08T19:31:22.561 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8055 ms) 2021-10-08T19:31:22.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:22.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]': finished 2021-10-08T19:31:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39"}]': finished 2021-10-08T19:31:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[32847]: osdmap e279: 8 total, 8 up, 8 in 2021-10-08T19:31:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:22.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[32847]: pgmap v389: 228 pgs: 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 84 op/s 2021-10-08T19:31:22.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:22.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]': finished 2021-10-08T19:31:22.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39"}]': finished 2021-10-08T19:31:22.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[42114]: osdmap e279: 8 total, 8 up, 8 in 2021-10-08T19:31:22.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:22.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:22.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:22.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:22 smithi157 ceph-mon[42114]: pgmap v389: 228 pgs: 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 84 op/s 2021-10-08T19:31:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:22 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-52"}]': finished 2021-10-08T19:31:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:22 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-39"}]': finished 2021-10-08T19:31:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:22 smithi196 ceph-mon[34258]: osdmap e279: 8 total, 8 up, 8 in 2021-10-08T19:31:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:22.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:22 smithi196 ceph-mon[34258]: pgmap v389: 228 pgs: 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 84 op/s 2021-10-08T19:31:23.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:23.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:23 smithi157 ceph-mon[32847]: osdmap e280: 8 total, 8 up, 8 in 2021-10-08T19:31:23.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:23 smithi157 ceph-mon[42114]: osdmap e280: 8 total, 8 up, 8 in 2021-10-08T19:31:23.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:23.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:23.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:23.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:23.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:23.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:23.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:31:23.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:23 smithi196 ceph-mon[34258]: osdmap e280: 8 total, 8 up, 8 in 2021-10-08T19:31:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:24.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:24 smithi157 ceph-mon[32847]: pgmap v392: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:31:24.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:24 smithi157 ceph-mon[32847]: osdmap e281: 8 total, 8 up, 8 in 2021-10-08T19:31:24.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:24.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:24 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:24.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:24 smithi157 ceph-mon[42114]: pgmap v392: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:31:24.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:24 smithi157 ceph-mon[42114]: osdmap e281: 8 total, 8 up, 8 in 2021-10-08T19:31:24.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:24.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:24 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:24.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:24 smithi196 ceph-mon[34258]: pgmap v392: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:31:24.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:24 smithi196 ceph-mon[34258]: osdmap e281: 8 total, 8 up, 8 in 2021-10-08T19:31:24.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:24.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:24 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-53"}]': finished 2021-10-08T19:31:25.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:25.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[42114]: osdmap e282: 8 total, 8 up, 8 in 2021-10-08T19:31:25.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:25.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:25.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-53"}]': finished 2021-10-08T19:31:25.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:25.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[32847]: osdmap e282: 8 total, 8 up, 8 in 2021-10-08T19:31:25.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:25.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:25 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:25.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-53"}]': finished 2021-10-08T19:31:25.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:25.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:25 smithi196 ceph-mon[34258]: osdmap e282: 8 total, 8 up, 8 in 2021-10-08T19:31:25.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:25.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:25 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:26.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:26.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[32847]: osdmap e283: 8 total, 8 up, 8 in 2021-10-08T19:31:26.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:31:26.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:31:26.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[32847]: pgmap v395: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:26.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:26.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[42114]: osdmap e283: 8 total, 8 up, 8 in 2021-10-08T19:31:26.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:31:26.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:31:26.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:26 smithi157 ceph-mon[42114]: pgmap v395: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:26.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:26 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:26.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:26 smithi196 ceph-mon[34258]: osdmap e283: 8 total, 8 up, 8 in 2021-10-08T19:31:26.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:31:26.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:26 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:31:26.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:26 smithi196 ceph-mon[34258]: pgmap v395: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:27.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:31:26 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:31:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:31:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[32847]: osdmap e284: 8 total, 8 up, 8 in 2021-10-08T19:31:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:27.830 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:27] "GET /metrics HTTP/1.1" 200 157718 "" "Prometheus/2.18.1" 2021-10-08T19:31:27.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:31:27.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[42114]: osdmap e284: 8 total, 8 up, 8 in 2021-10-08T19:31:27.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:27.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:27.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:27.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:31:27.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:27 smithi196 ceph-mon[34258]: osdmap e284: 8 total, 8 up, 8 in 2021-10-08T19:31:27.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:27.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:27.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:28.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:28.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:31:28.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-53"}]': finished 2021-10-08T19:31:28.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[42114]: osdmap e285: 8 total, 8 up, 8 in 2021-10-08T19:31:28.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:31:28.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:31:28.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:28.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[42114]: pgmap v398: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:28.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:28.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:31:28.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-53"}]': finished 2021-10-08T19:31:28.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[32847]: osdmap e285: 8 total, 8 up, 8 in 2021-10-08T19:31:28.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:31:28.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:31:28.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:28.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:28 smithi157 ceph-mon[32847]: pgmap v398: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:28.867 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:31:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:28.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:28.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:31:28.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-53"}]': finished 2021-10-08T19:31:28.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:28 smithi196 ceph-mon[34258]: osdmap e285: 8 total, 8 up, 8 in 2021-10-08T19:31:28.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:31:28.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:31:28.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-53"}]: dispatch 2021-10-08T19:31:28.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:28 smithi196 ceph-mon[34258]: pgmap v398: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:29.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:31:29.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-53"}]': finished 2021-10-08T19:31:29.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:29 smithi196 ceph-mon[34258]: osdmap e286: 8 total, 8 up, 8 in 2021-10-08T19:31:29.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:29.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:29.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:29.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:29.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:29.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:31:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-53"}]': finished 2021-10-08T19:31:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[32847]: osdmap e286: 8 total, 8 up, 8 in 2021-10-08T19:31:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-41","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:31:30.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/179217516' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-53"}]': finished 2021-10-08T19:31:30.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[42114]: osdmap e286: 8 total, 8 up, 8 in 2021-10-08T19:31:30.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:30 smithi196 ceph-mon[34258]: osdmap e287: 8 total, 8 up, 8 in 2021-10-08T19:31:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:30.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:30.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41"}]: dispatch 2021-10-08T19:31:30.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41"}]: dispatch 2021-10-08T19:31:30.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:30 smithi196 ceph-mon[34258]: pgmap v401: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:30.955 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:30.956 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[32847]: osdmap e287: 8 total, 8 up, 8 in 2021-10-08T19:31:30.956 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.956 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.957 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:30.957 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:30.957 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41"}]: dispatch 2021-10-08T19:31:30.957 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41"}]: dispatch 2021-10-08T19:31:30.957 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[32847]: pgmap v401: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:30.958 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:30.958 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[42114]: osdmap e287: 8 total, 8 up, 8 in 2021-10-08T19:31:30.958 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.959 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:30.959 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:30.959 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:30.959 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41"}]: dispatch 2021-10-08T19:31:30.960 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41"}]: dispatch 2021-10-08T19:31:30.960 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:30 smithi157 ceph-mon[42114]: pgmap v401: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:31.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:31:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:31:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:31:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:31 smithi196 ceph-mon[34258]: poll took 245493.037 ms: 1 events 2021-10-08T19:31:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41"}]': finished 2021-10-08T19:31:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:31 smithi196 ceph-mon[34258]: osdmap e288: 8 total, 8 up, 8 in 2021-10-08T19:31:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:32.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:31:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:31:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:31:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[32847]: poll took 245493.037 ms: 1 events 2021-10-08T19:31:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41"}]': finished 2021-10-08T19:31:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[32847]: osdmap e288: 8 total, 8 up, 8 in 2021-10-08T19:31:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:32.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:31:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:31:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:31:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[42114]: poll took 245493.037 ms: 1 events 2021-10-08T19:31:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-41"}]': finished 2021-10-08T19:31:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[42114]: osdmap e288: 8 total, 8 up, 8 in 2021-10-08T19:31:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:32.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:32.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-54"}]': finished 2021-10-08T19:31:32.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:32 smithi196 ceph-mon[34258]: osdmap e289: 8 total, 8 up, 8 in 2021-10-08T19:31:32.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:32 smithi196 ceph-mon[34258]: pgmap v404: 204 pgs: 8 creating+peering, 196 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-54"}]': finished 2021-10-08T19:31:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:32 smithi157 ceph-mon[32847]: osdmap e289: 8 total, 8 up, 8 in 2021-10-08T19:31:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:32 smithi157 ceph-mon[32847]: pgmap v404: 204 pgs: 8 creating+peering, 196 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-54"}]': finished 2021-10-08T19:31:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:32 smithi157 ceph-mon[42114]: osdmap e289: 8 total, 8 up, 8 in 2021-10-08T19:31:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:32 smithi157 ceph-mon[42114]: pgmap v404: 204 pgs: 8 creating+peering, 196 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:33.825 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:33 smithi157 ceph-mon[32847]: osdmap e290: 8 total, 8 up, 8 in 2021-10-08T19:31:33.825 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:33.826 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:33.826 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:33 smithi157 ceph-mon[42114]: osdmap e290: 8 total, 8 up, 8 in 2021-10-08T19:31:33.827 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:33.827 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:33.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:33.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:33.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:33.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:31:33.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:33 smithi196 ceph-mon[34258]: osdmap e290: 8 total, 8 up, 8 in 2021-10-08T19:31:33.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:33.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-43","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: osdmap e291: 8 total, 8 up, 8 in 2021-10-08T19:31:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi157-88568-6","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:31:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: pgmap v407: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]': finished 2021-10-08T19:31:35.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: osdmap e292: 8 total, 8 up, 8 in 2021-10-08T19:31:35.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:31:35.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:31:35.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-43","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:35.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: osdmap e291: 8 total, 8 up, 8 in 2021-10-08T19:31:35.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi157-88568-6","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:31:35.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:35.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:35.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: pgmap v407: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:35.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:35.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]': finished 2021-10-08T19:31:35.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: osdmap e292: 8 total, 8 up, 8 in 2021-10-08T19:31:35.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:31:35.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:31:35.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-43","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: osdmap e291: 8 total, 8 up, 8 in 2021-10-08T19:31:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi157-88568-6","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:31:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:35.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: pgmap v407: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:35.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:35.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-54"}]': finished 2021-10-08T19:31:35.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: osdmap e292: 8 total, 8 up, 8 in 2021-10-08T19:31:35.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:31:35.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:31:35.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2464024826' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:35.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]: dispatch 2021-10-08T19:31:36.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_count","val": "8"}]': finished 2021-10-08T19:31:36.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]': finished 2021-10-08T19:31:36.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: osdmap e293: 8 total, 8 up, 8 in 2021-10-08T19:31:36.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:36.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:36.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:36.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:36.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:36.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: pgmap v410: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:36.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:36.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:36.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:36.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:36.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_count","val": "8"}]': finished 2021-10-08T19:31:36.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]': finished 2021-10-08T19:31:36.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: osdmap e293: 8 total, 8 up, 8 in 2021-10-08T19:31:36.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:36.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:36.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:36.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:36.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:36.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: pgmap v410: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:36.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:36.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:36.839 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:36.840 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:36.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_count","val": "8"}]': finished 2021-10-08T19:31:36.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-54"}]': finished 2021-10-08T19:31:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: osdmap e293: 8 total, 8 up, 8 in 2021-10-08T19:31:36.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:36.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:31:36.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:36.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:36.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:36.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: pgmap v410: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:36.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:36.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:36.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:36.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:37.366 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:31:36 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:31:37.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:37] "GET /metrics HTTP/1.1" 200 157570 "" "Prometheus/2.18.1" 2021-10-08T19:31:38.141 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2021-10-08T19:31:38.141 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: hmm, no HitSet yet 2021-10-08T19:31:38.141 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: ok, hit_set contains 186:602f83fe:::foo:head 2021-10-08T19:31:38.142 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9057 ms) 2021-10-08T19:31:38.142 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2021-10-08T19:31:38.143 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg_num = 32 2021-10-08T19:31:38.144 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 0 ls 1633721498,0 2021-10-08T19:31:38.144 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 1 ls 1633721498,0 2021-10-08T19:31:38.144 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 2 ls 1633721498,0 2021-10-08T19:31:38.144 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 3 ls 1633721498,0 2021-10-08T19:31:38.145 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 4 ls 1633721498,0 2021-10-08T19:31:38.145 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 5 ls 1633721498,0 2021-10-08T19:31:38.145 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 6 ls 1633721498,0 2021-10-08T19:31:38.145 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 7 ls 1633721498,0 2021-10-08T19:31:38.146 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 8 ls 1633721498,0 2021-10-08T19:31:38.146 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 9 ls 1633721498,0 2021-10-08T19:31:38.146 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 10 ls 1633721498,0 2021-10-08T19:31:38.146 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 11 ls 1633721498,0 2021-10-08T19:31:38.146 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 12 ls 1633721498,0 2021-10-08T19:31:38.147 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 13 ls 1633721498,0 2021-10-08T19:31:38.147 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 14 ls 1633721498,0 2021-10-08T19:31:38.147 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 15 ls 1633721498,0 2021-10-08T19:31:38.147 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 16 ls 1633721498,0 2021-10-08T19:31:38.148 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 17 ls 1633721498,0 2021-10-08T19:31:38.148 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 18 ls 1633721498,0 2021-10-08T19:31:38.148 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 19 ls 1633721498,0 2021-10-08T19:31:38.149 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 20 ls 1633721498,0 2021-10-08T19:31:38.149 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 21 ls 1633721498,0 2021-10-08T19:31:38.149 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 22 ls 1633721498,0 2021-10-08T19:31:38.149 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 23 ls 1633721498,0 2021-10-08T19:31:38.150 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 24 ls 1633721498,0 2021-10-08T19:31:38.150 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 25 ls 1633721498,0 2021-10-08T19:31:38.151 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 26 ls 1633721498,0 2021-10-08T19:31:38.151 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 27 ls 1633721498,0 2021-10-08T19:31:38.151 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 28 ls 1633721498,0 2021-10-08T19:31:38.151 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 29 ls 1633721498,0 2021-10-08T19:31:38.152 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 30 ls 1633721498,0 2021-10-08T19:31:38.152 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg 31 ls 1633721498,0 2021-10-08T19:31:38.152 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: pg_num = 32 2021-10-08T19:31:38.152 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:6cac518f:::0:head 2021-10-08T19:31:38.153 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:02547ec2:::1:head 2021-10-08T19:31:38.153 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:f905c69b:::2:head 2021-10-08T19:31:38.153 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:cfc208b3:::3:head 2021-10-08T19:31:38.154 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d83876eb:::4:head 2021-10-08T19:31:38.154 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:b29083e3:::5:head 2021-10-08T19:31:38.154 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c4fdafeb:::6:head 2021-10-08T19:31:38.154 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:5c6b0b28:::7:head 2021-10-08T19:31:38.155 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:bd63b0f1:::8:head 2021-10-08T19:31:38.155 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:e960b815:::9:head 2021-10-08T19:31:38.156 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:52ea6a34:::10:head 2021-10-08T19:31:38.157 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:89d3ae78:::11:head 2021-10-08T19:31:38.157 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:de5d7c5f:::12:head 2021-10-08T19:31:38.157 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:566253c9:::13:head 2021-10-08T19:31:38.157 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:62a1935d:::14:head 2021-10-08T19:31:38.158 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:863748b0:::15:head 2021-10-08T19:31:38.158 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:3958e169:::16:head 2021-10-08T19:31:38.158 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:4d4dabf9:::17:head 2021-10-08T19:31:38.158 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:8391935d:::18:head 2021-10-08T19:31:38.159 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:28883081:::19:head 2021-10-08T19:31:38.159 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:69259c59:::20:head 2021-10-08T19:31:38.159 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:4bdb80b7:::21:head 2021-10-08T19:31:38.159 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:a11c5d71:::22:head 2021-10-08T19:31:38.159 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:271af37b:::23:head 2021-10-08T19:31:38.160 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:95b121be:::24:head 2021-10-08T19:31:38.160 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:58d1031b:::25:head 2021-10-08T19:31:38.160 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:0a050783:::26:head 2021-10-08T19:31:38.160 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c709704c:::27:head 2021-10-08T19:31:38.161 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:cbe56eaf:::28:head 2021-10-08T19:31:38.161 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:86b4b162:::29:head 2021-10-08T19:31:38.161 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:70d89383:::30:head 2021-10-08T19:31:38.161 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:dd450c7c:::31:head 2021-10-08T19:31:38.161 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:6d5729b1:::32:head 2021-10-08T19:31:38.162 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c388f3fb:::33:head 2021-10-08T19:31:38.162 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:56cfea31:::34:head 2021-10-08T19:31:38.163 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:9dbc1bf7:::35:head 2021-10-08T19:31:38.163 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:40b74ccd:::36:head 2021-10-08T19:31:38.163 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:4d5aaf42:::37:head 2021-10-08T19:31:38.163 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:920f362c:::38:head 2021-10-08T19:31:38.164 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:6cc53222:::39:head 2021-10-08T19:31:38.164 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:9cad833f:::40:head 2021-10-08T19:31:38.164 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:1ea84d41:::41:head 2021-10-08T19:31:38.164 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c4480ef6:::42:head 2021-10-08T19:31:38.165 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:a694361e:::43:head 2021-10-08T19:31:38.165 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d1bd33e9:::44:head 2021-10-08T19:31:38.165 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:ddc2cd5d:::45:head 2021-10-08T19:31:38.165 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:2b782207:::46:head 2021-10-08T19:31:38.165 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:7b187fca:::47:head 2021-10-08T19:31:38.166 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:90ecdf6f:::48:head 2021-10-08T19:31:38.166 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:a5ed95fe:::49:head 2021-10-08T19:31:38.166 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:ea0eaa55:::50:head 2021-10-08T19:31:38.166 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:f33ef17b:::51:head 2021-10-08T19:31:38.167 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:a0d1b2f6:::52:head 2021-10-08T19:31:38.167 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:60c5229e:::53:head 2021-10-08T19:31:38.167 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:edcbc575:::54:head 2021-10-08T19:31:38.167 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:102cf253:::55:head 2021-10-08T19:31:38.167 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:efb7fb0b:::56:head 2021-10-08T19:31:38.168 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:50d0a326:::57:head 2021-10-08T19:31:38.168 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d4dc5daf:::58:head 2021-10-08T19:31:38.168 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:3a130462:::59:head 2021-10-08T19:31:38.168 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:ec87ed71:::60:head 2021-10-08T19:31:38.168 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d5bc9454:::61:head 2021-10-08T19:31:38.169 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:3ddfe313:::62:head 2021-10-08T19:31:38.169 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:7c2816b9:::63:head 2021-10-08T19:31:38.169 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:47e00e4d:::64:head 2021-10-08T19:31:38.169 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c6410c18:::65:head 2021-10-08T19:31:38.170 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:b48ed237:::66:head 2021-10-08T19:31:38.170 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:cd63ad31:::67:head 2021-10-08T19:31:38.170 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:b179e92b:::68:head 2021-10-08T19:31:38.170 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:0d9f741a:::69:head 2021-10-08T19:31:38.170 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:6d3352ae:::70:head 2021-10-08T19:31:38.171 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c6d5c19e:::71:head 2021-10-08T19:31:38.171 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:bc4729c3:::72:head 2021-10-08T19:31:38.171 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:77e930b9:::73:head 2021-10-08T19:31:38.171 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:0abeecfd:::74:head 2021-10-08T19:31:38.171 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:b7c37e15:::75:head 2021-10-08T19:31:38.172 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:b6378398:::76:head 2021-10-08T19:31:38.172 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:02bd68de:::77:head 2021-10-08T19:31:38.172 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:cc795d2d:::78:head 2021-10-08T19:31:38.172 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:630d4fea:::79:head 2021-10-08T19:31:38.172 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:e0d29ef5:::80:head 2021-10-08T19:31:38.173 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:fd6f13d2:::81:head 2021-10-08T19:31:38.173 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:606461d5:::82:head 2021-10-08T19:31:38.173 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:eadbdc43:::83:head 2021-10-08T19:31:38.173 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:8761d0bb:::84:head 2021-10-08T19:31:38.174 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:9ef0186f:::85:head 2021-10-08T19:31:38.174 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:e0d41294:::86:head 2021-10-08T19:31:38.174 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:961de695:::87:head 2021-10-08T19:31:38.174 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:1423148f:::88:head 2021-10-08T19:31:38.175 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:633a8fa2:::89:head 2021-10-08T19:31:38.175 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:a8653809:::90:head 2021-10-08T19:31:38.175 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:3dac8b33:::91:head 2021-10-08T19:31:38.175 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:35aad435:::92:head 2021-10-08T19:31:38.175 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:f6dcc343:::93:head 2021-10-08T19:31:38.176 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:dbbdad87:::94:head 2021-10-08T19:31:38.176 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:1cb48ce0:::95:head 2021-10-08T19:31:38.176 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:03cd461c:::96:head 2021-10-08T19:31:38.176 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:17a4ea99:::97:head 2021-10-08T19:31:38.177 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:9993c9a7:::98:head 2021-10-08T19:31:38.177 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:6394211c:::99:head 2021-10-08T19:31:38.177 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:94c7ae57:::100:head 2021-10-08T19:31:38.177 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:6fdee5bb:::101:head 2021-10-08T19:31:38.177 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:9a477fd1:::102:head 2021-10-08T19:31:38.178 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:eb850916:::103:head 2021-10-08T19:31:38.178 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:affc56b9:::104:head 2021-10-08T19:31:38.178 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:b42dc814:::105:head 2021-10-08T19:31:38.178 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:f319f8f0:::106:head 2021-10-08T19:31:38.178 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:9a40b9de:::107:head 2021-10-08T19:31:38.179 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:8b524f28:::108:head 2021-10-08T19:31:38.179 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:e3de589f:::109:head 2021-10-08T19:31:38.179 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:90f90a5b:::110:head 2021-10-08T19:31:38.179 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:a7b4f1d7:::111:head 2021-10-08T19:31:38.180 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:af51766e:::112:head 2021-10-08T19:31:38.180 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:b6f90bd1:::113:head 2021-10-08T19:31:38.180 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:e0261208:::114:head 2021-10-08T19:31:38.180 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c9569ef7:::115:head 2021-10-08T19:31:38.181 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:61bebe50:::116:head 2021-10-08T19:31:38.181 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:fe93412b:::117:head 2021-10-08T19:31:38.181 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d3d38bee:::118:head 2021-10-08T19:31:38.181 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:3100ba0c:::119:head 2021-10-08T19:31:38.181 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d0560ada:::120:head 2021-10-08T19:31:38.182 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:f0ea8b35:::121:head 2021-10-08T19:31:38.182 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:766f231a:::122:head 2021-10-08T19:31:38.182 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:a07a2582:::123:head 2021-10-08T19:31:38.183 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:bd7c6b3a:::124:head 2021-10-08T19:31:38.183 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:fb2ddaff:::125:head 2021-10-08T19:31:38.183 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:4408e1fe:::126:head 2021-10-08T19:31:38.183 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:ee1df7a7:::127:head 2021-10-08T19:31:38.183 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c3002909:::128:head 2021-10-08T19:31:38.184 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:4f48ffa9:::129:head 2021-10-08T19:31:38.184 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:edf38733:::130:head 2021-10-08T19:31:38.184 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c08425c0:::131:head 2021-10-08T19:31:38.184 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:5f902d98:::132:head 2021-10-08T19:31:38.185 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:41ea2c93:::133:head 2021-10-08T19:31:38.185 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:813cee13:::134:head 2021-10-08T19:31:38.185 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:0131818d:::135:head 2021-10-08T19:31:38.185 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:26ba5a85:::136:head 2021-10-08T19:31:38.185 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:381b8a5a:::137:head 2021-10-08T19:31:38.186 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:28797e47:::138:head 2021-10-08T19:31:38.186 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:bfca7f22:::139:head 2021-10-08T19:31:38.186 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:36807075:::140:head 2021-10-08T19:31:38.186 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:80b03975:::141:head 2021-10-08T19:31:38.186 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:5c15709b:::142:head 2021-10-08T19:31:38.187 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:f39ea15e:::143:head 2021-10-08T19:31:38.187 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:ea992956:::144:head 2021-10-08T19:31:38.187 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:48887b1c:::145:head 2021-10-08T19:31:38.187 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:9f24a9dd:::146:head 2021-10-08T19:31:38.187 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:987f100b:::147:head 2021-10-08T19:31:38.188 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d2dd3581:::148:head 2021-10-08T19:31:38.188 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:7fed1808:::149:head 2021-10-08T19:31:38.188 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c80b70e9:::150:head 2021-10-08T19:31:38.188 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:85ed90f9:::151:head 2021-10-08T19:31:38.188 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:36428b24:::152:head 2021-10-08T19:31:38.189 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d044c34a:::153:head 2021-10-08T19:31:38.189 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:7c18bf58:::154:head 2021-10-08T19:31:38.189 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d1c21232:::155:head 2021-10-08T19:31:38.189 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:a7a3c575:::156:head 2021-10-08T19:31:38.189 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:87da0633:::157:head 2021-10-08T19:31:38.190 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d5ac3822:::158:head 2021-10-08T19:31:38.190 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:3f20522d:::159:head 2021-10-08T19:31:38.190 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:6ca26563:::160:head 2021-10-08T19:31:38.190 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:532ce135:::161:head 2021-10-08T19:31:38.191 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:c78863e6:::162:head 2021-10-08T19:31:38.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:31:38.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:38.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[32847]: osdmap e294: 8 total, 8 up, 8 in 2021-10-08T19:31:38.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:31:38.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:38.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:31:38.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:31:38.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:38.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[42114]: osdmap e294: 8 total, 8 up, 8 in 2021-10-08T19:31:38.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:31:38.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:38.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:31:38.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:31:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:37 smithi196 ceph-mon[34258]: osdmap e294: 8 total, 8 up, 8 in 2021-10-08T19:31:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:31:38.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:38.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:31:38.882 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:31:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:39.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:38 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:31:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: pgmap v413: 228 pgs: 228 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2021-10-08T19:31:39.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: osdmap e295: 8 total, 8 up, 8 in 2021-10-08T19:31:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi157-88568-43","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:31:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43"}]: dispatch 2021-10-08T19:31:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43"}]: dispatch 2021-10-08T19:31:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-55"}]': finished 2021-10-08T19:31:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43"}]': finished 2021-10-08T19:31:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: osdmap e296: 8 total, 8 up, 8 in 2021-10-08T19:31:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:39.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:39.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: pgmap v413: 228 pgs: 228 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:39.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2021-10-08T19:31:39.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: osdmap e295: 8 total, 8 up, 8 in 2021-10-08T19:31:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi157-88568-43","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:31:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:39.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43"}]: dispatch 2021-10-08T19:31:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43"}]: dispatch 2021-10-08T19:31:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-55"}]': finished 2021-10-08T19:31:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43"}]': finished 2021-10-08T19:31:39.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: osdmap e296: 8 total, 8 up, 8 in 2021-10-08T19:31:39.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:38 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: pgmap v413: 228 pgs: 228 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2021-10-08T19:31:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: osdmap e295: 8 total, 8 up, 8 in 2021-10-08T19:31:39.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi157-88568-43","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:31:39.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:39.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:39.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43"}]: dispatch 2021-10-08T19:31:39.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43"}]: dispatch 2021-10-08T19:31:39.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-55"}]': finished 2021-10-08T19:31:39.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-43"}]': finished 2021-10-08T19:31:39.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: osdmap e296: 8 total, 8 up, 8 in 2021-10-08T19:31:39.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:38 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:39.883 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:39 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:31:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:39 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:31:40.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:39 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:31:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:40.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:39 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:40.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:39 smithi157 ceph-mon[32847]: osdmap e297: 8 total, 8 up, 8 in 2021-10-08T19:31:40.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:39 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:31:40.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:39 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:31:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:40.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:39 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:40.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:39 smithi157 ceph-mon[42114]: osdmap e297: 8 total, 8 up, 8 in 2021-10-08T19:31:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:39 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:31:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:39 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:31:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:39 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:31:40.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:39 smithi196 ceph-mon[34258]: osdmap e297: 8 total, 8 up, 8 in 2021-10-08T19:31:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:31:41.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:31:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:41.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[32847]: pgmap v416: 204 pgs: 8 unknown, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:41.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[32847]: osdmap e298: 8 total, 8 up, 8 in 2021-10-08T19:31:41.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:41.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:41.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:31:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:31:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[42114]: pgmap v416: 204 pgs: 8 unknown, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[42114]: osdmap e298: 8 total, 8 up, 8 in 2021-10-08T19:31:41.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:41.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:41.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:40 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:31:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:40 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:31:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:40 smithi196 ceph-mon[34258]: pgmap v416: 204 pgs: 8 unknown, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:40 smithi196 ceph-mon[34258]: osdmap e298: 8 total, 8 up, 8 in 2021-10-08T19:31:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-45","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-55"}]': finished 2021-10-08T19:31:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[32847]: osdmap e299: 8 total, 8 up, 8 in 2021-10-08T19:31:43.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:43.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:43.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:43.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[32847]: pgmap v419: 228 pgs: 9 creating+activating, 219 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:43.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-45","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:43.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-55"}]': finished 2021-10-08T19:31:43.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[42114]: osdmap e299: 8 total, 8 up, 8 in 2021-10-08T19:31:43.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:43.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:43.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:43.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:42 smithi157 ceph-mon[42114]: pgmap v419: 228 pgs: 9 creating+activating, 219 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-45","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-55"}]': finished 2021-10-08T19:31:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:42 smithi196 ceph-mon[34258]: osdmap e299: 8 total, 8 up, 8 in 2021-10-08T19:31:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-55"}]: dispatch 2021-10-08T19:31:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:42 smithi196 ceph-mon[34258]: pgmap v419: 228 pgs: 9 creating+activating, 219 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:43.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:43.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:43.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:43.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:31:43.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-55"}]': finished 2021-10-08T19:31:43.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:43.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: osdmap e300: 8 total, 8 up, 8 in 2021-10-08T19:31:43.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:31:43.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:31:43.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:43.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:43.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:43.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:43.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-55"}]': finished 2021-10-08T19:31:43.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:43.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: osdmap e300: 8 total, 8 up, 8 in 2021-10-08T19:31:43.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:31:43.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:31:43.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:43.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:43.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:43.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:43.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/229664471' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-55"}]': finished 2021-10-08T19:31:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:44.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: osdmap e300: 8 total, 8 up, 8 in 2021-10-08T19:31:44.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:31:44.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:31:44.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:44.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:44.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:44.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:44.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:44.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:45.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:31:45.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:45.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[32847]: osdmap e301: 8 total, 8 up, 8 in 2021-10-08T19:31:45.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:31:45.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:45.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:31:45.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:45.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[32847]: pgmap v422: 228 pgs: 9 creating+activating, 219 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:45.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:31:45.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:31:45.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:45.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[42114]: osdmap e301: 8 total, 8 up, 8 in 2021-10-08T19:31:45.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:31:45.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:45.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:31:45.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:45.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[42114]: pgmap v422: 228 pgs: 9 creating+activating, 219 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:45.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:31:45.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:31:45.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:45.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:44 smithi196 ceph-mon[34258]: osdmap e301: 8 total, 8 up, 8 in 2021-10-08T19:31:45.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:31:45.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:45.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:31:45.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:45.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:44 smithi196 ceph-mon[34258]: pgmap v422: 228 pgs: 9 creating+activating, 219 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:45.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:31:46.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:31:46.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[32847]: osdmap e302: 8 total, 8 up, 8 in 2021-10-08T19:31:46.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:31:46.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-56"}]': finished 2021-10-08T19:31:46.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:31:46.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[32847]: osdmap e303: 8 total, 8 up, 8 in 2021-10-08T19:31:46.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:31:46.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:31:46.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:31:46.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[42114]: osdmap e302: 8 total, 8 up, 8 in 2021-10-08T19:31:46.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:31:46.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-56"}]': finished 2021-10-08T19:31:46.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:31:46.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[42114]: osdmap e303: 8 total, 8 up, 8 in 2021-10-08T19:31:46.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:31:46.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:31:46.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:31:46.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:45 smithi196 ceph-mon[34258]: osdmap e302: 8 total, 8 up, 8 in 2021-10-08T19:31:46.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:31:46.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-56"}]': finished 2021-10-08T19:31:46.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:31:46.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:45 smithi196 ceph-mon[34258]: osdmap e303: 8 total, 8 up, 8 in 2021-10-08T19:31:46.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:31:46.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:31:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:46 smithi157 ceph-mon[32847]: pgmap v425: 236 pgs: 8 unknown, 9 creating+activating, 219 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:31:47.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:46 smithi157 ceph-mon[32847]: osdmap e304: 8 total, 8 up, 8 in 2021-10-08T19:31:47.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:46 smithi157 ceph-mon[42114]: pgmap v425: 236 pgs: 8 unknown, 9 creating+activating, 219 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:47.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:31:47.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:46 smithi157 ceph-mon[42114]: osdmap e304: 8 total, 8 up, 8 in 2021-10-08T19:31:47.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:46 smithi196 ceph-mon[34258]: pgmap v425: 236 pgs: 8 unknown, 9 creating+activating, 219 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:47.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-45","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:31:47.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:46 smithi196 ceph-mon[34258]: osdmap e304: 8 total, 8 up, 8 in 2021-10-08T19:31:47.368 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:31:46 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:31:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:47] "GET /metrics HTTP/1.1" 200 157570 "" "Prometheus/2.18.1" 2021-10-08T19:31:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[32847]: osdmap e305: 8 total, 8 up, 8 in 2021-10-08T19:31:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[32847]: pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[42114]: osdmap e305: 8 total, 8 up, 8 in 2021-10-08T19:31:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:49.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:48 smithi157 ceph-mon[42114]: pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:49.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:31:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:48 smithi196 ceph-mon[34258]: osdmap e305: 8 total, 8 up, 8 in 2021-10-08T19:31:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:48 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:48 smithi196 ceph-mon[34258]: pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:50.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]': finished 2021-10-08T19:31:50.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:49 smithi157 ceph-mon[32847]: osdmap e306: 8 total, 8 up, 8 in 2021-10-08T19:31:50.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:50.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:50.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]': finished 2021-10-08T19:31:50.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:49 smithi157 ceph-mon[42114]: osdmap e306: 8 total, 8 up, 8 in 2021-10-08T19:31:50.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:50.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:50.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-56"}]': finished 2021-10-08T19:31:50.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:49 smithi196 ceph-mon[34258]: osdmap e306: 8 total, 8 up, 8 in 2021-10-08T19:31:50.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/14901281' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:50.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]: dispatch 2021-10-08T19:31:51.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]': finished 2021-10-08T19:31:51.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:50 smithi157 ceph-mon[32847]: osdmap e307: 8 total, 8 up, 8 in 2021-10-08T19:31:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:50 smithi157 ceph-mon[32847]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:51.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]': finished 2021-10-08T19:31:51.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:50 smithi157 ceph-mon[42114]: osdmap e307: 8 total, 8 up, 8 in 2021-10-08T19:31:51.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:50 smithi157 ceph-mon[42114]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-56"}]': finished 2021-10-08T19:31:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:50 smithi196 ceph-mon[34258]: osdmap e307: 8 total, 8 up, 8 in 2021-10-08T19:31:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:50 smithi196 ceph-mon[34258]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:52.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:51 smithi157 ceph-mon[32847]: osdmap e308: 8 total, 8 up, 8 in 2021-10-08T19:31:52.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2723460898' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:52.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:51 smithi157 ceph-mon[42114]: osdmap e308: 8 total, 8 up, 8 in 2021-10-08T19:31:52.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2723460898' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:51 smithi196 ceph-mon[34258]: osdmap e308: 8 total, 8 up, 8 in 2021-10-08T19:31:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2723460898' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:53.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2723460898' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:52 smithi157 ceph-mon[32847]: osdmap e309: 8 total, 8 up, 8 in 2021-10-08T19:31:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:52 smithi157 ceph-mon[32847]: pgmap v434: 260 pgs: 1 active, 14 creating+peering, 15 creating+activating, 230 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:31:53.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2723460898' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:53.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:52 smithi157 ceph-mon[42114]: osdmap e309: 8 total, 8 up, 8 in 2021-10-08T19:31:53.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:52 smithi157 ceph-mon[42114]: pgmap v434: 260 pgs: 1 active, 14 creating+peering, 15 creating+activating, 230 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:31:53.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2723460898' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88496-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:52 smithi196 ceph-mon[34258]: osdmap e309: 8 total, 8 up, 8 in 2021-10-08T19:31:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:52 smithi196 ceph-mon[34258]: pgmap v434: 260 pgs: 1 active, 14 creating+peering, 15 creating+activating, 230 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:31:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:53.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:53.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:31:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:31:53.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:31:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[32847]: osdmap e310: 8 total, 8 up, 8 in 2021-10-08T19:31:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:53.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:53.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:53.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:53.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:53.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:53.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[42114]: osdmap e310: 8 total, 8 up, 8 in 2021-10-08T19:31:53.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:53.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:53.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:53.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:53.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:53.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:54.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:53 smithi196 ceph-mon[34258]: osdmap e310: 8 total, 8 up, 8 in 2021-10-08T19:31:54.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:54.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:54.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:54.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:54.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:54.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[32847]: osdmap e311: 8 total, 8 up, 8 in 2021-10-08T19:31:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[32847]: pgmap v437: 228 pgs: 228 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:31:55.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:55.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[42114]: osdmap e311: 8 total, 8 up, 8 in 2021-10-08T19:31:55.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:55.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:55.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:54 smithi157 ceph-mon[42114]: pgmap v437: 228 pgs: 228 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:31:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:54 smithi196 ceph-mon[34258]: osdmap e311: 8 total, 8 up, 8 in 2021-10-08T19:31:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:55.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:54 smithi196 ceph-mon[34258]: pgmap v437: 228 pgs: 228 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:31:56.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:55 smithi157 ceph-mon[32847]: osdmap e312: 8 total, 8 up, 8 in 2021-10-08T19:31:56.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:55 smithi157 ceph-mon[42114]: osdmap e312: 8 total, 8 up, 8 in 2021-10-08T19:31:56.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:55 smithi196 ceph-mon[34258]: osdmap e312: 8 total, 8 up, 8 in 2021-10-08T19:31:56.969 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-58"}]': finished 2021-10-08T19:31:56.970 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:56 smithi196 ceph-mon[34258]: osdmap e313: 8 total, 8 up, 8 in 2021-10-08T19:31:56.970 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:56 smithi196 ceph-mon[34258]: pgmap v440: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:57.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-58"}]': finished 2021-10-08T19:31:57.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:56 smithi157 ceph-mon[32847]: osdmap e313: 8 total, 8 up, 8 in 2021-10-08T19:31:57.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:56 smithi157 ceph-mon[32847]: pgmap v440: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:57.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-58"}]': finished 2021-10-08T19:31:57.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:56 smithi157 ceph-mon[42114]: osdmap e313: 8 total, 8 up, 8 in 2021-10-08T19:31:57.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:56 smithi157 ceph-mon[42114]: pgmap v440: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:57.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:31:56 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:31:57.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:57 smithi157 ceph-mon[32847]: osdmap e314: 8 total, 8 up, 8 in 2021-10-08T19:31:57.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:31:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:57] "GET /metrics HTTP/1.1" 200 158732 "" "Prometheus/2.18.1" 2021-10-08T19:31:57.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:57 smithi157 ceph-mon[42114]: osdmap e314: 8 total, 8 up, 8 in 2021-10-08T19:31:58.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:57 smithi196 ceph-mon[34258]: osdmap e314: 8 total, 8 up, 8 in 2021-10-08T19:31:58.906 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:31:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:31:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:58.907 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:58.907 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:58 smithi196 ceph-mon[34258]: osdmap e315: 8 total, 8 up, 8 in 2021-10-08T19:31:58.907 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:58.908 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:58.908 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:58 smithi196 ceph-mon[34258]: pgmap v443: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2021-10-08T19:31:58.908 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:58.909 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:58.909 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45"}]: dispatch 2021-10-08T19:31:58.909 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45"}]: dispatch 2021-10-08T19:31:59.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:59.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[32847]: osdmap e315: 8 total, 8 up, 8 in 2021-10-08T19:31:59.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:59.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:59.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[32847]: pgmap v443: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2021-10-08T19:31:59.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:59.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:59.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45"}]: dispatch 2021-10-08T19:31:59.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45"}]: dispatch 2021-10-08T19:31:59.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:59.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[42114]: osdmap e315: 8 total, 8 up, 8 in 2021-10-08T19:31:59.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:59.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:31:59.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[42114]: pgmap v443: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2021-10-08T19:31:59.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:59.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:31:59.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45"}]: dispatch 2021-10-08T19:31:59.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45"}]: dispatch 2021-10-08T19:32:00.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]': finished 2021-10-08T19:32:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45"}]': finished 2021-10-08T19:32:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[32847]: osdmap e316: 8 total, 8 up, 8 in 2021-10-08T19:32:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:32:00.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:32:00.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]': finished 2021-10-08T19:32:00.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45"}]': finished 2021-10-08T19:32:00.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[42114]: osdmap e316: 8 total, 8 up, 8 in 2021-10-08T19:32:00.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:32:00.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:31:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:32:00.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-58"}]': finished 2021-10-08T19:32:00.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-45"}]': finished 2021-10-08T19:32:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:59 smithi196 ceph-mon[34258]: osdmap e316: 8 total, 8 up, 8 in 2021-10-08T19:32:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1544262540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:32:00.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:31:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]: dispatch 2021-10-08T19:32:01.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]': finished 2021-10-08T19:32:01.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[32847]: osdmap e317: 8 total, 8 up, 8 in 2021-10-08T19:32:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[32847]: pgmap v446: 196 pgs: 196 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:01.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]': finished 2021-10-08T19:32:01.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[42114]: osdmap e317: 8 total, 8 up, 8 in 2021-10-08T19:32:01.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[42114]: pgmap v446: 196 pgs: 196 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:01.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:01.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-58"}]': finished 2021-10-08T19:32:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:00 smithi196 ceph-mon[34258]: osdmap e317: 8 total, 8 up, 8 in 2021-10-08T19:32:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:00 smithi196 ceph-mon[34258]: pgmap v446: 196 pgs: 196 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:01.996 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:01.997 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[32847]: osdmap e318: 8 total, 8 up, 8 in 2021-10-08T19:32:01.997 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.997 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:01.998 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:01.998 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:02.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:02.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[42114]: osdmap e318: 8 total, 8 up, 8 in 2021-10-08T19:32:02.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:02.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:02.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:02.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:02.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:02.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:01 smithi196 ceph-mon[34258]: osdmap e318: 8 total, 8 up, 8 in 2021-10-08T19:32:02.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:02.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:02.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:02.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: pgmap v449: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:03.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: osdmap e319: 8 total, 8 up, 8 in 2021-10-08T19:32:03.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:03.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:03.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-59"}]': finished 2021-10-08T19:32:03.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:03.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: osdmap e320: 8 total, 8 up, 8 in 2021-10-08T19:32:03.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:03.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:03.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: pgmap v449: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:03.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:03.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: osdmap e319: 8 total, 8 up, 8 in 2021-10-08T19:32:03.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:03.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:03.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-59"}]': finished 2021-10-08T19:32:03.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:03.339 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: osdmap e320: 8 total, 8 up, 8 in 2021-10-08T19:32:03.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:03.340 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: pgmap v449: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: osdmap e319: 8 total, 8 up, 8 in 2021-10-08T19:32:03.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:03.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:03.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-59"}]': finished 2021-10-08T19:32:03.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:03.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: osdmap e320: 8 total, 8 up, 8 in 2021-10-08T19:32:03.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:03.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:03.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:03.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:03.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:03.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:32:05.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-47"}]': finished 2021-10-08T19:32:05.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[32847]: osdmap e321: 8 total, 8 up, 8 in 2021-10-08T19:32:05.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[32847]: pgmap v452: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:05.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-47", "mode": "writeback"}]: dispatch 2021-10-08T19:32:05.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-47", "mode": "writeback"}]: dispatch 2021-10-08T19:32:05.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-47"}]': finished 2021-10-08T19:32:05.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[42114]: osdmap e321: 8 total, 8 up, 8 in 2021-10-08T19:32:05.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[42114]: pgmap v452: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:05.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-47", "mode": "writeback"}]: dispatch 2021-10-08T19:32:05.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-47", "mode": "writeback"}]: dispatch 2021-10-08T19:32:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-47"}]': finished 2021-10-08T19:32:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:04 smithi196 ceph-mon[34258]: osdmap e321: 8 total, 8 up, 8 in 2021-10-08T19:32:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:04 smithi196 ceph-mon[34258]: pgmap v452: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-47", "mode": "writeback"}]: dispatch 2021-10-08T19:32:05.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-47", "mode": "writeback"}]: dispatch 2021-10-08T19:32:05.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:05 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:32:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:05.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:05.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-47", "mode": "writeback"}]': finished 2021-10-08T19:32:05.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[32847]: osdmap e322: 8 total, 8 up, 8 in 2021-10-08T19:32:05.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:05.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:05.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:05.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:05.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:05.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:05.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-47", "mode": "writeback"}]': finished 2021-10-08T19:32:05.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[42114]: osdmap e322: 8 total, 8 up, 8 in 2021-10-08T19:32:05.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:05.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:05.836 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:05.837 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:05.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:05 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:06.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:05 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-47", "mode": "writeback"}]': finished 2021-10-08T19:32:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:05 smithi196 ceph-mon[34258]: osdmap e322: 8 total, 8 up, 8 in 2021-10-08T19:32:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:06.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:06.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:06.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:06.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:05 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:06.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:05 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:32:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:06.770 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:7462ddf6::: LibRadosAio.RoundTripCmpExtPP (2765 ms) 2021-10-08T19:32:06.771 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2021-10-08T19:32:06.771 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3010 ms) 2021-10-08T19:32:06.772 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2021-10-08T19:32:06.772 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: setting pool EIO 2021-10-08T19:32:06.772 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: waiting for 2557 2021-10-08T19:32:06.773 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: max_success 1532, min_failed 1533 2021-10-08T19:32:06.773 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (5037 ms) 2021-10-08T19:32:06.774 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] 29 tests from LibRadosAio (114671 ms total) 2021-10-08T19:32:06.774 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: 2021-10-08T19:32:06.775 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2021-10-08T19:32:06.775 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2021-10-08T19:32:06.775 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3212 ms) 2021-10-08T19:32:06.776 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2021-10-08T19:32:06.776 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (8814 ms) 2021-10-08T19:32:06.777 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2021-10-08T19:32:06.777 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14918 ms) 2021-10-08T19:32:06.778 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2021-10-08T19:32:06.778 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3021 ms) 2021-10-08T19:32:06.778 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29967 ms total) 2021-10-08T19:32:06.779 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: 2021-10-08T19:32:06.780 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2021-10-08T19:32:06.780 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2021-10-08T19:32:06.780 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3015 ms) 2021-10-08T19:32:06.780 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3015 ms total) 2021-10-08T19:32:06.781 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: 2021-10-08T19:32:06.781 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2021-10-08T19:32:06.781 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2021-10-08T19:32:06.782 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13967 ms) 2021-10-08T19:32:06.782 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2021-10-08T19:32:06.782 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7048 ms) 2021-10-08T19:32:06.783 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2021-10-08T19:32:06.783 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6971 ms) 2021-10-08T19:32:06.784 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2021-10-08T19:32:06.784 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7023 ms) 2021-10-08T19:32:06.785 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2021-10-08T19:32:06.786 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3011 ms) 2021-10-08T19:32:06.786 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2021-10-08T19:32:06.786 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7030 ms) 2021-10-08T19:32:06.786 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2021-10-08T19:32:06.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7051 ms) 2021-10-08T19:32:06.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2021-10-08T19:32:06.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6889 ms) 2021-10-08T19:32:06.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2021-10-08T19:32:06.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7040 ms) 2021-10-08T19:32:06.788 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2021-10-08T19:32:06.788 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7049 ms) 2021-10-08T19:32:06.788 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2021-10-08T19:32:06.788 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7026 ms) 2021-10-08T19:32:06.789 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2021-10-08T19:32:06.789 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7026 ms) 2021-10-08T19:32:06.789 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2021-10-08T19:32:06.789 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7036 ms) 2021-10-08T19:32:06.789 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2021-10-08T19:32:06.790 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3023 ms) 2021-10-08T19:32:06.790 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2021-10-08T19:32:06.790 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7041 ms) 2021-10-08T19:32:06.790 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2021-10-08T19:32:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:32:07.103 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:32:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:07.104 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: pgmap v454: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:07.104 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]': finished 2021-10-08T19:32:07.105 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:32:07.105 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: osdmap e323: 8 total, 8 up, 8 in 2021-10-08T19:32:07.105 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:07.106 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:07.106 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:07.107 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:07.107 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:07.107 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:32:07.108 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:32:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:07.108 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: pgmap v454: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:07.108 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]': finished 2021-10-08T19:32:07.108 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:32:07.108 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: osdmap e323: 8 total, 8 up, 8 in 2021-10-08T19:32:07.109 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:07.109 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:07.109 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:07.109 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:07.110 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:06 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:07.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:32:06 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:32:07.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:32:07.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:32:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:07.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: pgmap v454: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:07.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-59"}]': finished 2021-10-08T19:32:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:32:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: osdmap e323: 8 total, 8 up, 8 in 2021-10-08T19:32:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3859955195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:07.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]: dispatch 2021-10-08T19:32:07.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:07.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:06 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:07] "GET /metrics HTTP/1.1" 200 157628 "" "Prometheus/2.18.1" 2021-10-08T19:32:07.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:32:07.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:32:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:07.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]': finished 2021-10-08T19:32:07.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:07.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: osdmap e324: 8 total, 8 up, 8 in 2021-10-08T19:32:07.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:07.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:07.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:07.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:07.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:07.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:32:07.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:32:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:07.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]': finished 2021-10-08T19:32:07.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:07.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: osdmap e324: 8 total, 8 up, 8 in 2021-10-08T19:32:07.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:07.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:07.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:07.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:07.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:32:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:32:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-59"}]': finished 2021-10-08T19:32:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:08.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: osdmap e324: 8 total, 8 up, 8 in 2021-10-08T19:32:08.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:08.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:08.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:08.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:08.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[32847]: pgmap v457: 228 pgs: 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:32:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:32:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:09.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[32847]: osdmap e325: 8 total, 8 up, 8 in 2021-10-08T19:32:09.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:09.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:09.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:09.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:09.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[42114]: pgmap v457: 228 pgs: 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:32:09.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:09.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:32:09.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:09.085 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[42114]: osdmap e325: 8 total, 8 up, 8 in 2021-10-08T19:32:09.086 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:09.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:09.087 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:09.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:32:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:09.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:09.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:08 smithi196 ceph-mon[34258]: pgmap v457: 228 pgs: 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:32:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:08 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:32:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:08 smithi196 ceph-mon[34258]: osdmap e325: 8 total, 8 up, 8 in 2021-10-08T19:32:09.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:09.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:09.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:10.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:32:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:09 smithi157 ceph-mon[32847]: osdmap e326: 8 total, 8 up, 8 in 2021-10-08T19:32:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:32:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:32:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:32:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:09 smithi157 ceph-mon[42114]: osdmap e326: 8 total, 8 up, 8 in 2021-10-08T19:32:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:32:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:32:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:32:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:09 smithi196 ceph-mon[34258]: osdmap e326: 8 total, 8 up, 8 in 2021-10-08T19:32:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:32:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:32:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[32847]: pgmap v460: 228 pgs: 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:32:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-60"}]': finished 2021-10-08T19:32:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:32:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[32847]: osdmap e327: 8 total, 8 up, 8 in 2021-10-08T19:32:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:32:11.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:32:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[42114]: pgmap v460: 228 pgs: 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:32:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-60"}]': finished 2021-10-08T19:32:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:32:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[42114]: osdmap e327: 8 total, 8 up, 8 in 2021-10-08T19:32:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:32:11.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:32:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:10 smithi196 ceph-mon[34258]: pgmap v460: 228 pgs: 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:32:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-60"}]': finished 2021-10-08T19:32:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:32:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:10 smithi196 ceph-mon[34258]: osdmap e327: 8 total, 8 up, 8 in 2021-10-08T19:32:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:32:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:32:12.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:11 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:32:12.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:11 smithi157 ceph-mon[32847]: osdmap e328: 8 total, 8 up, 8 in 2021-10-08T19:32:12.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:12.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:11 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:12.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:11 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:32:12.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:11 smithi157 ceph-mon[42114]: osdmap e328: 8 total, 8 up, 8 in 2021-10-08T19:32:12.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:12.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:11 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:12.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:11 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-47","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:32:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:11 smithi196 ceph-mon[34258]: osdmap e328: 8 total, 8 up, 8 in 2021-10-08T19:32:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:11 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[32847]: pgmap v463: 236 pgs: 236 active+clean; 8.4 MiB data, 400 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:32:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:32:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[32847]: osdmap e329: 8 total, 8 up, 8 in 2021-10-08T19:32:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:13.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[42114]: pgmap v463: 236 pgs: 236 active+clean; 8.4 MiB data, 400 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:32:13.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:32:13.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[42114]: osdmap e329: 8 total, 8 up, 8 in 2021-10-08T19:32:13.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:13.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:13.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:12 smithi196 ceph-mon[34258]: pgmap v463: 236 pgs: 236 active+clean; 8.4 MiB data, 400 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:32:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:32:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:12 smithi196 ceph-mon[34258]: osdmap e329: 8 total, 8 up, 8 in 2021-10-08T19:32:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:13.809 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:13.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:13.810 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:13.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:13.810 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:13.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:32:13.811 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-60"}]': finished 2021-10-08T19:32:13.811 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]': finished 2021-10-08T19:32:13.811 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[42114]: osdmap e330: 8 total, 8 up, 8 in 2021-10-08T19:32:13.811 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:13.812 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:13.812 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:14.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:14.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:14.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-60"}]': finished 2021-10-08T19:32:14.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]': finished 2021-10-08T19:32:14.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[32847]: osdmap e330: 8 total, 8 up, 8 in 2021-10-08T19:32:14.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:14.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:14.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:14.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:14.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:14.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-60"}]': finished 2021-10-08T19:32:14.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]': finished 2021-10-08T19:32:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:13 smithi196 ceph-mon[34258]: osdmap e330: 8 total, 8 up, 8 in 2021-10-08T19:32:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-60"}]: dispatch 2021-10-08T19:32:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:14.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-47"}]: dispatch 2021-10-08T19:32:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[32847]: pgmap v466: 228 pgs: 228 active+clean; 8.4 MiB data, 400 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:32:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-60"}]': finished 2021-10-08T19:32:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[32847]: osdmap e331: 8 total, 8 up, 8 in 2021-10-08T19:32:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:15.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[42114]: pgmap v466: 228 pgs: 228 active+clean; 8.4 MiB data, 400 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:32:15.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-60"}]': finished 2021-10-08T19:32:15.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[42114]: osdmap e331: 8 total, 8 up, 8 in 2021-10-08T19:32:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:15.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:14 smithi196 ceph-mon[34258]: pgmap v466: 228 pgs: 228 active+clean; 8.4 MiB data, 400 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:32:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/18064269' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-60"}]': finished 2021-10-08T19:32:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:14 smithi196 ceph-mon[34258]: osdmap e331: 8 total, 8 up, 8 in 2021-10-08T19:32:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:16.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:16.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[32847]: osdmap e332: 8 total, 8 up, 8 in 2021-10-08T19:32:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[42114]: osdmap e332: 8 total, 8 up, 8 in 2021-10-08T19:32:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:16.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:15 smithi196 ceph-mon[34258]: osdmap e332: 8 total, 8 up, 8 in 2021-10-08T19:32:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:16.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[32847]: pgmap v469: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 400 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-49","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[32847]: osdmap e333: 8 total, 8 up, 8 in 2021-10-08T19:32:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:17.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[42114]: pgmap v469: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 400 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:17.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-49","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:17.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[42114]: osdmap e333: 8 total, 8 up, 8 in 2021-10-08T19:32:17.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:17.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:17.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:32:16 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:32:17.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:16 smithi196 ceph-mon[34258]: pgmap v469: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 400 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:17.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-49","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:17.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:16 smithi196 ceph-mon[34258]: osdmap e333: 8 total, 8 up, 8 in 2021-10-08T19:32:17.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:17.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:17.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:17] "GET /metrics HTTP/1.1" 200 157628 "" "Prometheus/2.18.1" 2021-10-08T19:32:18.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-61"}]': finished 2021-10-08T19:32:18.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:18.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:17 smithi196 ceph-mon[34258]: osdmap e334: 8 total, 8 up, 8 in 2021-10-08T19:32:18.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:18.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-61"}]': finished 2021-10-08T19:32:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[32847]: osdmap e334: 8 total, 8 up, 8 in 2021-10-08T19:32:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:18.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-61"}]': finished 2021-10-08T19:32:18.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:18.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[42114]: osdmap e334: 8 total, 8 up, 8 in 2021-10-08T19:32:18.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:18.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:19.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:32:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:18 smithi196 ceph-mon[34258]: pgmap v472: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:32:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-49"}]': finished 2021-10-08T19:32:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:18 smithi196 ceph-mon[34258]: osdmap e335: 8 total, 8 up, 8 in 2021-10-08T19:32:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:32:19.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:32:19.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:19.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[42114]: pgmap v472: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:32:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-49"}]': finished 2021-10-08T19:32:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[42114]: osdmap e335: 8 total, 8 up, 8 in 2021-10-08T19:32:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:32:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:32:19.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:19.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[32847]: pgmap v472: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:32:19.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-49"}]': finished 2021-10-08T19:32:19.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[32847]: osdmap e335: 8 total, 8 up, 8 in 2021-10-08T19:32:19.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:32:19.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:32:20.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:19 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:20.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-49", "mode": "readproxy"}]': finished 2021-10-08T19:32:20.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:19 smithi196 ceph-mon[34258]: osdmap e336: 8 total, 8 up, 8 in 2021-10-08T19:32:20.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:20.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-61"}]': finished 2021-10-08T19:32:20.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:19 smithi196 ceph-mon[34258]: osdmap e337: 8 total, 8 up, 8 in 2021-10-08T19:32:20.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:20.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:20.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-49", "mode": "readproxy"}]': finished 2021-10-08T19:32:20.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[32847]: osdmap e336: 8 total, 8 up, 8 in 2021-10-08T19:32:20.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:20.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-61"}]': finished 2021-10-08T19:32:20.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[32847]: osdmap e337: 8 total, 8 up, 8 in 2021-10-08T19:32:20.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:20.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:20.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-49", "mode": "readproxy"}]': finished 2021-10-08T19:32:20.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[42114]: osdmap e336: 8 total, 8 up, 8 in 2021-10-08T19:32:20.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:20.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-61"}]': finished 2021-10-08T19:32:20.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[42114]: osdmap e337: 8 total, 8 up, 8 in 2021-10-08T19:32:20.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-61"}]: dispatch 2021-10-08T19:32:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:20 smithi196 ceph-mon[34258]: pgmap v475: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:32:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-61"}]': finished 2021-10-08T19:32:21.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:20 smithi196 ceph-mon[34258]: osdmap e338: 8 total, 8 up, 8 in 2021-10-08T19:32:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:20 smithi157 ceph-mon[32847]: pgmap v475: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:32:21.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-61"}]': finished 2021-10-08T19:32:21.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:20 smithi157 ceph-mon[32847]: osdmap e338: 8 total, 8 up, 8 in 2021-10-08T19:32:21.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:20 smithi157 ceph-mon[42114]: pgmap v475: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:32:21.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3385342912' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-61"}]': finished 2021-10-08T19:32:21.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:20 smithi157 ceph-mon[42114]: osdmap e338: 8 total, 8 up, 8 in 2021-10-08T19:32:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:22.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:22.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:22.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:22.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:22.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:22.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:23 smithi196 ceph-mon[34258]: pgmap v478: 228 pgs: 228 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:32:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:23 smithi196 ceph-mon[34258]: osdmap e339: 8 total, 8 up, 8 in 2021-10-08T19:32:23.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:23.517 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:23 smithi157 ceph-mon[42114]: pgmap v478: 228 pgs: 228 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:32:23.518 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:23.518 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:23 smithi157 ceph-mon[42114]: osdmap e339: 8 total, 8 up, 8 in 2021-10-08T19:32:23.518 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:23.519 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:23 smithi157 ceph-mon[32847]: pgmap v478: 228 pgs: 228 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:32:23.519 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:23.519 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:23 smithi157 ceph-mon[32847]: osdmap e339: 8 total, 8 up, 8 in 2021-10-08T19:32:23.520 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:23.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:23.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:23.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:32:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:24 smithi196 ceph-mon[34258]: osdmap e340: 8 total, 8 up, 8 in 2021-10-08T19:32:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:24 smithi196 ceph-mon[34258]: pgmap v481: 228 pgs: 228 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:32:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-62"}]': finished 2021-10-08T19:32:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:24 smithi196 ceph-mon[34258]: osdmap e341: 8 total, 8 up, 8 in 2021-10-08T19:32:24.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:24 smithi157 ceph-mon[32847]: osdmap e340: 8 total, 8 up, 8 in 2021-10-08T19:32:24.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:24 smithi157 ceph-mon[32847]: pgmap v481: 228 pgs: 228 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:32:24.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-62"}]': finished 2021-10-08T19:32:24.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:24 smithi157 ceph-mon[32847]: osdmap e341: 8 total, 8 up, 8 in 2021-10-08T19:32:24.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:24 smithi157 ceph-mon[42114]: osdmap e340: 8 total, 8 up, 8 in 2021-10-08T19:32:24.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:24 smithi157 ceph-mon[42114]: pgmap v481: 228 pgs: 228 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:32:24.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-62"}]': finished 2021-10-08T19:32:24.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:24 smithi157 ceph-mon[42114]: osdmap e341: 8 total, 8 up, 8 in 2021-10-08T19:32:26.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:25 smithi157 ceph-mon[32847]: osdmap e342: 8 total, 8 up, 8 in 2021-10-08T19:32:26.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:25 smithi157 ceph-mon[42114]: osdmap e342: 8 total, 8 up, 8 in 2021-10-08T19:32:26.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:25 smithi196 ceph-mon[34258]: osdmap e342: 8 total, 8 up, 8 in 2021-10-08T19:32:27.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:26 smithi157 ceph-mon[42114]: pgmap v484: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:27.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:26 smithi157 ceph-mon[42114]: osdmap e343: 8 total, 8 up, 8 in 2021-10-08T19:32:27.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:27.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:26 smithi157 ceph-mon[32847]: pgmap v484: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:27.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:26 smithi157 ceph-mon[32847]: osdmap e343: 8 total, 8 up, 8 in 2021-10-08T19:32:27.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:27.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:26 smithi196 ceph-mon[34258]: pgmap v484: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 391 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:27.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:26 smithi196 ceph-mon[34258]: osdmap e343: 8 total, 8 up, 8 in 2021-10-08T19:32:27.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:27.368 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:32:26 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:32:27.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:27] "GET /metrics HTTP/1.1" 200 157624 "" "Prometheus/2.18.1" 2021-10-08T19:32:28.273 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-62"}]': finished 2021-10-08T19:32:28.274 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[32847]: osdmap e344: 8 total, 8 up, 8 in 2021-10-08T19:32:28.274 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:28.274 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-62"}]': finished 2021-10-08T19:32:28.274 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[32847]: osdmap e345: 8 total, 8 up, 8 in 2021-10-08T19:32:28.275 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-62"}]': finished 2021-10-08T19:32:28.275 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[42114]: osdmap e344: 8 total, 8 up, 8 in 2021-10-08T19:32:28.275 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:28.277 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-62"}]': finished 2021-10-08T19:32:28.277 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:27 smithi157 ceph-mon[42114]: osdmap e345: 8 total, 8 up, 8 in 2021-10-08T19:32:28.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-62"}]': finished 2021-10-08T19:32:28.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:27 smithi196 ceph-mon[34258]: osdmap e344: 8 total, 8 up, 8 in 2021-10-08T19:32:28.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-62"}]: dispatch 2021-10-08T19:32:28.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1709848842' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-62"}]': finished 2021-10-08T19:32:28.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:27 smithi196 ceph-mon[34258]: osdmap e345: 8 total, 8 up, 8 in 2021-10-08T19:32:28.884 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:32:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:29.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:29.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[42114]: pgmap v487: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:29.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:29.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[32847]: pgmap v487: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:29.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:29.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:28 smithi196 ceph-mon[34258]: pgmap v487: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:29.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:29.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[32847]: osdmap e346: 8 total, 8 up, 8 in 2021-10-08T19:32:30.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:30.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:30.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:30.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:30.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[42114]: osdmap e346: 8 total, 8 up, 8 in 2021-10-08T19:32:30.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:30.588 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:30.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:30.589 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:30 smithi196 ceph-mon[34258]: osdmap e346: 8 total, 8 up, 8 in 2021-10-08T19:32:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:30.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:30.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:31.340 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: pgmap v490: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:31.340 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:32:31.341 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: osdmap e347: 8 total, 8 up, 8 in 2021-10-08T19:32:31.341 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.341 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.341 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:31.341 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-63"}]': finished 2021-10-08T19:32:31.342 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]': finished 2021-10-08T19:32:31.342 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: osdmap e348: 8 total, 8 up, 8 in 2021-10-08T19:32:31.342 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:31.342 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:31.343 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.343 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.343 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:32:31.343 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:32:31.343 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:32:31.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:31 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:32:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:31.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: pgmap v490: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:31.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:32:31.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: osdmap e347: 8 total, 8 up, 8 in 2021-10-08T19:32:31.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:31.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-63"}]': finished 2021-10-08T19:32:31.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]': finished 2021-10-08T19:32:31.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: osdmap e348: 8 total, 8 up, 8 in 2021-10-08T19:32:31.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:31.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:31.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:32:31.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:32:31.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:32:31.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: pgmap v490: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:31.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:32:31.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: osdmap e347: 8 total, 8 up, 8 in 2021-10-08T19:32:31.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:31.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88496-63"}]': finished 2021-10-08T19:32:31.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]': finished 2021-10-08T19:32:31.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: osdmap e348: 8 total, 8 up, 8 in 2021-10-08T19:32:31.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:31.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:31.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-49"}]: dispatch 2021-10-08T19:32:31.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:32:31.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:32:31.587 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:32:31.894 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (70163:head 2021-10-08T19:32:31.894 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:5d165639:::164:head 2021-10-08T19:32:31.895 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:f43765fc:::165:head 2021-10-08T19:32:31.895 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:b4c720e9:::166:head 2021-10-08T19:32:31.895 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:e694b040:::167:head 2021-10-08T19:32:31.895 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:afa38db2:::168:head 2021-10-08T19:32:31.896 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:77ba9f53:::169:head 2021-10-08T19:32:31.896 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:87495034:::170:head 2021-10-08T19:32:31.896 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:7c96bf0e:::171:head 2021-10-08T19:32:31.897 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:dbe346cc:::172:head 2021-10-08T19:32:31.897 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:e943ec24:::173:head 2021-10-08T19:32:31.897 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:f97a9c0c:::174:head 2021-10-08T19:32:31.897 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:6f26e74d:::175:head 2021-10-08T19:32:31.897 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:4f95e106:::176:head 2021-10-08T19:32:31.898 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:0e6f2f8f:::177:head 2021-10-08T19:32:31.898 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:05db05f1:::178:head 2021-10-08T19:32:31.898 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:38a78d66:::179:head 2021-10-08T19:32:31.898 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:d095610b:::180:head 2021-10-08T19:32:31.898 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:a1a9d709:::181:head 2021-10-08T19:32:31.899 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:1e5d39db:::182:head 2021-10-08T19:32:31.899 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:f7df4fb9:::183:head 2021-10-08T19:32:31.899 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:03a7f161:::184:head 2021-10-08T19:32:31.899 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:ba70721e:::185:head 2021-10-08T19:32:31.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:28e5662d:::186:head 2021-10-08T19:32:31.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:973d52de:::187:head 2021-10-08T19:32:31.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:4303eb1c:::188:head 2021-10-08T19:32:31.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:b990b48e:::189:head 2021-10-08T19:32:31.900 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:29b8165b:::190:head 2021-10-08T19:32:31.901 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:3547f197:::191:head 2021-10-08T19:32:31.901 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:7e260936:::192:head 2021-10-08T19:32:31.901 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:1abec7b1:::193:head 2021-10-08T19:32:31.902 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:10fdda93:::194:head 2021-10-08T19:32:31.902 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:15817eea:::195:head 2021-10-08T19:32:31.903 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:770bab57:::196:head 2021-10-08T19:32:31.903 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:ed9e13e7:::197:head 2021-10-08T19:32:31.903 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:71471a8f:::198:head 2021-10-08T19:32:31.903 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: checking for 189:10fb1d02:::199:head 2021-10-08T19:32:31.903 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8025 ms) 2021-10-08T19:32:31.904 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2021-10-08T19:32:31.904 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,0 2021-10-08T19:32:31.904 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: first is 1633721507 2021-10-08T19:32:31.904 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,0 2021-10-08T19:32:31.905 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,0 2021-10-08T19:32:31.905 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,1633721509,1633721510,0 2021-10-08T19:32:31.905 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,1633721509,1633721510,0 2021-10-08T19:32:31.905 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,1633721509,1633721510,0 2021-10-08T19:32:31.906 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,1633721509,1633721510,1633721512,1633721513,0 2021-10-08T19:32:31.907 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,1633721509,1633721510,1633721512,1633721513,0 2021-10-08T19:32:31.907 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,1633721509,1633721510,1633721512,1633721513,0 2021-10-08T19:32:31.908 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,1633721509,1633721510,1633721512,1633721513,1633721515,1633721516,0 2021-10-08T19:32:31.908 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,1633721509,1633721510,1633721512,1633721513,1633721515,1633721516,0 2021-10-08T19:32:31.908 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721507,1633721509,1633721510,1633721512,1633721513,1633721515,1633721516,0 2021-10-08T19:32:31.909 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633721510,1633721512,1633721513,1633721515,1633721516,1633721518,1633721519,0 2021-10-08T19:32:31.909 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: first now 1633721510, trimmed 2021-10-08T19:32:31.909 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (20098 ms) 2021-10-08T19:32:31.909 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2021-10-08T19:32:31.909 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: foo0 2021-10-08T19:32:31.910 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: verifying foo0 is eventually promoted 2021-10-08T19:32:31.910 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14085 ms) 2021-10-08T19:32:31.910 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2021-10-08T19:32:32.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:32 smithi196 ceph-mon[34258]: poll took 60020.452 ms: 1 events 2021-10-08T19:32:32.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:32.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:32.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:32.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:32 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:32:32.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:32 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:32:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:32.621 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:32 smithi196 ceph-mon[34258]: pgmap v493: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:32.622 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:32 smithi196 ceph-mon[34258]: osdmap e349: 8 total, 8 up, 8 in 2021-10-08T19:32:32.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[32847]: poll took 60020.452 ms: 1 events 2021-10-08T19:32:32.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:32.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:32.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:32.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:32:32.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:32:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:32.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[32847]: pgmap v493: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:32.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[32847]: osdmap e349: 8 total, 8 up, 8 in 2021-10-08T19:32:32.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[42114]: poll took 60020.452 ms: 1 events 2021-10-08T19:32:32.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:32.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:32.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:32.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:32:32.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:32:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:32.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[42114]: pgmap v493: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:32.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:32 smithi157 ceph-mon[42114]: osdmap e349: 8 total, 8 up, 8 in 2021-10-08T19:32:33.518 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:33 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:32:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:33.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:33.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:33.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:32:34.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[42114]: osdmap e350: 8 total, 8 up, 8 in 2021-10-08T19:32:34.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:34.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:34.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:34.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:34.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:34.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[32847]: osdmap e350: 8 total, 8 up, 8 in 2021-10-08T19:32:34.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:34.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:34.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:34.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:34.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:33 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:34.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:33 smithi196 ceph-mon[34258]: osdmap e350: 8 total, 8 up, 8 in 2021-10-08T19:32:34.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:34.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:34.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:34.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:34.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:33 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:34.912 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ 32 ms) 2021-10-08T19:32:34.912 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2021-10-08T19:32:34.913 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7285 ms) 2021-10-08T19:32:34.913 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2021-10-08T19:32:34.913 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (6791 ms) 2021-10-08T19:32:34.913 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2021-10-08T19:32:34.913 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7024 ms) 2021-10-08T19:32:34.914 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2021-10-08T19:32:34.914 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7040 ms) 2021-10-08T19:32:34.914 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139403 ms total) 2021-10-08T19:32:34.914 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: 2021-10-08T19:32:34.915 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [----------] Global test environment tear-down 2021-10-08T19:32:34.915 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [==========] 54 tests from 4 test suites ran. (287056 ms total) 2021-10-08T19:32:34.916 INFO:tasks.workunit.client.0.smithi157.stdout: api_aio_pp: [ PASSED ] 54 tests. 2021-10-08T19:32:34.925 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.925 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88507 2021-10-08T19:32:34.925 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88507 2021-10-08T19:32:34.926 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.926 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88981 2021-10-08T19:32:34.927 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88981 2021-10-08T19:32:34.927 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.928 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88571 2021-10-08T19:32:34.928 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88571 2021-10-08T19:32:34.928 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.929 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88555 2021-10-08T19:32:34.929 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88555 2021-10-08T19:32:34.930 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.930 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88531 2021-10-08T19:32:34.931 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88531 2021-10-08T19:32:34.932 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.932 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88833 2021-10-08T19:32:34.932 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88833 2021-10-08T19:32:34.932 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.932 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88499 2021-10-08T19:32:34.933 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88499 2021-10-08T19:32:34.933 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.933 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88916 2021-10-08T19:32:34.933 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88916 2021-10-08T19:32:34.934 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.934 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88754 2021-10-08T19:32:34.934 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88754 2021-10-08T19:32:34.934 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.934 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88991 2021-10-08T19:32:34.935 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88991 2021-10-08T19:32:34.935 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.935 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88880 2021-10-08T19:32:34.935 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88880 2021-10-08T19:32:34.935 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.936 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=89010 2021-10-08T19:32:34.936 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 89010 2021-10-08T19:32:34.936 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.936 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88483 2021-10-08T19:32:34.937 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88483 2021-10-08T19:32:34.940 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.940 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=89002 2021-10-08T19:32:34.940 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 89002 2021-10-08T19:32:34.941 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.941 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88941 2021-10-08T19:32:34.941 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88941 2021-10-08T19:32:34.942 INFO:tasks.workunit.client.0.smithi157.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:32:34.942 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=88563 2021-10-08T19:32:34.942 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 88563 2021-10-08T19:32:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:32:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:32:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:35.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: pgmap v496: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:35.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-51","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:35.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]': finished 2021-10-08T19:32:35.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: osdmap e351: 8 total, 8 up, 8 in 2021-10-08T19:32:35.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:35.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:35.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:35.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:35.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:32:35.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:32:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:35.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: pgmap v496: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:35.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-51","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:35.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]': finished 2021-10-08T19:32:35.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: osdmap e351: 8 total, 8 up, 8 in 2021-10-08T19:32:35.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:35.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:35.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:35.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:35.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:32:35.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:32:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:35.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: pgmap v496: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:35.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-51","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:35.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88496-63"}]': finished 2021-10-08T19:32:35.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: osdmap e351: 8 total, 8 up, 8 in 2021-10-08T19:32:35.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4292295082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:35.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]: dispatch 2021-10-08T19:32:35.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:35.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:36.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]': finished 2021-10-08T19:32:36.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:36.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: osdmap e352: 8 total, 8 up, 8 in 2021-10-08T19:32:36.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:36.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:36.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:36.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:36.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:36.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:36.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-51"}]': finished 2021-10-08T19:32:36.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[32847]: osdmap e353: 8 total, 8 up, 8 in 2021-10-08T19:32:36.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]': finished 2021-10-08T19:32:36.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:36.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: osdmap e352: 8 total, 8 up, 8 in 2021-10-08T19:32:36.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:36.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:36.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:36.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:36.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:36.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:36.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-51"}]': finished 2021-10-08T19:32:36.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:35 smithi157 ceph-mon[42114]: osdmap e353: 8 total, 8 up, 8 in 2021-10-08T19:32:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88496-63"}]': finished 2021-10-08T19:32:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: osdmap e352: 8 total, 8 up, 8 in 2021-10-08T19:32:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:36.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:36.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:36.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:36.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:36.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:36.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-51"}]': finished 2021-10-08T19:32:36.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:35 smithi196 ceph-mon[34258]: osdmap e353: 8 total, 8 up, 8 in 2021-10-08T19:32:37.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[32847]: pgmap v499: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-51", "mode": "writeback"}]: dispatch 2021-10-08T19:32:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-51", "mode": "writeback"}]: dispatch 2021-10-08T19:32:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-51", "mode": "writeback"}]': finished 2021-10-08T19:32:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[32847]: osdmap e354: 8 total, 8 up, 8 in 2021-10-08T19:32:37.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[42114]: pgmap v499: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:37.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-51", "mode": "writeback"}]: dispatch 2021-10-08T19:32:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-51", "mode": "writeback"}]: dispatch 2021-10-08T19:32:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-51", "mode": "writeback"}]': finished 2021-10-08T19:32:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:36 smithi157 ceph-mon[42114]: osdmap e354: 8 total, 8 up, 8 in 2021-10-08T19:32:37.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:32:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:32:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:36 smithi196 ceph-mon[34258]: pgmap v499: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 393 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-51", "mode": "writeback"}]: dispatch 2021-10-08T19:32:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-51", "mode": "writeback"}]: dispatch 2021-10-08T19:32:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:36 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-51", "mode": "writeback"}]': finished 2021-10-08T19:32:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:36 smithi196 ceph-mon[34258]: osdmap e354: 8 total, 8 up, 8 in 2021-10-08T19:32:37.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:37] "GET /metrics HTTP/1.1" 200 157582 "" "Prometheus/2.18.1" 2021-10-08T19:32:38.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:38.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:38.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:38.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:38.929 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:32:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[32847]: pgmap v502: 228 pgs: 228 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:32:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:32:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[32847]: osdmap e355: 8 total, 8 up, 8 in 2021-10-08T19:32:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[42114]: pgmap v502: 228 pgs: 228 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:32:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:32:39.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[42114]: osdmap e355: 8 total, 8 up, 8 in 2021-10-08T19:32:39.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:39.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:39.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:39.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:38 smithi196 ceph-mon[34258]: pgmap v502: 228 pgs: 228 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:32:39.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:32:39.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:38 smithi196 ceph-mon[34258]: osdmap e355: 8 total, 8 up, 8 in 2021-10-08T19:32:39.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:39.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:39 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:39 smithi157 ceph-mon[32847]: osdmap e356: 8 total, 8 up, 8 in 2021-10-08T19:32:40.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:39 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:40.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:39 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:39 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:40.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:39 smithi157 ceph-mon[42114]: osdmap e356: 8 total, 8 up, 8 in 2021-10-08T19:32:40.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:39 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:40.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:39 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:39 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:39 smithi196 ceph-mon[34258]: osdmap e356: 8 total, 8 up, 8 in 2021-10-08T19:32:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:39 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:40.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:39 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[32847]: pgmap v505: 228 pgs: 228 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:32:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:32:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[32847]: osdmap e357: 8 total, 8 up, 8 in 2021-10-08T19:32:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:41.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[42114]: pgmap v505: 228 pgs: 228 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:32:41.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:41.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:32:41.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[42114]: osdmap e357: 8 total, 8 up, 8 in 2021-10-08T19:32:41.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:41.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:40 smithi196 ceph-mon[34258]: pgmap v505: 228 pgs: 228 active+clean; 8.4 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:32:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:40 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:32:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:40 smithi196 ceph-mon[34258]: osdmap e357: 8 total, 8 up, 8 in 2021-10-08T19:32:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:32:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:32:42.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:41 smithi157 ceph-mon[32847]: osdmap e358: 8 total, 8 up, 8 in 2021-10-08T19:32:42.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:32:42.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:32:42.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:32:42.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:41 smithi157 ceph-mon[42114]: osdmap e358: 8 total, 8 up, 8 in 2021-10-08T19:32:42.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:32:42.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:32:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:32:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:41 smithi196 ceph-mon[34258]: osdmap e358: 8 total, 8 up, 8 in 2021-10-08T19:32:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:32:42.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:32:43.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:42 smithi157 ceph-mon[32847]: pgmap v508: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:32:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:32:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:42 smithi157 ceph-mon[32847]: osdmap e359: 8 total, 8 up, 8 in 2021-10-08T19:32:43.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:42 smithi157 ceph-mon[42114]: pgmap v508: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:32:43.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:32:43.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:42 smithi157 ceph-mon[42114]: osdmap e359: 8 total, 8 up, 8 in 2021-10-08T19:32:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:42 smithi196 ceph-mon[34258]: pgmap v508: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:32:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-51","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:32:43.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:42 smithi196 ceph-mon[34258]: osdmap e359: 8 total, 8 up, 8 in 2021-10-08T19:32:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:43.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:43.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:43.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:43.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:32:44.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:43 smithi157 ceph-mon[32847]: pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:32:44.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:43 smithi157 ceph-mon[42114]: pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:32:44.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:43 smithi196 ceph-mon[34258]: pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:32:45.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:44 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:32:45.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:44 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:32:45.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:44 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:32:46.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:45 smithi157 ceph-mon[32847]: pgmap v511: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:32:46.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:45 smithi157 ceph-mon[42114]: pgmap v511: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:32:46.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:45 smithi196 ceph-mon[34258]: pgmap v511: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:32:47.366 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:32:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:32:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:47] "GET /metrics HTTP/1.1" 200 157582 "" "Prometheus/2.18.1" 2021-10-08T19:32:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:48 smithi157 ceph-mon[32847]: pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:32:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:48 smithi157 ceph-mon[42114]: pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:32:49.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:32:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:48 smithi196 ceph-mon[34258]: pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:32:50.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:50 smithi157 ceph-mon[32847]: pgmap v513: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:32:50.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:50 smithi157 ceph-mon[42114]: pgmap v513: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:32:50.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:50 smithi196 ceph-mon[34258]: pgmap v513: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:32:53.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:52 smithi157 ceph-mon[32847]: pgmap v514: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:32:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:53.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:52 smithi157 ceph-mon[42114]: pgmap v514: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:32:53.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:53.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:52 smithi196 ceph-mon[34258]: pgmap v514: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:32:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:53.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:53.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:53.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:32:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:32:53.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:32:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:32:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:53 smithi157 ceph-mon[32847]: osdmap e360: 8 total, 8 up, 8 in 2021-10-08T19:32:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:32:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:53 smithi157 ceph-mon[42114]: osdmap e360: 8 total, 8 up, 8 in 2021-10-08T19:32:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:53.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:54.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:32:54.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:53 smithi196 ceph-mon[34258]: osdmap e360: 8 total, 8 up, 8 in 2021-10-08T19:32:54.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:54.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[32847]: pgmap v516: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:32:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]': finished 2021-10-08T19:32:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[32847]: osdmap e361: 8 total, 8 up, 8 in 2021-10-08T19:32:55.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:55.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:55.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:55.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:55.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[42114]: pgmap v516: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:32:55.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]': finished 2021-10-08T19:32:55.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[42114]: osdmap e361: 8 total, 8 up, 8 in 2021-10-08T19:32:55.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:55.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:55.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:55.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:55.092 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:54 smithi196 ceph-mon[34258]: pgmap v516: 228 pgs: 228 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:32:55.092 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]': finished 2021-10-08T19:32:55.093 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:54 smithi196 ceph-mon[34258]: osdmap e361: 8 total, 8 up, 8 in 2021-10-08T19:32:55.093 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:55.093 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:55.094 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:55.094 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-51"}]: dispatch 2021-10-08T19:32:56.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:55 smithi196 ceph-mon[34258]: osdmap e362: 8 total, 8 up, 8 in 2021-10-08T19:32:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:55 smithi157 ceph-mon[32847]: osdmap e362: 8 total, 8 up, 8 in 2021-10-08T19:32:56.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:55 smithi157 ceph-mon[42114]: osdmap e362: 8 total, 8 up, 8 in 2021-10-08T19:32:57.116 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:32:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:32:57.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:56 smithi196 ceph-mon[34258]: pgmap v519: 196 pgs: 196 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2021-10-08T19:32:57.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:56 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:32:57.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:56 smithi196 ceph-mon[34258]: osdmap e363: 8 total, 8 up, 8 in 2021-10-08T19:32:57.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:57.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:57.148 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[32847]: pgmap v519: 196 pgs: 196 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2021-10-08T19:32:57.149 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:32:57.149 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[32847]: osdmap e363: 8 total, 8 up, 8 in 2021-10-08T19:32:57.149 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:57.149 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:57.150 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[42114]: pgmap v519: 196 pgs: 196 active+clean; 8.4 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2021-10-08T19:32:57.150 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:32:57.150 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[42114]: osdmap e363: 8 total, 8 up, 8 in 2021-10-08T19:32:57.151 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:57.151 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:57.151 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:57 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:32:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:57.533 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:32:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:57] "GET /metrics HTTP/1.1" 200 157651 "" "Prometheus/2.18.1" 2021-10-08T19:32:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-53","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:58 smithi196 ceph-mon[34258]: osdmap e364: 8 total, 8 up, 8 in 2021-10-08T19:32:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-53"}]: dispatch 2021-10-08T19:32:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-53"}]: dispatch 2021-10-08T19:32:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:58 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:58.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-53","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:58.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[32847]: osdmap e364: 8 total, 8 up, 8 in 2021-10-08T19:32:58.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:58.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:58.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-53"}]: dispatch 2021-10-08T19:32:58.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-53"}]: dispatch 2021-10-08T19:32:58.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:58.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-53","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:58.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[42114]: osdmap e364: 8 total, 8 up, 8 in 2021-10-08T19:32:58.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:58.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:32:58.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-53"}]: dispatch 2021-10-08T19:32:58.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-53"}]: dispatch 2021-10-08T19:32:58.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:58 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:32:59.097 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:32:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:32:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:59 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:59 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:32:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:59 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:32:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:59 smithi196 ceph-mon[34258]: pgmap v522: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:32:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:59 smithi196 ceph-mon[34258]: osdmap e365: 8 total, 8 up, 8 in 2021-10-08T19:32:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:59 smithi196 ceph-mon[34258]: osdmap e366: 8 total, 8 up, 8 in 2021-10-08T19:32:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:32:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:59.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:59.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:32:59.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:32:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:59.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[42114]: pgmap v522: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:32:59.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[42114]: osdmap e365: 8 total, 8 up, 8 in 2021-10-08T19:32:59.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[42114]: osdmap e366: 8 total, 8 up, 8 in 2021-10-08T19:32:59.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:59.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:59.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:59.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:32:59.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:32:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:59.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[32847]: pgmap v522: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:32:59.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[32847]: osdmap e365: 8 total, 8 up, 8 in 2021-10-08T19:32:59.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[32847]: osdmap e366: 8 total, 8 up, 8 in 2021-10-08T19:32:59.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:59.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:32:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:00.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:00 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:33:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:00 smithi196 ceph-mon[34258]: pgmap v525: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-55","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:00 smithi196 ceph-mon[34258]: osdmap e367: 8 total, 8 up, 8 in 2021-10-08T19:33:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-55"}]: dispatch 2021-10-08T19:33:01.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-55"}]: dispatch 2021-10-08T19:33:01.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:00 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:01.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[32847]: pgmap v525: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:01.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-55","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[32847]: osdmap e367: 8 total, 8 up, 8 in 2021-10-08T19:33:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:01.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-55"}]: dispatch 2021-10-08T19:33:01.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-55"}]: dispatch 2021-10-08T19:33:01.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[42114]: pgmap v525: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-55","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:01.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[42114]: osdmap e367: 8 total, 8 up, 8 in 2021-10-08T19:33:01.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:01.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:01.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:01.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-55"}]: dispatch 2021-10-08T19:33:01.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-55"}]: dispatch 2021-10-08T19:33:01.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:00 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:01 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:33:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:01 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:33:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:01 smithi196 ceph-mon[34258]: osdmap e368: 8 total, 8 up, 8 in 2021-10-08T19:33:02.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:01 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:33:02.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:01 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:33:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:02.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:01 smithi157 ceph-mon[32847]: osdmap e368: 8 total, 8 up, 8 in 2021-10-08T19:33:02.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:01 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:33:02.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:01 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:33:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:02.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:01 smithi157 ceph-mon[42114]: osdmap e368: 8 total, 8 up, 8 in 2021-10-08T19:33:03.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:02 smithi157 ceph-mon[32847]: pgmap v528: 196 pgs: 196 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:03.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:02 smithi157 ceph-mon[32847]: osdmap e369: 8 total, 8 up, 8 in 2021-10-08T19:33:03.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:03.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:03.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:02 smithi157 ceph-mon[42114]: pgmap v528: 196 pgs: 196 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:03.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:02 smithi157 ceph-mon[42114]: osdmap e369: 8 total, 8 up, 8 in 2021-10-08T19:33:03.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:03.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:03.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:02 smithi196 ceph-mon[34258]: pgmap v528: 196 pgs: 196 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:02 smithi196 ceph-mon[34258]: osdmap e369: 8 total, 8 up, 8 in 2021-10-08T19:33:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:03.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:03.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:03.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:03.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:33:04.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:04.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[32847]: osdmap e370: 8 total, 8 up, 8 in 2021-10-08T19:33:04.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:04.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:04.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-57"}]: dispatch 2021-10-08T19:33:04.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-57"}]: dispatch 2021-10-08T19:33:04.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:04.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[42114]: osdmap e370: 8 total, 8 up, 8 in 2021-10-08T19:33:04.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:04.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:04.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-57"}]: dispatch 2021-10-08T19:33:04.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-57"}]: dispatch 2021-10-08T19:33:04.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:04.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:03 smithi196 ceph-mon[34258]: osdmap e370: 8 total, 8 up, 8 in 2021-10-08T19:33:04.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:04.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:04.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-57"}]: dispatch 2021-10-08T19:33:04.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-57"}]: dispatch 2021-10-08T19:33:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:04 smithi157 ceph-mon[32847]: pgmap v531: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:04 smithi157 ceph-mon[32847]: osdmap e371: 8 total, 8 up, 8 in 2021-10-08T19:33:05.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:04 smithi157 ceph-mon[42114]: pgmap v531: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:05.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:04 smithi157 ceph-mon[42114]: osdmap e371: 8 total, 8 up, 8 in 2021-10-08T19:33:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:04 smithi196 ceph-mon[34258]: pgmap v531: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:04 smithi196 ceph-mon[34258]: osdmap e371: 8 total, 8 up, 8 in 2021-10-08T19:33:06.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:05 smithi157 ceph-mon[32847]: osdmap e372: 8 total, 8 up, 8 in 2021-10-08T19:33:06.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:06.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:06.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:05 smithi157 ceph-mon[42114]: osdmap e372: 8 total, 8 up, 8 in 2021-10-08T19:33:06.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:06.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:05 smithi196 ceph-mon[34258]: osdmap e372: 8 total, 8 up, 8 in 2021-10-08T19:33:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:06.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[32847]: pgmap v534: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:07.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-59","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:07.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[32847]: osdmap e373: 8 total, 8 up, 8 in 2021-10-08T19:33:07.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:07.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:07.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:07.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-59"}]: dispatch 2021-10-08T19:33:07.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-59"}]: dispatch 2021-10-08T19:33:07.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[42114]: pgmap v534: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:07.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-59","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:07.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[42114]: osdmap e373: 8 total, 8 up, 8 in 2021-10-08T19:33:07.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:07.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:07.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:07.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-59"}]: dispatch 2021-10-08T19:33:07.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-59"}]: dispatch 2021-10-08T19:33:07.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:33:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:33:07.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:06 smithi196 ceph-mon[34258]: pgmap v534: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:07.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-59","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:07.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:06 smithi196 ceph-mon[34258]: osdmap e373: 8 total, 8 up, 8 in 2021-10-08T19:33:07.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:07.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:07.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:07.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-59"}]: dispatch 2021-10-08T19:33:07.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-59"}]: dispatch 2021-10-08T19:33:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:07] "GET /metrics HTTP/1.1" 200 157587 "" "Prometheus/2.18.1" 2021-10-08T19:33:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:07 smithi157 ceph-mon[32847]: osdmap e374: 8 total, 8 up, 8 in 2021-10-08T19:33:08.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:07 smithi157 ceph-mon[42114]: osdmap e374: 8 total, 8 up, 8 in 2021-10-08T19:33:08.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:07 smithi196 ceph-mon[34258]: osdmap e374: 8 total, 8 up, 8 in 2021-10-08T19:33:08.905 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:33:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:09.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:09.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[42114]: pgmap v537: 196 pgs: 196 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:09.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[42114]: osdmap e375: 8 total, 8 up, 8 in 2021-10-08T19:33:09.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:09.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:09.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:09.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[32847]: pgmap v537: 196 pgs: 196 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:09.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[32847]: osdmap e375: 8 total, 8 up, 8 in 2021-10-08T19:33:09.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:09.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:08 smithi196 ceph-mon[34258]: pgmap v537: 196 pgs: 196 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:08 smithi196 ceph-mon[34258]: osdmap e375: 8 total, 8 up, 8 in 2021-10-08T19:33:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:10.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-61","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:10.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[42114]: osdmap e376: 8 total, 8 up, 8 in 2021-10-08T19:33:10.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:10.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:10.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:10.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-61","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:10.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[32847]: osdmap e376: 8 total, 8 up, 8 in 2021-10-08T19:33:10.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:10.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:10.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:10.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-61","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:10.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:09 smithi196 ceph-mon[34258]: osdmap e376: 8 total, 8 up, 8 in 2021-10-08T19:33:10.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:10.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:10.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:11.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[42114]: pgmap v540: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:11.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:33:11.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[42114]: osdmap e377: 8 total, 8 up, 8 in 2021-10-08T19:33:11.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:11.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:11.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-61"}]: dispatch 2021-10-08T19:33:11.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-61"}]: dispatch 2021-10-08T19:33:11.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[32847]: pgmap v540: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:11.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:33:11.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[32847]: osdmap e377: 8 total, 8 up, 8 in 2021-10-08T19:33:11.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:11.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:11.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-61"}]: dispatch 2021-10-08T19:33:11.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-61"}]: dispatch 2021-10-08T19:33:11.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:10 smithi196 ceph-mon[34258]: pgmap v540: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:33:11.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:33:11.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:10 smithi196 ceph-mon[34258]: osdmap e377: 8 total, 8 up, 8 in 2021-10-08T19:33:11.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:11.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:11.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-61"}]: dispatch 2021-10-08T19:33:11.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-61"}]: dispatch 2021-10-08T19:33:12.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:11 smithi157 ceph-mon[32847]: osdmap e378: 8 total, 8 up, 8 in 2021-10-08T19:33:12.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:11 smithi157 ceph-mon[42114]: osdmap e378: 8 total, 8 up, 8 in 2021-10-08T19:33:12.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:11 smithi196 ceph-mon[34258]: osdmap e378: 8 total, 8 up, 8 in 2021-10-08T19:33:13.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:12 smithi157 ceph-mon[32847]: pgmap v543: 196 pgs: 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:33:13.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:12 smithi157 ceph-mon[32847]: osdmap e379: 8 total, 8 up, 8 in 2021-10-08T19:33:13.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:13.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:13.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:12 smithi157 ceph-mon[42114]: pgmap v543: 196 pgs: 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:33:13.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:12 smithi157 ceph-mon[42114]: osdmap e379: 8 total, 8 up, 8 in 2021-10-08T19:33:13.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:13.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:13.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:12 smithi196 ceph-mon[34258]: pgmap v543: 196 pgs: 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:33:13.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:12 smithi196 ceph-mon[34258]: osdmap e379: 8 total, 8 up, 8 in 2021-10-08T19:33:13.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:13.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:13.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:13.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:13.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:13.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:33:14.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-63","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:14.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[32847]: osdmap e380: 8 total, 8 up, 8 in 2021-10-08T19:33:14.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:14.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:14.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:14.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-63","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:14.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[42114]: osdmap e380: 8 total, 8 up, 8 in 2021-10-08T19:33:14.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:14.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:14.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:14.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-63","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:14.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:13 smithi196 ceph-mon[34258]: osdmap e380: 8 total, 8 up, 8 in 2021-10-08T19:33:14.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:14.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:14.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:15.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:14 smithi157 ceph-mon[32847]: pgmap v546: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:33:15.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:33:15.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:14 smithi157 ceph-mon[32847]: osdmap e381: 8 total, 8 up, 8 in 2021-10-08T19:33:15.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:14 smithi157 ceph-mon[42114]: pgmap v546: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:33:15.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:33:15.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:14 smithi157 ceph-mon[42114]: osdmap e381: 8 total, 8 up, 8 in 2021-10-08T19:33:15.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:14 smithi196 ceph-mon[34258]: pgmap v546: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:33:15.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:33:15.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:14 smithi196 ceph-mon[34258]: osdmap e381: 8 total, 8 up, 8 in 2021-10-08T19:33:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:15 smithi157 ceph-mon[32847]: osdmap e382: 8 total, 8 up, 8 in 2021-10-08T19:33:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:15 smithi157 ceph-mon[32847]: pgmap v549: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:16.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:15 smithi157 ceph-mon[42114]: osdmap e382: 8 total, 8 up, 8 in 2021-10-08T19:33:16.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:15 smithi157 ceph-mon[42114]: pgmap v549: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:16.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:15 smithi196 ceph-mon[34258]: osdmap e382: 8 total, 8 up, 8 in 2021-10-08T19:33:16.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:15 smithi196 ceph-mon[34258]: pgmap v549: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:16 smithi157 ceph-mon[32847]: osdmap e383: 8 total, 8 up, 8 in 2021-10-08T19:33:17.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:16 smithi157 ceph-mon[42114]: osdmap e383: 8 total, 8 up, 8 in 2021-10-08T19:33:17.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:16 smithi196 ceph-mon[34258]: osdmap e383: 8 total, 8 up, 8 in 2021-10-08T19:33:17.368 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:33:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:33:17.662 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:17] "GET /metrics HTTP/1.1" 200 157587 "" "Prometheus/2.18.1" 2021-10-08T19:33:18.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:17 smithi157 ceph-mon[42114]: osdmap e384: 8 total, 8 up, 8 in 2021-10-08T19:33:18.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:17 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:18.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:17 smithi157 ceph-mon[42114]: pgmap v552: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2021-10-08T19:33:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:17 smithi157 ceph-mon[32847]: osdmap e384: 8 total, 8 up, 8 in 2021-10-08T19:33:18.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:17 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:18.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:17 smithi157 ceph-mon[32847]: pgmap v552: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2021-10-08T19:33:18.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:17 smithi196 ceph-mon[34258]: osdmap e384: 8 total, 8 up, 8 in 2021-10-08T19:33:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:17 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:17 smithi196 ceph-mon[34258]: pgmap v552: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2021-10-08T19:33:18.967 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:33:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:18 smithi157 ceph-mon[32847]: osdmap e385: 8 total, 8 up, 8 in 2021-10-08T19:33:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:18 smithi157 ceph-mon[42114]: osdmap e385: 8 total, 8 up, 8 in 2021-10-08T19:33:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:18 smithi196 ceph-mon[34258]: osdmap e385: 8 total, 8 up, 8 in 2021-10-08T19:33:20.764 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:20 smithi196 ceph-mon[34258]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2021-10-08T19:33:20.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:20 smithi157 ceph-mon[32847]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2021-10-08T19:33:20.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:20 smithi157 ceph-mon[42114]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2021-10-08T19:33:23.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:22 smithi157 ceph-mon[42114]: pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2021-10-08T19:33:23.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:22 smithi157 ceph-mon[32847]: pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2021-10-08T19:33:23.080 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:22 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:33:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:23.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:22 smithi196 ceph-mon[34258]: pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2021-10-08T19:33:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:23.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:23.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:23.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:33:24.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:23 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:24.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:23 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:33:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:23 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:33:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:24.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:23 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:24.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:23 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:33:24.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:23 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:33:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:23 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:23 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:33:24.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:23 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:33:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:25.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:24 smithi157 ceph-mon[32847]: pgmap v556: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2021-10-08T19:33:25.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:24 smithi157 ceph-mon[32847]: osdmap e386: 8 total, 8 up, 8 in 2021-10-08T19:33:25.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:24 smithi157 ceph-mon[42114]: pgmap v556: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2021-10-08T19:33:25.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:24 smithi157 ceph-mon[42114]: osdmap e386: 8 total, 8 up, 8 in 2021-10-08T19:33:25.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:24 smithi196 ceph-mon[34258]: pgmap v556: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2021-10-08T19:33:25.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:24 smithi196 ceph-mon[34258]: osdmap e386: 8 total, 8 up, 8 in 2021-10-08T19:33:27.243 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:26 smithi157 ceph-mon[32847]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:33:27.244 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:26 smithi157 ceph-mon[42114]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:33:27.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:26 smithi196 ceph-mon[34258]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 389 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:33:27.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:33:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:33:27.534 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:27 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:33:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:28.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:27] "GET /metrics HTTP/1.1" 200 157657 "" "Prometheus/2.18.1" 2021-10-08T19:33:28.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:28.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:28.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:33:28.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:33:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:28.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[32847]: pgmap v559: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 208 B/s wr, 1 op/s 2021-10-08T19:33:28.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:28.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:28.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:33:28.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:33:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:28.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:28 smithi157 ceph-mon[42114]: pgmap v559: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 208 B/s wr, 1 op/s 2021-10-08T19:33:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:28 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:28 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:33:28.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:28 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:33:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:28.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:28 smithi196 ceph-mon[34258]: pgmap v559: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 208 B/s wr, 1 op/s 2021-10-08T19:33:29.119 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:33:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:29.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:29 smithi157 ceph-mon[32847]: osdmap e387: 8 total, 8 up, 8 in 2021-10-08T19:33:29.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:29 smithi157 ceph-mon[42114]: osdmap e387: 8 total, 8 up, 8 in 2021-10-08T19:33:29.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:29 smithi196 ceph-mon[34258]: osdmap e387: 8 total, 8 up, 8 in 2021-10-08T19:33:30.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:30 smithi157 ceph-mon[32847]: pgmap v561: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:33:30.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:30 smithi157 ceph-mon[42114]: pgmap v561: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:33:30.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:30 smithi196 ceph-mon[34258]: pgmap v561: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:33:31.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:33:31.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:33:31.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:33:31.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:31.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:33:31.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:33:31.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:33:31.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:33:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:33:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:33:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:32.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:32 smithi157 ceph-mon[32847]: pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:32.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:32 smithi157 ceph-mon[42114]: pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:32.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:32 smithi196 ceph-mon[34258]: pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:33.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:33.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:33.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:33:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:34 smithi196 ceph-mon[34258]: pgmap v563: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:34 smithi196 ceph-mon[34258]: osdmap e388: 8 total, 8 up, 8 in 2021-10-08T19:33:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:34 smithi157 ceph-mon[32847]: pgmap v563: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:35.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:34 smithi157 ceph-mon[32847]: osdmap e388: 8 total, 8 up, 8 in 2021-10-08T19:33:35.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:34 smithi157 ceph-mon[42114]: pgmap v563: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:35.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:34 smithi157 ceph-mon[42114]: osdmap e388: 8 total, 8 up, 8 in 2021-10-08T19:33:36.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:36.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:36.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:36.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:36.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:36.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:36.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:36.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:36.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:36 smithi196 ceph-mon[34258]: pgmap v565: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "29.b", "id": [6, 0]}]: dispatch 2021-10-08T19:33:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "29.b", "id": [6, 0]}]: dispatch 2021-10-08T19:33:37.118 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:33:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:33:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:36 smithi157 ceph-mon[32847]: pgmap v565: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "29.b", "id": [6, 0]}]: dispatch 2021-10-08T19:33:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "29.b", "id": [6, 0]}]: dispatch 2021-10-08T19:33:37.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:36 smithi157 ceph-mon[42114]: pgmap v565: 228 pgs: 228 active+clean; 8.4 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:37.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "29.b", "id": [6, 0]}]: dispatch 2021-10-08T19:33:37.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "29.b", "id": [6, 0]}]: dispatch 2021-10-08T19:33:37.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:37] "GET /metrics HTTP/1.1" 200 157658 "" "Prometheus/2.18.1" 2021-10-08T19:33:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:37 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "29.b", "id": [6, 0]}]': finished 2021-10-08T19:33:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:37 smithi196 ceph-mon[34258]: osdmap e389: 8 total, 8 up, 8 in 2021-10-08T19:33:38.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:37 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "29.b", "id": [6, 0]}]': finished 2021-10-08T19:33:38.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:37 smithi157 ceph-mon[32847]: osdmap e389: 8 total, 8 up, 8 in 2021-10-08T19:33:38.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:37 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "29.b", "id": [6, 0]}]': finished 2021-10-08T19:33:38.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:37 smithi157 ceph-mon[42114]: osdmap e389: 8 total, 8 up, 8 in 2021-10-08T19:33:39.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:33:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:38 smithi196 ceph-mon[34258]: pgmap v567: 228 pgs: 228 active+clean; 8.4 MiB data, 394 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:38 smithi196 ceph-mon[34258]: osdmap e390: 8 total, 8 up, 8 in 2021-10-08T19:33:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:38 smithi157 ceph-mon[32847]: pgmap v567: 228 pgs: 228 active+clean; 8.4 MiB data, 394 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:38 smithi157 ceph-mon[32847]: osdmap e390: 8 total, 8 up, 8 in 2021-10-08T19:33:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:38 smithi157 ceph-mon[42114]: pgmap v567: 228 pgs: 228 active+clean; 8.4 MiB data, 394 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:38 smithi157 ceph-mon[42114]: osdmap e390: 8 total, 8 up, 8 in 2021-10-08T19:33:40.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:39 smithi196 ceph-mon[34258]: osdmap e391: 8 total, 8 up, 8 in 2021-10-08T19:33:40.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:39 smithi157 ceph-mon[42114]: osdmap e391: 8 total, 8 up, 8 in 2021-10-08T19:33:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:39 smithi157 ceph-mon[32847]: osdmap e391: 8 total, 8 up, 8 in 2021-10-08T19:33:41.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:40 smithi196 ceph-mon[34258]: pgmap v570: 228 pgs: 228 active+clean; 8.4 MiB data, 394 MiB used, 715 GiB / 715 GiB avail; 971 B/s rd, 0 op/s 2021-10-08T19:33:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:40 smithi157 ceph-mon[32847]: pgmap v570: 228 pgs: 228 active+clean; 8.4 MiB data, 394 MiB used, 715 GiB / 715 GiB avail; 971 B/s rd, 0 op/s 2021-10-08T19:33:41.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:40 smithi157 ceph-mon[42114]: pgmap v570: 228 pgs: 228 active+clean; 8.4 MiB data, 394 MiB used, 715 GiB / 715 GiB avail; 971 B/s rd, 0 op/s 2021-10-08T19:33:43.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:42 smithi196 ceph-mon[34258]: pgmap v571: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-10-08T19:33:43.187 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:42 smithi157 ceph-mon[32847]: pgmap v571: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-10-08T19:33:43.187 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:42 smithi157 ceph-mon[42114]: pgmap v571: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-10-08T19:33:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:43.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:43.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:43.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:43.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:33:45.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:44 smithi196 ceph-mon[34258]: pgmap v572: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 885 B/s rd, 0 op/s 2021-10-08T19:33:45.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:44 smithi196 ceph-mon[34258]: osdmap e392: 8 total, 8 up, 8 in 2021-10-08T19:33:45.315 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:44 smithi157 ceph-mon[42114]: pgmap v572: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 885 B/s rd, 0 op/s 2021-10-08T19:33:45.315 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:44 smithi157 ceph-mon[42114]: osdmap e392: 8 total, 8 up, 8 in 2021-10-08T19:33:45.316 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:44 smithi157 ceph-mon[32847]: pgmap v572: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 885 B/s rd, 0 op/s 2021-10-08T19:33:45.316 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:44 smithi157 ceph-mon[32847]: osdmap e392: 8 total, 8 up, 8 in 2021-10-08T19:33:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:46 smithi157 ceph-mon[32847]: pgmap v574: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 774 B/s rd, 0 op/s 2021-10-08T19:33:47.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:46 smithi157 ceph-mon[42114]: pgmap v574: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 774 B/s rd, 0 op/s 2021-10-08T19:33:47.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:46 smithi196 ceph-mon[34258]: pgmap v574: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 774 B/s rd, 0 op/s 2021-10-08T19:33:47.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:33:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:33:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:47] "GET /metrics HTTP/1.1" 200 157658 "" "Prometheus/2.18.1" 2021-10-08T19:33:48.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:48 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:33:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:49.056 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:33:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:49.057 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:49.058 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:48 smithi196 ceph-mon[34258]: pgmap v575: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:49.058 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:48 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:49.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:48 smithi157 ceph-mon[32847]: pgmap v575: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:49.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:48 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:49.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:49.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:48 smithi157 ceph-mon[42114]: pgmap v575: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:49.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:48 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:49 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:33:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:49 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:33:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:50.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:50.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:50.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-63"}]: dispatch 2021-10-08T19:33:50.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-63"}]: dispatch 2021-10-08T19:33:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:33:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:33:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:50.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:50.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:50.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-63"}]: dispatch 2021-10-08T19:33:50.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-63"}]: dispatch 2021-10-08T19:33:50.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:33:50.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:33:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:50.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:50.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:33:50.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-63"}]: dispatch 2021-10-08T19:33:50.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-63"}]: dispatch 2021-10-08T19:33:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:50 smithi157 ceph-mon[32847]: pgmap v576: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:33:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:50 smithi157 ceph-mon[32847]: osdmap e393: 8 total, 8 up, 8 in 2021-10-08T19:33:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:50 smithi157 ceph-mon[42114]: pgmap v576: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:33:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:50 smithi157 ceph-mon[42114]: osdmap e393: 8 total, 8 up, 8 in 2021-10-08T19:33:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:50 smithi196 ceph-mon[34258]: pgmap v576: 228 pgs: 228 active+clean; 8.4 MiB data, 395 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:33:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:50 smithi196 ceph-mon[34258]: osdmap e393: 8 total, 8 up, 8 in 2021-10-08T19:33:52.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:51 smithi157 ceph-mon[32847]: osdmap e394: 8 total, 8 up, 8 in 2021-10-08T19:33:52.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:52.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:52.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:51 smithi157 ceph-mon[42114]: osdmap e394: 8 total, 8 up, 8 in 2021-10-08T19:33:52.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:52.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:52.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:51 smithi196 ceph-mon[34258]: osdmap e394: 8 total, 8 up, 8 in 2021-10-08T19:33:52.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:52.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[32847]: pgmap v579: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-65","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[32847]: osdmap e395: 8 total, 8 up, 8 in 2021-10-08T19:33:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:53.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:53.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[42114]: pgmap v579: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:53.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-65","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:53.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[42114]: osdmap e395: 8 total, 8 up, 8 in 2021-10-08T19:33:53.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:53.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:53.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:53.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:52 smithi196 ceph-mon[34258]: pgmap v579: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:53.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-65","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:53.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:52 smithi196 ceph-mon[34258]: osdmap e395: 8 total, 8 up, 8 in 2021-10-08T19:33:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:33:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:33:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:53.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:53.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:33:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:33:53.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:33:54.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:33:54.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:53 smithi157 ceph-mon[42114]: osdmap e396: 8 total, 8 up, 8 in 2021-10-08T19:33:54.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:53 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:54.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:33:54.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:53 smithi157 ceph-mon[32847]: osdmap e396: 8 total, 8 up, 8 in 2021-10-08T19:33:54.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:53 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:54.330 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:53 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:33:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:54.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:33:54.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:53 smithi196 ceph-mon[34258]: osdmap e396: 8 total, 8 up, 8 in 2021-10-08T19:33:54.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:53 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:33:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:54 smithi157 ceph-mon[32847]: pgmap v582: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:54 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:33:55.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:54 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:33:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:55.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:54 smithi157 ceph-mon[32847]: osdmap e397: 8 total, 8 up, 8 in 2021-10-08T19:33:55.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:54 smithi157 ceph-mon[42114]: pgmap v582: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:55.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:54 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:33:55.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:54 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:33:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:55.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:54 smithi157 ceph-mon[42114]: osdmap e397: 8 total, 8 up, 8 in 2021-10-08T19:33:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:54 smithi196 ceph-mon[34258]: pgmap v582: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:54 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:33:55.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:54 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:33:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:55.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:54 smithi196 ceph-mon[34258]: osdmap e397: 8 total, 8 up, 8 in 2021-10-08T19:33:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:55 smithi157 ceph-mon[32847]: osdmap e398: 8 total, 8 up, 8 in 2021-10-08T19:33:56.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:55 smithi157 ceph-mon[42114]: osdmap e398: 8 total, 8 up, 8 in 2021-10-08T19:33:56.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:55 smithi196 ceph-mon[34258]: osdmap e398: 8 total, 8 up, 8 in 2021-10-08T19:33:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:56 smithi157 ceph-mon[32847]: pgmap v585: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:56 smithi157 ceph-mon[32847]: osdmap e399: 8 total, 8 up, 8 in 2021-10-08T19:33:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:56 smithi157 ceph-mon[42114]: pgmap v585: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:56 smithi157 ceph-mon[42114]: osdmap e399: 8 total, 8 up, 8 in 2021-10-08T19:33:57.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:56 smithi196 ceph-mon[34258]: pgmap v585: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 396 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:56 smithi196 ceph-mon[34258]: osdmap e399: 8 total, 8 up, 8 in 2021-10-08T19:33:57.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:33:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:33:57.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:33:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:57] "GET /metrics HTTP/1.1" 200 156520 "" "Prometheus/2.18.1" 2021-10-08T19:33:58.916 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:33:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:33:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:59.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:33:58 smithi157 ceph-mon[32847]: pgmap v587: 228 pgs: 228 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2021-10-08T19:33:59.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:59.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:33:58 smithi157 ceph-mon[42114]: pgmap v587: 228 pgs: 228 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2021-10-08T19:33:59.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:59.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:33:58 smithi196 ceph-mon[34258]: pgmap v587: 228 pgs: 228 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2021-10-08T19:34:00.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:00 smithi157 ceph-mon[42114]: osdmap e400: 8 total, 8 up, 8 in 2021-10-08T19:34:00.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:00 smithi157 ceph-mon[42114]: pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2021-10-08T19:34:00.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:00 smithi157 ceph-mon[32847]: osdmap e400: 8 total, 8 up, 8 in 2021-10-08T19:34:00.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:00 smithi157 ceph-mon[32847]: pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2021-10-08T19:34:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:00 smithi196 ceph-mon[34258]: osdmap e400: 8 total, 8 up, 8 in 2021-10-08T19:34:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:00 smithi196 ceph-mon[34258]: pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2021-10-08T19:34:03.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:02 smithi196 ceph-mon[34258]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2021-10-08T19:34:03.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:02 smithi157 ceph-mon[32847]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2021-10-08T19:34:03.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:02 smithi157 ceph-mon[42114]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2021-10-08T19:34:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:03.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:03.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:03.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:34:05.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:04 smithi196 ceph-mon[34258]: pgmap v591: 228 pgs: 228 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2021-10-08T19:34:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:04 smithi157 ceph-mon[32847]: pgmap v591: 228 pgs: 228 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2021-10-08T19:34:05.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:04 smithi157 ceph-mon[42114]: pgmap v591: 228 pgs: 228 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2021-10-08T19:34:07.116 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:34:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:34:07.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:06 smithi196 ceph-mon[34258]: pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2021-10-08T19:34:07.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:07.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:07.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-65"}]: dispatch 2021-10-08T19:34:07.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-65"}]: dispatch 2021-10-08T19:34:07.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[42114]: pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2021-10-08T19:34:07.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:07.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-65"}]: dispatch 2021-10-08T19:34:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-65"}]: dispatch 2021-10-08T19:34:07.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[32847]: pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2021-10-08T19:34:07.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:07.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:07.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-65"}]: dispatch 2021-10-08T19:34:07.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-65"}]: dispatch 2021-10-08T19:34:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:07] "GET /metrics HTTP/1.1" 200 157671 "" "Prometheus/2.18.1" 2021-10-08T19:34:08.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:07 smithi196 ceph-mon[34258]: osdmap e401: 8 total, 8 up, 8 in 2021-10-08T19:34:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:07 smithi157 ceph-mon[32847]: osdmap e401: 8 total, 8 up, 8 in 2021-10-08T19:34:08.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:07 smithi157 ceph-mon[42114]: osdmap e401: 8 total, 8 up, 8 in 2021-10-08T19:34:08.970 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:08.970 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[32847]: pgmap v594: 196 pgs: 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:08.971 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[32847]: osdmap e402: 8 total, 8 up, 8 in 2021-10-08T19:34:08.971 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:08.971 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:08.972 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:08.972 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[42114]: pgmap v594: 196 pgs: 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:08.972 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[42114]: osdmap e402: 8 total, 8 up, 8 in 2021-10-08T19:34:08.972 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:08.973 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:09.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:34:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:09.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:09.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:08 smithi196 ceph-mon[34258]: pgmap v594: 196 pgs: 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:08 smithi196 ceph-mon[34258]: osdmap e402: 8 total, 8 up, 8 in 2021-10-08T19:34:09.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:09.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:10.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-67","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:10.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:09 smithi157 ceph-mon[32847]: osdmap e403: 8 total, 8 up, 8 in 2021-10-08T19:34:10.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:10.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-67","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:10.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:09 smithi157 ceph-mon[42114]: osdmap e403: 8 total, 8 up, 8 in 2021-10-08T19:34:10.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:10.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-67","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:10.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:09 smithi196 ceph-mon[34258]: osdmap e403: 8 total, 8 up, 8 in 2021-10-08T19:34:10.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[32847]: pgmap v597: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[32847]: osdmap e404: 8 total, 8 up, 8 in 2021-10-08T19:34:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-67"}]: dispatch 2021-10-08T19:34:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-67"}]: dispatch 2021-10-08T19:34:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[42114]: pgmap v597: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[42114]: osdmap e404: 8 total, 8 up, 8 in 2021-10-08T19:34:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-67"}]: dispatch 2021-10-08T19:34:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-67"}]: dispatch 2021-10-08T19:34:11.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:10 smithi196 ceph-mon[34258]: pgmap v597: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:11.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:10 smithi196 ceph-mon[34258]: osdmap e404: 8 total, 8 up, 8 in 2021-10-08T19:34:11.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:11.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:11.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-67"}]: dispatch 2021-10-08T19:34:11.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-67"}]: dispatch 2021-10-08T19:34:12.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:11 smithi157 ceph-mon[42114]: osdmap e405: 8 total, 8 up, 8 in 2021-10-08T19:34:12.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:11 smithi157 ceph-mon[32847]: osdmap e405: 8 total, 8 up, 8 in 2021-10-08T19:34:12.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:11 smithi196 ceph-mon[34258]: osdmap e405: 8 total, 8 up, 8 in 2021-10-08T19:34:13.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:12 smithi157 ceph-mon[42114]: pgmap v600: 196 pgs: 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:13.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:12 smithi157 ceph-mon[42114]: osdmap e406: 8 total, 8 up, 8 in 2021-10-08T19:34:13.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:13.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:13.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:12 smithi157 ceph-mon[32847]: pgmap v600: 196 pgs: 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:13.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:12 smithi157 ceph-mon[32847]: osdmap e406: 8 total, 8 up, 8 in 2021-10-08T19:34:13.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:13.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:13.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:12 smithi196 ceph-mon[34258]: pgmap v600: 196 pgs: 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:13.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:12 smithi196 ceph-mon[34258]: osdmap e406: 8 total, 8 up, 8 in 2021-10-08T19:34:13.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:13.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:13.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:13.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:13.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:13.521Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:34:14.156 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-69","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:14.157 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:13 smithi196 ceph-mon[34258]: osdmap e407: 8 total, 8 up, 8 in 2021-10-08T19:34:14.157 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:14.157 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:14.157 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:14.158 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-69"}]: dispatch 2021-10-08T19:34:14.158 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-69"}]: dispatch 2021-10-08T19:34:14.159 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-69","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:14.159 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[32847]: osdmap e407: 8 total, 8 up, 8 in 2021-10-08T19:34:14.159 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:14.160 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:14.160 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:14.160 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-69"}]: dispatch 2021-10-08T19:34:14.160 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-69"}]: dispatch 2021-10-08T19:34:14.161 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-69","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:14.162 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[42114]: osdmap e407: 8 total, 8 up, 8 in 2021-10-08T19:34:14.163 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:14.163 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:14.163 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:14.163 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-69"}]: dispatch 2021-10-08T19:34:14.164 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-69"}]: dispatch 2021-10-08T19:34:14.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:14 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:34:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:15.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:14 smithi157 ceph-mon[32847]: pgmap v603: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:15.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:14 smithi157 ceph-mon[32847]: osdmap e408: 8 total, 8 up, 8 in 2021-10-08T19:34:15.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:14 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:15.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:14 smithi157 ceph-mon[42114]: pgmap v603: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:15.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:14 smithi157 ceph-mon[42114]: osdmap e408: 8 total, 8 up, 8 in 2021-10-08T19:34:15.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:14 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:15.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:14 smithi196 ceph-mon[34258]: pgmap v603: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:15.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:14 smithi196 ceph-mon[34258]: osdmap e408: 8 total, 8 up, 8 in 2021-10-08T19:34:15.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:14 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:34:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:34:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[32847]: osdmap e409: 8 total, 8 up, 8 in 2021-10-08T19:34:16.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:16.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:16.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:34:16.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:34:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:16.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[42114]: osdmap e409: 8 total, 8 up, 8 in 2021-10-08T19:34:16.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:16.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:16.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:15 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:34:16.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:15 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:34:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:16.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:15 smithi196 ceph-mon[34258]: osdmap e409: 8 total, 8 up, 8 in 2021-10-08T19:34:16.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:16.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:17.086 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:16 smithi196 ceph-mon[34258]: pgmap v606: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:17.086 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-71","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:17.086 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:16 smithi196 ceph-mon[34258]: osdmap e410: 8 total, 8 up, 8 in 2021-10-08T19:34:17.087 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:17.087 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:17.087 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:17.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[32847]: pgmap v606: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:17.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-71","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:17.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[32847]: osdmap e410: 8 total, 8 up, 8 in 2021-10-08T19:34:17.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:17.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:17.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:17.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[42114]: pgmap v606: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:17.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-71","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:17.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[42114]: osdmap e410: 8 total, 8 up, 8 in 2021-10-08T19:34:17.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:17.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:17.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:17.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:34:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:34:17.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:17] "GET /metrics HTTP/1.1" 200 157671 "" "Prometheus/2.18.1" 2021-10-08T19:34:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:17 smithi157 ceph-mon[32847]: osdmap e411: 8 total, 8 up, 8 in 2021-10-08T19:34:18.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:18.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:17 smithi157 ceph-mon[42114]: osdmap e411: 8 total, 8 up, 8 in 2021-10-08T19:34:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:18.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:17 smithi196 ceph-mon[34258]: osdmap e411: 8 total, 8 up, 8 in 2021-10-08T19:34:18.922 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:34:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:18 smithi157 ceph-mon[32847]: pgmap v609: 228 pgs: 228 active+clean; 8.4 MiB data, 405 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:34:19.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:18 smithi157 ceph-mon[32847]: osdmap e412: 8 total, 8 up, 8 in 2021-10-08T19:34:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:18 smithi157 ceph-mon[42114]: pgmap v609: 228 pgs: 228 active+clean; 8.4 MiB data, 405 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:34:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:18 smithi157 ceph-mon[42114]: osdmap e412: 8 total, 8 up, 8 in 2021-10-08T19:34:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:18 smithi196 ceph-mon[34258]: pgmap v609: 228 pgs: 228 active+clean; 8.4 MiB data, 405 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:34:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:18 smithi196 ceph-mon[34258]: osdmap e412: 8 total, 8 up, 8 in 2021-10-08T19:34:20.807 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:20 smithi157 ceph-mon[32847]: pgmap v611: 228 pgs: 228 active+clean; 8.4 MiB data, 405 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 629 B/s wr, 1 op/s 2021-10-08T19:34:20.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:20 smithi157 ceph-mon[42114]: pgmap v611: 228 pgs: 228 active+clean; 8.4 MiB data, 405 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 629 B/s wr, 1 op/s 2021-10-08T19:34:20.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:20 smithi196 ceph-mon[34258]: pgmap v611: 228 pgs: 228 active+clean; 8.4 MiB data, 405 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 629 B/s wr, 1 op/s 2021-10-08T19:34:21.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:20 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:34:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:22.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:21 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:22.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:21 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:34:22.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:21 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:34:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:21 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:21 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:34:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:21 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:34:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:21 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:22.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:21 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:34:22.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:21 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:34:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:23.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:22 smithi157 ceph-mon[32847]: pgmap v612: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2021-10-08T19:34:23.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:22 smithi157 ceph-mon[42114]: pgmap v612: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2021-10-08T19:34:23.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:22 smithi196 ceph-mon[34258]: pgmap v612: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2021-10-08T19:34:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:23.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:23.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:23.521Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:34:25.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:24 smithi157 ceph-mon[42114]: pgmap v613: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2021-10-08T19:34:25.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:24 smithi157 ceph-mon[32847]: pgmap v613: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2021-10-08T19:34:25.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:24 smithi196 ceph-mon[34258]: pgmap v613: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2021-10-08T19:34:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:26 smithi157 ceph-mon[32847]: pgmap v614: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 692 B/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:34:27.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:26 smithi157 ceph-mon[42114]: pgmap v614: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 692 B/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:34:27.097 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:26 smithi196 ceph-mon[34258]: pgmap v614: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 692 B/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:34:27.372 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:34:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:34:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:27] "GET /metrics HTTP/1.1" 200 157633 "" "Prometheus/2.18.1" 2021-10-08T19:34:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:29.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:28 smithi157 ceph-mon[32847]: pgmap v615: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:34:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:28 smithi157 ceph-mon[42114]: pgmap v615: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:34:29.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:34:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:28 smithi196 ceph-mon[34258]: pgmap v615: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:34:30.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:30 smithi157 ceph-mon[32847]: pgmap v616: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 948 B/s rd, 1.1 KiB/s wr, 2 op/s 2021-10-08T19:34:30.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:30 smithi157 ceph-mon[42114]: pgmap v616: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 948 B/s rd, 1.1 KiB/s wr, 2 op/s 2021-10-08T19:34:30.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:30 smithi196 ceph-mon[34258]: pgmap v616: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 948 B/s rd, 1.1 KiB/s wr, 2 op/s 2021-10-08T19:34:31.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:34:31.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:34:31.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:34:31.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:31.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:34:31.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:34:31.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:34:31.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:31.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:34:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:34:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:34:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:32.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:32 smithi157 ceph-mon[42114]: pgmap v617: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:34:32.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:32 smithi157 ceph-mon[32847]: pgmap v617: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:34:32.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:32 smithi196 ceph-mon[34258]: pgmap v617: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:34:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:33.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:33.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:33.521Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:34:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:34 smithi157 ceph-mon[32847]: pgmap v618: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:34 smithi157 ceph-mon[42114]: pgmap v618: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:35.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:34 smithi196 ceph-mon[34258]: pgmap v618: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:36.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:36.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:36.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:36.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:36.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:36.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:36.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:36.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:36.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:37.109 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:36 smithi196 ceph-mon[34258]: pgmap v619: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:37.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:36 smithi157 ceph-mon[32847]: pgmap v619: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:37.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:36 smithi157 ceph-mon[42114]: pgmap v619: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:37.366 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:34:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:34:37.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:37] "GET /metrics HTTP/1.1" 200 157667 "" "Prometheus/2.18.1" 2021-10-08T19:34:39.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:34:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:38 smithi196 ceph-mon[34258]: pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-71"}]: dispatch 2021-10-08T19:34:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:38 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-71"}]: dispatch 2021-10-08T19:34:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[32847]: pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-71"}]: dispatch 2021-10-08T19:34:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-71"}]: dispatch 2021-10-08T19:34:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[42114]: pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-71"}]: dispatch 2021-10-08T19:34:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:38 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-71"}]: dispatch 2021-10-08T19:34:40.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:39 smithi157 ceph-mon[32847]: osdmap e413: 8 total, 8 up, 8 in 2021-10-08T19:34:40.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:39 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:40.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:39 smithi157 ceph-mon[42114]: osdmap e413: 8 total, 8 up, 8 in 2021-10-08T19:34:40.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:39 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:40.081 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:39 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:34:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:40.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:39 smithi196 ceph-mon[34258]: osdmap e413: 8 total, 8 up, 8 in 2021-10-08T19:34:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:39 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:41.158 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:40 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:34:41.158 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:40 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:34:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:41.159 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:40 smithi196 ceph-mon[34258]: pgmap v622: 196 pgs: 196 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2021-10-08T19:34:41.159 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:40 smithi196 ceph-mon[34258]: osdmap e414: 8 total, 8 up, 8 in 2021-10-08T19:34:41.159 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:41.159 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:34:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:34:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[32847]: pgmap v622: 196 pgs: 196 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2021-10-08T19:34:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[32847]: osdmap e414: 8 total, 8 up, 8 in 2021-10-08T19:34:41.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:41.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:41.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:34:41.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:34:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:41.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[42114]: pgmap v622: 196 pgs: 196 active+clean; 8.4 MiB data, 406 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2021-10-08T19:34:41.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[42114]: osdmap e414: 8 total, 8 up, 8 in 2021-10-08T19:34:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-73","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:41 smithi157 ceph-mon[32847]: osdmap e415: 8 total, 8 up, 8 in 2021-10-08T19:34:42.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:42.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-73","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:42.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:41 smithi157 ceph-mon[42114]: osdmap e415: 8 total, 8 up, 8 in 2021-10-08T19:34:42.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:42.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-73","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:42.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:41 smithi196 ceph-mon[34258]: osdmap e415: 8 total, 8 up, 8 in 2021-10-08T19:34:42.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:42 smithi196 ceph-mon[34258]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 411 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:42 smithi196 ceph-mon[34258]: osdmap e416: 8 total, 8 up, 8 in 2021-10-08T19:34:43.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:42 smithi157 ceph-mon[32847]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 411 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:43.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:42 smithi157 ceph-mon[32847]: osdmap e416: 8 total, 8 up, 8 in 2021-10-08T19:34:43.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:42 smithi157 ceph-mon[42114]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 411 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:43.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:42 smithi157 ceph-mon[42114]: osdmap e416: 8 total, 8 up, 8 in 2021-10-08T19:34:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:43.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:43.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:43.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:34:44.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:43 smithi157 ceph-mon[32847]: osdmap e417: 8 total, 8 up, 8 in 2021-10-08T19:34:44.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:43 smithi157 ceph-mon[42114]: osdmap e417: 8 total, 8 up, 8 in 2021-10-08T19:34:44.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:43 smithi196 ceph-mon[34258]: osdmap e417: 8 total, 8 up, 8 in 2021-10-08T19:34:45.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:44 smithi157 ceph-mon[32847]: pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:34:45.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:44 smithi157 ceph-mon[42114]: pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:34:45.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:44 smithi196 ceph-mon[34258]: pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:34:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:46 smithi157 ceph-mon[32847]: pgmap v629: 228 pgs: 228 active+clean; 8.4 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 863 B/s wr, 1 op/s 2021-10-08T19:34:47.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:46 smithi157 ceph-mon[42114]: pgmap v629: 228 pgs: 228 active+clean; 8.4 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 863 B/s wr, 1 op/s 2021-10-08T19:34:47.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:46 smithi196 ceph-mon[34258]: pgmap v629: 228 pgs: 228 active+clean; 8.4 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 863 B/s wr, 1 op/s 2021-10-08T19:34:47.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:34:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:34:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:47] "GET /metrics HTTP/1.1" 200 157667 "" "Prometheus/2.18.1" 2021-10-08T19:34:48.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:47 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:34:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:49.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:34:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:48 smithi196 ceph-mon[34258]: pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2021-10-08T19:34:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:48 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:48 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:34:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:48 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:34:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[32847]: pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2021-10-08T19:34:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:34:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:34:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:49.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:49.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[42114]: pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2021-10-08T19:34:49.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:34:49.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:34:49.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:48 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:34:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:50.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:50 smithi157 ceph-mon[32847]: pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:50.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:50 smithi157 ceph-mon[42114]: pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:50.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:50 smithi196 ceph-mon[34258]: pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:34:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:52 smithi196 ceph-mon[34258]: pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 206 B/s wr, 2 op/s 2021-10-08T19:34:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:52 smithi157 ceph-mon[32847]: pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 206 B/s wr, 2 op/s 2021-10-08T19:34:53.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:52 smithi157 ceph-mon[42114]: pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 206 B/s wr, 2 op/s 2021-10-08T19:34:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:53.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:53.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:34:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:34:53.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:34:54.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:54.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:54.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-73"}]: dispatch 2021-10-08T19:34:54.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-73"}]: dispatch 2021-10-08T19:34:54.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:54.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:54.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-73"}]: dispatch 2021-10-08T19:34:54.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-73"}]: dispatch 2021-10-08T19:34:54.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:54.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:54.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-73"}]: dispatch 2021-10-08T19:34:54.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-73"}]: dispatch 2021-10-08T19:34:55.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:54 smithi196 ceph-mon[34258]: pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 187 B/s wr, 2 op/s 2021-10-08T19:34:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:54 smithi196 ceph-mon[34258]: osdmap e418: 8 total, 8 up, 8 in 2021-10-08T19:34:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:54 smithi157 ceph-mon[32847]: pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 187 B/s wr, 2 op/s 2021-10-08T19:34:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:54 smithi157 ceph-mon[32847]: osdmap e418: 8 total, 8 up, 8 in 2021-10-08T19:34:55.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:54 smithi157 ceph-mon[42114]: pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 187 B/s wr, 2 op/s 2021-10-08T19:34:55.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:54 smithi157 ceph-mon[42114]: osdmap e418: 8 total, 8 up, 8 in 2021-10-08T19:34:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:55 smithi157 ceph-mon[32847]: osdmap e419: 8 total, 8 up, 8 in 2021-10-08T19:34:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:55 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:56.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:55 smithi157 ceph-mon[42114]: osdmap e419: 8 total, 8 up, 8 in 2021-10-08T19:34:56.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:56.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:55 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:56.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:55 smithi196 ceph-mon[34258]: osdmap e419: 8 total, 8 up, 8 in 2021-10-08T19:34:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:55 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:57.130 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:56 smithi196 ceph-mon[34258]: pgmap v636: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:57.130 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-75","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:57.131 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:56 smithi196 ceph-mon[34258]: osdmap e420: 8 total, 8 up, 8 in 2021-10-08T19:34:57.131 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:56 smithi157 ceph-mon[32847]: pgmap v636: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-75","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:56 smithi157 ceph-mon[32847]: osdmap e420: 8 total, 8 up, 8 in 2021-10-08T19:34:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:56 smithi157 ceph-mon[42114]: pgmap v636: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-75","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:56 smithi157 ceph-mon[42114]: osdmap e420: 8 total, 8 up, 8 in 2021-10-08T19:34:57.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:57.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:34:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:34:57.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:34:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:57] "GET /metrics HTTP/1.1" 200 157663 "" "Prometheus/2.18.1" 2021-10-08T19:34:58.328 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:34:57 smithi157 conmon[59794]: 2021-10-08T19:34:57.918+0000 7f3c86b8a700 -1 snap_mapper.add_oid found existing snaps mapped on 64:2c6e886f:test-rados-api-smithi157-88568-76::foo:28, removing 2021-10-08T19:34:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:57 smithi157 ceph-mon[32847]: osdmap e421: 8 total, 8 up, 8 in 2021-10-08T19:34:58.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:57 smithi157 ceph-mon[42114]: osdmap e421: 8 total, 8 up, 8 in 2021-10-08T19:34:58.330 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:34:57 smithi157 conmon[51806]: 2021-10-08T19:34:57.918+0000 7f9f27314700 -1 snap_mapper.add_oid found existing snaps mapped on 64:2c6e886f:test-rados-api-smithi157-88568-76::foo:28, removing 2021-10-08T19:34:58.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:57 smithi196 ceph-mon[34258]: osdmap e421: 8 total, 8 up, 8 in 2021-10-08T19:34:58.367 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:34:57 smithi196 conmon[46000]: 2021-10-08T19:34:57.917+0000 7f34ff131700 -1 snap_mapper.add_oid found existing snaps mapped on 64:2c6e886f:test-rados-api-smithi157-88568-76::foo:28, removing 2021-10-08T19:34:58.890 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:34:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:34:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[32847]: pgmap v639: 228 pgs: 228 active+clean; 8.4 MiB data, 413 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[32847]: osdmap e422: 8 total, 8 up, 8 in 2021-10-08T19:34:59.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:59.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:59.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-75"}]: dispatch 2021-10-08T19:34:59.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-75"}]: dispatch 2021-10-08T19:34:59.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:59.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[42114]: pgmap v639: 228 pgs: 228 active+clean; 8.4 MiB data, 413 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:59.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[42114]: osdmap e422: 8 total, 8 up, 8 in 2021-10-08T19:34:59.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:59.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:59.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-75"}]: dispatch 2021-10-08T19:34:59.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-75"}]: dispatch 2021-10-08T19:34:59.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:58 smithi196 ceph-mon[34258]: pgmap v639: 228 pgs: 228 active+clean; 8.4 MiB data, 413 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:58 smithi196 ceph-mon[34258]: osdmap e422: 8 total, 8 up, 8 in 2021-10-08T19:34:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:34:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-75"}]: dispatch 2021-10-08T19:34:59.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-75"}]: dispatch 2021-10-08T19:35:00.176 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:34:59 smithi157 ceph-mon[32847]: osdmap e423: 8 total, 8 up, 8 in 2021-10-08T19:35:00.177 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:34:59 smithi157 ceph-mon[42114]: osdmap e423: 8 total, 8 up, 8 in 2021-10-08T19:35:00.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:34:59 smithi196 ceph-mon[34258]: osdmap e423: 8 total, 8 up, 8 in 2021-10-08T19:35:01.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[32847]: pgmap v642: 196 pgs: 196 active+clean; 8.4 MiB data, 413 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:35:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[32847]: osdmap e424: 8 total, 8 up, 8 in 2021-10-08T19:35:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-77","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:01.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[32847]: osdmap e425: 8 total, 8 up, 8 in 2021-10-08T19:35:01.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:01.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[42114]: pgmap v642: 196 pgs: 196 active+clean; 8.4 MiB data, 413 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:35:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[42114]: osdmap e424: 8 total, 8 up, 8 in 2021-10-08T19:35:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-77","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:01.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[42114]: osdmap e425: 8 total, 8 up, 8 in 2021-10-08T19:35:01.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:00 smithi196 ceph-mon[34258]: pgmap v642: 196 pgs: 196 active+clean; 8.4 MiB data, 413 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:35:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:00 smithi196 ceph-mon[34258]: osdmap e424: 8 total, 8 up, 8 in 2021-10-08T19:35:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-77","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:00 smithi196 ceph-mon[34258]: osdmap e425: 8 total, 8 up, 8 in 2021-10-08T19:35:01.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:02.367 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:35:01 smithi196 conmon[41793]: 2021-10-08T19:35:01.926+0000 7fed38a00700 -1 snap_mapper.add_oid found existing snaps mapped on 64:5c5def25:test-rados-api-smithi157-88568-78::foo:29, removing 2021-10-08T19:35:02.368 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:35:01 smithi196 conmon[46000]: 2021-10-08T19:35:01.927+0000 7f3500133700 -1 snap_mapper.add_oid found existing snaps mapped on 64:5c5def25:test-rados-api-smithi157-88568-78::foo:29, removing 2021-10-08T19:35:02.369 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:35:01 smithi196 conmon[53867]: 2021-10-08T19:35:01.926+0000 7f64ed529700 -1 snap_mapper.add_oid found existing snaps mapped on 64:5c5def25:test-rados-api-smithi157-88568-78::foo:29, removing 2021-10-08T19:35:03.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[42114]: pgmap v645: 228 pgs: 228 active+clean; 8.4 MiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2021-10-08T19:35:03.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[42114]: osdmap e426: 8 total, 8 up, 8 in 2021-10-08T19:35:03.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:03.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:03.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-77"}]: dispatch 2021-10-08T19:35:03.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-77"}]: dispatch 2021-10-08T19:35:03.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[32847]: pgmap v645: 228 pgs: 228 active+clean; 8.4 MiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2021-10-08T19:35:03.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[32847]: osdmap e426: 8 total, 8 up, 8 in 2021-10-08T19:35:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-77"}]: dispatch 2021-10-08T19:35:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-77"}]: dispatch 2021-10-08T19:35:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:02 smithi196 ceph-mon[34258]: pgmap v645: 228 pgs: 228 active+clean; 8.4 MiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2021-10-08T19:35:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:02 smithi196 ceph-mon[34258]: osdmap e426: 8 total, 8 up, 8 in 2021-10-08T19:35:03.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:03.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:03.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-77"}]: dispatch 2021-10-08T19:35:03.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-77"}]: dispatch 2021-10-08T19:35:03.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:03.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:03.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:03.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:35:04.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:03 smithi157 ceph-mon[32847]: osdmap e427: 8 total, 8 up, 8 in 2021-10-08T19:35:04.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:03 smithi157 ceph-mon[42114]: osdmap e427: 8 total, 8 up, 8 in 2021-10-08T19:35:04.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:03 smithi196 ceph-mon[34258]: osdmap e427: 8 total, 8 up, 8 in 2021-10-08T19:35:05.310 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:04 smithi157 ceph-mon[32847]: pgmap v648: 196 pgs: 196 active+clean; 8.4 MiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:35:05.311 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:04 smithi157 ceph-mon[32847]: osdmap e428: 8 total, 8 up, 8 in 2021-10-08T19:35:05.313 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:05.313 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:05.314 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:04 smithi157 ceph-mon[42114]: pgmap v648: 196 pgs: 196 active+clean; 8.4 MiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:35:05.315 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:04 smithi157 ceph-mon[42114]: osdmap e428: 8 total, 8 up, 8 in 2021-10-08T19:35:05.315 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:05.316 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:05.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:04 smithi196 ceph-mon[34258]: pgmap v648: 196 pgs: 196 active+clean; 8.4 MiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:35:05.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:04 smithi196 ceph-mon[34258]: osdmap e428: 8 total, 8 up, 8 in 2021-10-08T19:35:05.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:05.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:05.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:05 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:35:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:06.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-79","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:06.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:05 smithi157 ceph-mon[32847]: osdmap e429: 8 total, 8 up, 8 in 2021-10-08T19:35:06.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:06.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:05 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:06.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-79","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:06.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:05 smithi157 ceph-mon[42114]: osdmap e429: 8 total, 8 up, 8 in 2021-10-08T19:35:06.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:06.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:05 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-79","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:06.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:05 smithi196 ceph-mon[34258]: osdmap e429: 8 total, 8 up, 8 in 2021-10-08T19:35:06.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:06.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:05 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:06 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:35:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:06 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:35:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:06 smithi157 ceph-mon[32847]: pgmap v651: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 414 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:07.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:06 smithi157 ceph-mon[32847]: osdmap e430: 8 total, 8 up, 8 in 2021-10-08T19:35:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:06 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:35:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:06 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:35:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:06 smithi157 ceph-mon[42114]: pgmap v651: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 414 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:07.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:06 smithi157 ceph-mon[42114]: osdmap e430: 8 total, 8 up, 8 in 2021-10-08T19:35:07.367 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:35:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:35:07.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:06 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:35:07.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:06 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:35:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:07.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:06 smithi196 ceph-mon[34258]: pgmap v651: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 414 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:07.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:06 smithi196 ceph-mon[34258]: osdmap e430: 8 total, 8 up, 8 in 2021-10-08T19:35:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:07] "GET /metrics HTTP/1.1" 200 157606 "" "Prometheus/2.18.1" 2021-10-08T19:35:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:07 smithi157 ceph-mon[32847]: osdmap e431: 8 total, 8 up, 8 in 2021-10-08T19:35:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.6"}]: dispatch 2021-10-08T19:35:08.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:07 smithi157 ceph-mon[42114]: osdmap e431: 8 total, 8 up, 8 in 2021-10-08T19:35:08.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.6"}]: dispatch 2021-10-08T19:35:08.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:07 smithi196 ceph-mon[34258]: osdmap e431: 8 total, 8 up, 8 in 2021-10-08T19:35:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.6"}]: dispatch 2021-10-08T19:35:08.960 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:35:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:08 smithi157 ceph-mon[32847]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.6"}]: dispatch 2021-10-08T19:35:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:09.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:08 smithi157 ceph-mon[32847]: 216.6 deep-scrub ok 2021-10-08T19:35:09.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:08 smithi157 ceph-mon[32847]: pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:35:09.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:08 smithi157 ceph-mon[42114]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.6"}]: dispatch 2021-10-08T19:35:09.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:09.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:08 smithi157 ceph-mon[42114]: 216.6 deep-scrub ok 2021-10-08T19:35:09.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:08 smithi157 ceph-mon[42114]: pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:35:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:08 smithi196 ceph-mon[34258]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.6"}]: dispatch 2021-10-08T19:35:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:08 smithi196 ceph-mon[34258]: 216.6 deep-scrub ok 2021-10-08T19:35:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:08 smithi196 ceph-mon[34258]: pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:35:10.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:10 smithi157 ceph-mon[32847]: pgmap v655: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2021-10-08T19:35:10.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:10 smithi157 ceph-mon[42114]: pgmap v655: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2021-10-08T19:35:10.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:10 smithi196 ceph-mon[34258]: pgmap v655: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2021-10-08T19:35:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:12 smithi196 ceph-mon[34258]: pgmap v656: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2021-10-08T19:35:13.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:12 smithi157 ceph-mon[32847]: pgmap v656: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2021-10-08T19:35:13.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:12 smithi157 ceph-mon[42114]: pgmap v656: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2021-10-08T19:35:13.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:13.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:13.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:13.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:35:14.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:14 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:35:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:15.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:14 smithi196 ceph-mon[34258]: pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 895 B/s wr, 3 op/s 2021-10-08T19:35:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:14 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:15.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:14 smithi157 ceph-mon[32847]: pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 895 B/s wr, 3 op/s 2021-10-08T19:35:15.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:14 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:15.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:14 smithi157 ceph-mon[42114]: pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 895 B/s wr, 3 op/s 2021-10-08T19:35:15.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:14 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:15 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:35:16.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:15 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:35:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:16.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:15 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:35:16.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:15 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:35:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:16.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:15 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:35:16.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:15 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:35:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:17.153 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:16 smithi196 ceph-mon[34258]: pgmap v658: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 726 B/s wr, 2 op/s 2021-10-08T19:35:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:16 smithi157 ceph-mon[32847]: pgmap v658: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 726 B/s wr, 2 op/s 2021-10-08T19:35:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:16 smithi157 ceph-mon[42114]: pgmap v658: 228 pgs: 228 active+clean; 8.4 MiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 726 B/s wr, 2 op/s 2021-10-08T19:35:17.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:35:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:35:17.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:17] "GET /metrics HTTP/1.1" 200 157606 "" "Prometheus/2.18.1" 2021-10-08T19:35:19.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:35:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:18 smithi196 ceph-mon[34258]: pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 94 B/s wr, 67 op/s 2021-10-08T19:35:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:18 smithi157 ceph-mon[32847]: pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 94 B/s wr, 67 op/s 2021-10-08T19:35:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:18 smithi157 ceph-mon[42114]: pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 94 B/s wr, 67 op/s 2021-10-08T19:35:20.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:20 smithi157 ceph-mon[42114]: pgmap v660: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 85 B/s wr, 60 op/s 2021-10-08T19:35:20.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:20 smithi157 ceph-mon[32847]: pgmap v660: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 85 B/s wr, 60 op/s 2021-10-08T19:35:20.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:20 smithi196 ceph-mon[34258]: pgmap v660: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 85 B/s wr, 60 op/s 2021-10-08T19:35:23.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:22 smithi196 ceph-mon[34258]: pgmap v661: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 85 B/s wr, 61 op/s 2021-10-08T19:35:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:22 smithi157 ceph-mon[32847]: pgmap v661: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 85 B/s wr, 61 op/s 2021-10-08T19:35:23.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:22 smithi157 ceph-mon[42114]: pgmap v661: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 85 B/s wr, 61 op/s 2021-10-08T19:35:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:23.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:23.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:23.523Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:35:25.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:24 smithi157 ceph-mon[32847]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:35:25.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:24 smithi157 ceph-mon[42114]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:35:25.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:24 smithi196 ceph-mon[34258]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:35:27.158 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:26 smithi196 ceph-mon[34258]: pgmap v663: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:35:27.159 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:35:26 smithi196 conmon[46000]: 2021-10-08T19:35:26.986+0000 7f34fe12f700 -1 snap_mapper.add_oid found existing snaps mapped on 216:65b56a2d:test-rados-api-smithi157-88568-80::foo:2, removing 2021-10-08T19:35:27.160 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:35:26 smithi196 conmon[53867]: 2021-10-08T19:35:26.986+0000 7f64e7d1e700 -1 snap_mapper.add_oid found existing snaps mapped on 216:65b56a2d:test-rados-api-smithi157-88568-80::foo:2, removing 2021-10-08T19:35:27.160 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:35:26 smithi196 conmon[41793]: 2021-10-08T19:35:26.985+0000 7fed3c207700 -1 snap_mapper.add_oid found existing snaps mapped on 216:65b56a2d:test-rados-api-smithi157-88568-80::foo:2, removing 2021-10-08T19:35:27.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:26 smithi157 ceph-mon[32847]: pgmap v663: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:35:27.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:26 smithi157 ceph-mon[42114]: pgmap v663: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:35:27.619 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:35:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:35:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:27] "GET /metrics HTTP/1.1" 200 157679 "" "Prometheus/2.18.1" 2021-10-08T19:35:28.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:28.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:28.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-79"}]: dispatch 2021-10-08T19:35:28.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-79"}]: dispatch 2021-10-08T19:35:28.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:28.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:28.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-79"}]: dispatch 2021-10-08T19:35:28.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-79"}]: dispatch 2021-10-08T19:35:28.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:28.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:28.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-79"}]: dispatch 2021-10-08T19:35:28.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-79"}]: dispatch 2021-10-08T19:35:29.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:35:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:28 smithi196 ceph-mon[34258]: pgmap v664: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:35:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:28 smithi196 ceph-mon[34258]: osdmap e432: 8 total, 8 up, 8 in 2021-10-08T19:35:29.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:29.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:28 smithi157 ceph-mon[42114]: pgmap v664: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:35:29.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:28 smithi157 ceph-mon[42114]: osdmap e432: 8 total, 8 up, 8 in 2021-10-08T19:35:29.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:29.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:28 smithi157 ceph-mon[32847]: pgmap v664: 228 pgs: 228 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:35:29.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:28 smithi157 ceph-mon[32847]: osdmap e432: 8 total, 8 up, 8 in 2021-10-08T19:35:30.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:29 smithi157 ceph-mon[32847]: osdmap e433: 8 total, 8 up, 8 in 2021-10-08T19:35:30.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:30.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:30.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:29 smithi157 ceph-mon[42114]: osdmap e433: 8 total, 8 up, 8 in 2021-10-08T19:35:30.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:30.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:30.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:29 smithi196 ceph-mon[34258]: osdmap e433: 8 total, 8 up, 8 in 2021-10-08T19:35:30.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:30.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:31.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:30 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:35:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:31.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[32847]: pgmap v667: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:35:31.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-81","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:31.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[32847]: osdmap e434: 8 total, 8 up, 8 in 2021-10-08T19:35:31.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:31.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:31.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:31.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:31.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[42114]: pgmap v667: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:35:31.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-81","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:31.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[42114]: osdmap e434: 8 total, 8 up, 8 in 2021-10-08T19:35:31.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:31.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:31.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:31.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:30 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:31.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:30 smithi196 ceph-mon[34258]: pgmap v667: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:35:31.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-81","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:31.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:30 smithi196 ceph-mon[34258]: osdmap e434: 8 total, 8 up, 8 in 2021-10-08T19:35:31.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:31.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:31.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:31.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:30 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:32.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:35:32.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:35:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:32.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:32.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: osdmap e435: 8 total, 8 up, 8 in 2021-10-08T19:35:32.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:32.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:32.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:35:32.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:35:32.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:35:32.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:32.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:35:32.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:35:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:32.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:32.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: osdmap e435: 8 total, 8 up, 8 in 2021-10-08T19:35:32.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:32.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:32.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:35:32.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:35:32.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:35:32.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:35:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:35:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: osdmap e435: 8 total, 8 up, 8 in 2021-10-08T19:35:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:32.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:32.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:35:32.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:35:32.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:35:32.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:33.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[32847]: pgmap v670: 228 pgs: 228 active+clean; 8.4 MiB data, 431 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-10-08T19:35:33.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:35:33.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[32847]: osdmap e436: 8 total, 8 up, 8 in 2021-10-08T19:35:33.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:33.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:33.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[42114]: pgmap v670: 228 pgs: 228 active+clean; 8.4 MiB data, 431 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-10-08T19:35:33.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:35:33.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[42114]: osdmap e436: 8 total, 8 up, 8 in 2021-10-08T19:35:33.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:33.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:33.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:32 smithi196 ceph-mon[34258]: pgmap v670: 228 pgs: 228 active+clean; 8.4 MiB data, 431 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-10-08T19:35:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:35:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:32 smithi196 ceph-mon[34258]: osdmap e436: 8 total, 8 up, 8 in 2021-10-08T19:35:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:33.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:33.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:33.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:33.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:33.523Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:35:34.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:35:34.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:33 smithi157 ceph-mon[32847]: osdmap e437: 8 total, 8 up, 8 in 2021-10-08T19:35:34.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:34.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:34.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:35:34.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:33 smithi157 ceph-mon[42114]: osdmap e437: 8 total, 8 up, 8 in 2021-10-08T19:35:34.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:34.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:34.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:35:34.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:33 smithi196 ceph-mon[34258]: osdmap e437: 8 total, 8 up, 8 in 2021-10-08T19:35:34.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:34.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:35.028 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:34 smithi196 ceph-mon[34258]: pgmap v673: 228 pgs: 228 active+clean; 8.4 MiB data, 431 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:35:35.028 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:35.029 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:34 smithi196 ceph-mon[34258]: osdmap e438: 8 total, 8 up, 8 in 2021-10-08T19:35:35.029 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:35:35.029 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:35:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[32847]: pgmap v673: 228 pgs: 228 active+clean; 8.4 MiB data, 431 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:35:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[32847]: osdmap e438: 8 total, 8 up, 8 in 2021-10-08T19:35:35.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:35:35.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:35:35.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[42114]: pgmap v673: 228 pgs: 228 active+clean; 8.4 MiB data, 431 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:35:35.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:35.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[42114]: osdmap e438: 8 total, 8 up, 8 in 2021-10-08T19:35:35.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:35:35.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:35:36.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2021-10-08T19:35:36.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[42114]: osdmap e439: 8 total, 8 up, 8 in 2021-10-08T19:35:36.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:35:36.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:35:36.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:36.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:36.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:36.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:36.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2021-10-08T19:35:36.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[32847]: osdmap e439: 8 total, 8 up, 8 in 2021-10-08T19:35:36.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:35:36.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:35:36.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:36.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:36.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:36.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2021-10-08T19:35:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:35 smithi196 ceph-mon[34258]: osdmap e439: 8 total, 8 up, 8 in 2021-10-08T19:35:36.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:35:36.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:35:36.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:36.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:36.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:36.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:37.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[42114]: pgmap v676: 228 pgs: 228 active+clean; 8.4 MiB data, 431 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:37.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2021-10-08T19:35:37.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[42114]: osdmap e440: 8 total, 8 up, 8 in 2021-10-08T19:35:37.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:37.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[32847]: pgmap v676: 228 pgs: 228 active+clean; 8.4 MiB data, 431 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2021-10-08T19:35:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[32847]: osdmap e440: 8 total, 8 up, 8 in 2021-10-08T19:35:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:37.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:36 smithi196 ceph-mon[34258]: pgmap v676: 228 pgs: 228 active+clean; 8.4 MiB data, 431 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2021-10-08T19:35:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:36 smithi196 ceph-mon[34258]: osdmap e440: 8 total, 8 up, 8 in 2021-10-08T19:35:37.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:37.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:37.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:35:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:35:37.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:37] "GET /metrics HTTP/1.1" 200 157644 "" "Prometheus/2.18.1" 2021-10-08T19:35:38.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:38.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[32847]: osdmap e441: 8 total, 8 up, 8 in 2021-10-08T19:35:38.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:38.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:38.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-81"}]: dispatch 2021-10-08T19:35:38.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-81"}]: dispatch 2021-10-08T19:35:38.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:38.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[42114]: osdmap e441: 8 total, 8 up, 8 in 2021-10-08T19:35:38.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:38.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:38.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-81"}]: dispatch 2021-10-08T19:35:38.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-81"}]: dispatch 2021-10-08T19:35:38.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:37 smithi196 ceph-mon[34258]: osdmap e441: 8 total, 8 up, 8 in 2021-10-08T19:35:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-81"}]: dispatch 2021-10-08T19:35:38.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-81"}]: dispatch 2021-10-08T19:35:38.951 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:35:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:38 smithi157 ceph-mon[32847]: pgmap v679: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 29 op/s 2021-10-08T19:35:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:38 smithi157 ceph-mon[32847]: osdmap e442: 8 total, 8 up, 8 in 2021-10-08T19:35:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:38 smithi157 ceph-mon[42114]: pgmap v679: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 29 op/s 2021-10-08T19:35:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:38 smithi157 ceph-mon[42114]: osdmap e442: 8 total, 8 up, 8 in 2021-10-08T19:35:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:38 smithi196 ceph-mon[34258]: pgmap v679: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 29 op/s 2021-10-08T19:35:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:38 smithi196 ceph-mon[34258]: osdmap e442: 8 total, 8 up, 8 in 2021-10-08T19:35:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:39 smithi157 ceph-mon[32847]: osdmap e443: 8 total, 8 up, 8 in 2021-10-08T19:35:40.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:39 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:40.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:39 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:40.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:39 smithi157 ceph-mon[42114]: osdmap e443: 8 total, 8 up, 8 in 2021-10-08T19:35:40.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:39 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:40.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:39 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:40.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:39 smithi196 ceph-mon[34258]: osdmap e443: 8 total, 8 up, 8 in 2021-10-08T19:35:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:39 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:39 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:41.319 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[42114]: pgmap v682: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 9.0 KiB/s wr, 28 op/s 2021-10-08T19:35:41.319 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-83","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:41.319 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[42114]: osdmap e444: 8 total, 8 up, 8 in 2021-10-08T19:35:41.320 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:41.320 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:41.320 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:41.321 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[32847]: pgmap v682: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 9.0 KiB/s wr, 28 op/s 2021-10-08T19:35:41.321 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-83","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:41.321 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[32847]: osdmap e444: 8 total, 8 up, 8 in 2021-10-08T19:35:41.321 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:41.322 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:41.322 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:40 smithi196 ceph-mon[34258]: pgmap v682: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 9.0 KiB/s wr, 28 op/s 2021-10-08T19:35:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-83","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:40 smithi196 ceph-mon[34258]: osdmap e444: 8 total, 8 up, 8 in 2021-10-08T19:35:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:41.577 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:41 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:35:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[32847]: osdmap e445: 8 total, 8 up, 8 in 2021-10-08T19:35:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:42.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:42.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:35:42.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:35:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:42.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[32847]: pgmap v685: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 11 op/s 2021-10-08T19:35:42.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:42.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[42114]: osdmap e445: 8 total, 8 up, 8 in 2021-10-08T19:35:42.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:42.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:42.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:42.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:35:42.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:35:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:42.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:41 smithi157 ceph-mon[42114]: pgmap v685: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 11 op/s 2021-10-08T19:35:42.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:41 smithi196 ceph-mon[34258]: osdmap e445: 8 total, 8 up, 8 in 2021-10-08T19:35:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:41 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:42.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:41 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:35:42.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:41 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:35:41] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:42.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:41 smithi196 ceph-mon[34258]: pgmap v685: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 11 op/s 2021-10-08T19:35:43.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:35:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:42 smithi157 ceph-mon[32847]: osdmap e446: 8 total, 8 up, 8 in 2021-10-08T19:35:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:43.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:35:43.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:42 smithi157 ceph-mon[42114]: osdmap e446: 8 total, 8 up, 8 in 2021-10-08T19:35:43.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:43.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:43.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:35:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:42 smithi196 ceph-mon[34258]: osdmap e446: 8 total, 8 up, 8 in 2021-10-08T19:35:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:43.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:43.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:43.943 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:43.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:43.944 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:43.523Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:35:44.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:35:44.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[32847]: osdmap e447: 8 total, 8 up, 8 in 2021-10-08T19:35:44.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:44.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:44.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[32847]: pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2021-10-08T19:35:44.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:35:44.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[42114]: osdmap e447: 8 total, 8 up, 8 in 2021-10-08T19:35:44.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:44.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:44.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:43 smithi157 ceph-mon[42114]: pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2021-10-08T19:35:44.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:35:44.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:43 smithi196 ceph-mon[34258]: osdmap e447: 8 total, 8 up, 8 in 2021-10-08T19:35:44.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:44.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:44.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:43 smithi196 ceph-mon[34258]: pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2021-10-08T19:35:45.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:45 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:45.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:45 smithi157 ceph-mon[32847]: osdmap e448: 8 total, 8 up, 8 in 2021-10-08T19:35:45.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:45 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:45.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:45 smithi157 ceph-mon[42114]: osdmap e448: 8 total, 8 up, 8 in 2021-10-08T19:35:45.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:45 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:45.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:45 smithi196 ceph-mon[34258]: osdmap e448: 8 total, 8 up, 8 in 2021-10-08T19:35:46.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:46 smithi157 ceph-mon[32847]: osdmap e449: 8 total, 8 up, 8 in 2021-10-08T19:35:46.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:46 smithi157 ceph-mon[32847]: pgmap v691: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:46.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:46 smithi157 ceph-mon[42114]: osdmap e449: 8 total, 8 up, 8 in 2021-10-08T19:35:46.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:46 smithi157 ceph-mon[42114]: pgmap v691: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:46.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:46 smithi196 ceph-mon[34258]: osdmap e449: 8 total, 8 up, 8 in 2021-10-08T19:35:46.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:46 smithi196 ceph-mon[34258]: pgmap v691: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[32847]: osdmap e450: 8 total, 8 up, 8 in 2021-10-08T19:35:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:47.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:47.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-83"}]: dispatch 2021-10-08T19:35:47.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-83"}]: dispatch 2021-10-08T19:35:47.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[42114]: osdmap e450: 8 total, 8 up, 8 in 2021-10-08T19:35:47.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:47.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:47.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-83"}]: dispatch 2021-10-08T19:35:47.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-83"}]: dispatch 2021-10-08T19:35:47.366 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:35:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:35:47.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:47 smithi196 ceph-mon[34258]: osdmap e450: 8 total, 8 up, 8 in 2021-10-08T19:35:47.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:47.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:47.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-83"}]: dispatch 2021-10-08T19:35:47.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-83"}]: dispatch 2021-10-08T19:35:47.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:47] "GET /metrics HTTP/1.1" 200 157644 "" "Prometheus/2.18.1" 2021-10-08T19:35:48.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:48 smithi157 ceph-mon[42114]: osdmap e451: 8 total, 8 up, 8 in 2021-10-08T19:35:48.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:48.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:48 smithi157 ceph-mon[42114]: pgmap v694: 196 pgs: 196 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2021-10-08T19:35:48.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:48 smithi157 ceph-mon[32847]: osdmap e451: 8 total, 8 up, 8 in 2021-10-08T19:35:48.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:48.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:48 smithi157 ceph-mon[32847]: pgmap v694: 196 pgs: 196 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2021-10-08T19:35:48.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:48 smithi196 ceph-mon[34258]: osdmap e451: 8 total, 8 up, 8 in 2021-10-08T19:35:48.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:48.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:48 smithi196 ceph-mon[34258]: pgmap v694: 196 pgs: 196 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2021-10-08T19:35:49.023 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:35:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:49.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:49 smithi157 ceph-mon[42114]: osdmap e452: 8 total, 8 up, 8 in 2021-10-08T19:35:49.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:49.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:49 smithi157 ceph-mon[32847]: osdmap e452: 8 total, 8 up, 8 in 2021-10-08T19:35:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:49.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:49 smithi196 ceph-mon[34258]: osdmap e452: 8 total, 8 up, 8 in 2021-10-08T19:35:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-85","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[32847]: osdmap e453: 8 total, 8 up, 8 in 2021-10-08T19:35:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[32847]: pgmap v697: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2021-10-08T19:35:50.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-85","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[42114]: osdmap e453: 8 total, 8 up, 8 in 2021-10-08T19:35:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:50 smithi157 ceph-mon[42114]: pgmap v697: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2021-10-08T19:35:50.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-85","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:50.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:50 smithi196 ceph-mon[34258]: osdmap e453: 8 total, 8 up, 8 in 2021-10-08T19:35:50.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:50.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:50.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:50.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:50 smithi196 ceph-mon[34258]: pgmap v697: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2021-10-08T19:35:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:51 smithi157 ceph-mon[32847]: osdmap e454: 8 total, 8 up, 8 in 2021-10-08T19:35:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:51 smithi157 ceph-mon[42114]: osdmap e454: 8 total, 8 up, 8 in 2021-10-08T19:35:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:51.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:51.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:51 smithi196 ceph-mon[34258]: osdmap e454: 8 total, 8 up, 8 in 2021-10-08T19:35:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:52.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:35:52.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[42114]: osdmap e455: 8 total, 8 up, 8 in 2021-10-08T19:35:52.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:52.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:52.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[42114]: pgmap v700: 228 pgs: 228 active+clean; 8.4 MiB data, 440 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:52.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:35:52.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[42114]: osdmap e456: 8 total, 8 up, 8 in 2021-10-08T19:35:52.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:35:52.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[32847]: osdmap e455: 8 total, 8 up, 8 in 2021-10-08T19:35:52.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:52.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:52.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[32847]: pgmap v700: 228 pgs: 228 active+clean; 8.4 MiB data, 440 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:52.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:35:52.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:52 smithi157 ceph-mon[32847]: osdmap e456: 8 total, 8 up, 8 in 2021-10-08T19:35:52.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_tier","val": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:35:52.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:52 smithi196 ceph-mon[34258]: osdmap e455: 8 total, 8 up, 8 in 2021-10-08T19:35:52.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:52.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:35:52.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:52 smithi196 ceph-mon[34258]: pgmap v700: 228 pgs: 228 active+clean; 8.4 MiB data, 440 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:52.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:35:52.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:52 smithi196 ceph-mon[34258]: osdmap e456: 8 total, 8 up, 8 in 2021-10-08T19:35:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:53.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:53.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:53.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:53 smithi157 ceph-mon[32847]: osdmap e457: 8 total, 8 up, 8 in 2021-10-08T19:35:53.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:53.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:53.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:53.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:53 smithi157 ceph-mon[42114]: osdmap e457: 8 total, 8 up, 8 in 2021-10-08T19:35:53.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:53.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:35:53.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:35:53.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:53 smithi196 ceph-mon[34258]: osdmap e457: 8 total, 8 up, 8 in 2021-10-08T19:35:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:53.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:53.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:35:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:35:53.524Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:35:54.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:54 smithi157 ceph-mon[32847]: pgmap v703: 228 pgs: 228 active+clean; 8.4 MiB data, 440 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:54.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:54 smithi157 ceph-mon[42114]: pgmap v703: 228 pgs: 228 active+clean; 8.4 MiB data, 440 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:54.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:54 smithi196 ceph-mon[34258]: pgmap v703: 228 pgs: 228 active+clean; 8.4 MiB data, 440 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:55.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:55 smithi157 ceph-mon[32847]: osdmap e458: 8 total, 8 up, 8 in 2021-10-08T19:35:55.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:55 smithi157 ceph-mon[42114]: osdmap e458: 8 total, 8 up, 8 in 2021-10-08T19:35:55.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:55 smithi196 ceph-mon[34258]: osdmap e458: 8 total, 8 up, 8 in 2021-10-08T19:35:56.078 INFO:tasks.workunit.client.0.smithi157.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (18080 ms) 2021-10-08T19:35:56.079 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2021-10-08T19:35:56.079 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22944 ms) 2021-10-08T19:35:56.079 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2021-10-08T19:35:56.079 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3013 ms) 2021-10-08T19:35:56.080 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2021-10-08T19:35:56.080 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.080 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3012 ms) 2021-10-08T19:35:56.080 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2021-10-08T19:35:56.081 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3024 ms) 2021-10-08T19:35:56.081 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2021-10-08T19:35:56.081 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.081 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3018 ms) 2021-10-08T19:35:56.081 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2021-10-08T19:35:56.082 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.082 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4028 ms) 2021-10-08T19:35:56.082 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2021-10-08T19:35:56.082 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (38954 ms) 2021-10-08T19:35:56.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2021-10-08T19:35:56.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (16974 ms) 2021-10-08T19:35:56.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2021-10-08T19:35:56.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4030 ms) 2021-10-08T19:35:56.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2021-10-08T19:35:56.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3012 ms) 2021-10-08T19:35:56.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2021-10-08T19:35:56.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (24963 ms) 2021-10-08T19:35:56.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2021-10-08T19:35:56.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15005 ms) 2021-10-08T19:35:56.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2021-10-08T19:35:56.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5036 ms) 2021-10-08T19:35:56.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2021-10-08T19:35:56.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4019 ms) 2021-10-08T19:35:56.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2021-10-08T19:35:56.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: waiting for scrubs... 2021-10-08T19:35:56.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: done waiting 2021-10-08T19:35:56.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24958 ms) 2021-10-08T19:35:56.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2021-10-08T19:35:56.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10075 ms) 2021-10-08T19:35:56.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2021-10-08T19:35:56.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9064 ms) 2021-10-08T19:35:56.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2021-10-08T19:35:56.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:35:56.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9056 ms) 2021-10-08T19:35:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[32847]: osdmap e459: 8 total, 8 up, 8 in 2021-10-08T19:35:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-85"}]: dispatch 2021-10-08T19:35:56.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-85"}]: dispatch 2021-10-08T19:35:56.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[32847]: pgmap v706: 228 pgs: 228 active+clean; 8.4 MiB data, 440 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:56.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[42114]: osdmap e459: 8 total, 8 up, 8 in 2021-10-08T19:35:56.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:56.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:56.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-85"}]: dispatch 2021-10-08T19:35:56.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-85"}]: dispatch 2021-10-08T19:35:56.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:56 smithi157 ceph-mon[42114]: pgmap v706: 228 pgs: 228 active+clean; 8.4 MiB data, 440 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:56.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:56 smithi196 ceph-mon[34258]: osdmap e459: 8 total, 8 up, 8 in 2021-10-08T19:35:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:35:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-85"}]: dispatch 2021-10-08T19:35:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:56 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-85"}]: dispatch 2021-10-08T19:35:56.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:56 smithi196 ceph-mon[34258]: pgmap v706: 228 pgs: 228 active+clean; 8.4 MiB data, 440 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:57.069 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:56 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:35:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:57 smithi157 ceph-mon[32847]: osdmap e460: 8 total, 8 up, 8 in 2021-10-08T19:35:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:57 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:57 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:35:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:57 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:35:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:57 smithi157 ceph-mon[42114]: osdmap e460: 8 total, 8 up, 8 in 2021-10-08T19:35:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:57 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:57 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:35:57.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:57 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:35:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:57.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:57 smithi196 ceph-mon[34258]: osdmap e460: 8 total, 8 up, 8 in 2021-10-08T19:35:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:57 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:35:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:57 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:35:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:57 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:35:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:57.368 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:35:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:35:57.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:35:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:57] "GET /metrics HTTP/1.1" 200 157636 "" "Prometheus/2.18.1" 2021-10-08T19:35:58.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:58 smithi196 ceph-mon[34258]: osdmap e461: 8 total, 8 up, 8 in 2021-10-08T19:35:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:58 smithi196 ceph-mon[34258]: pgmap v709: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:35:58.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[32847]: osdmap e461: 8 total, 8 up, 8 in 2021-10-08T19:35:58.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:58.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:58.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:58.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[32847]: pgmap v709: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:35:58.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[42114]: osdmap e461: 8 total, 8 up, 8 in 2021-10-08T19:35:58.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:58.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:58.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:58.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:58 smithi157 ceph-mon[42114]: pgmap v709: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:35:59.081 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:35:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:35:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:59.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-87","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:59 smithi196 ceph-mon[34258]: osdmap e462: 8 total, 8 up, 8 in 2021-10-08T19:35:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:35:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:59.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-87","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:59.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:59 smithi157 ceph-mon[32847]: osdmap e462: 8 total, 8 up, 8 in 2021-10-08T19:35:59.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:35:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:59.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-87","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:59.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:59 smithi157 ceph-mon[42114]: osdmap e462: 8 total, 8 up, 8 in 2021-10-08T19:35:59.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:35:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:00.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:00 smithi196 ceph-mon[34258]: osdmap e463: 8 total, 8 up, 8 in 2021-10-08T19:36:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:00 smithi196 ceph-mon[34258]: pgmap v712: 260 pgs: 64 unknown, 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:36:00.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:00 smithi157 ceph-mon[42114]: osdmap e463: 8 total, 8 up, 8 in 2021-10-08T19:36:00.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:00.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:00.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:00 smithi157 ceph-mon[42114]: pgmap v712: 260 pgs: 64 unknown, 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:36:00.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:00 smithi157 ceph-mon[32847]: osdmap e463: 8 total, 8 up, 8 in 2021-10-08T19:36:00.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:00.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:00.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:00 smithi157 ceph-mon[32847]: pgmap v712: 260 pgs: 64 unknown, 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:36:01.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:01 smithi196 ceph-mon[34258]: osdmap e464: 8 total, 8 up, 8 in 2021-10-08T19:36:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_tier","val": "test-rados-api-smithi157-88568-89-test-flush"}]: dispatch 2021-10-08T19:36:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_tier","val": "test-rados-api-smithi157-88568-89-test-flush"}]: dispatch 2021-10-08T19:36:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_tier","val": "test-rados-api-smithi157-88568-89-test-flush"}]': finished 2021-10-08T19:36:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:01 smithi196 ceph-mon[34258]: osdmap e465: 8 total, 8 up, 8 in 2021-10-08T19:36:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:01.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:01.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[42114]: osdmap e464: 8 total, 8 up, 8 in 2021-10-08T19:36:01.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_tier","val": "test-rados-api-smithi157-88568-89-test-flush"}]: dispatch 2021-10-08T19:36:01.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_tier","val": "test-rados-api-smithi157-88568-89-test-flush"}]: dispatch 2021-10-08T19:36:01.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_tier","val": "test-rados-api-smithi157-88568-89-test-flush"}]': finished 2021-10-08T19:36:01.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[42114]: osdmap e465: 8 total, 8 up, 8 in 2021-10-08T19:36:01.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:01.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:01.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:01.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[32847]: osdmap e464: 8 total, 8 up, 8 in 2021-10-08T19:36:01.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_tier","val": "test-rados-api-smithi157-88568-89-test-flush"}]: dispatch 2021-10-08T19:36:01.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_tier","val": "test-rados-api-smithi157-88568-89-test-flush"}]: dispatch 2021-10-08T19:36:01.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_tier","val": "test-rados-api-smithi157-88568-89-test-flush"}]': finished 2021-10-08T19:36:01.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[32847]: osdmap e465: 8 total, 8 up, 8 in 2021-10-08T19:36:01.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:01.582 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:02.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:02 smithi196 ceph-mon[34258]: pgmap v715: 260 pgs: 260 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:36:02.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:02.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:02 smithi196 ceph-mon[34258]: osdmap e466: 8 total, 8 up, 8 in 2021-10-08T19:36:02.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:02.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:02.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[32847]: pgmap v715: 260 pgs: 260 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:36:02.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:02.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[32847]: osdmap e466: 8 total, 8 up, 8 in 2021-10-08T19:36:02.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:02.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[42114]: pgmap v715: 260 pgs: 260 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:36:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[42114]: osdmap e466: 8 total, 8 up, 8 in 2021-10-08T19:36:02.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:02.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:03.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:03.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:03.524Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:36:04.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:04.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:04 smithi196 ceph-mon[34258]: osdmap e467: 8 total, 8 up, 8 in 2021-10-08T19:36:04.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:04 smithi196 ceph-mon[34258]: pgmap v718: 260 pgs: 260 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:36:04.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:04.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:04 smithi157 ceph-mon[32847]: osdmap e467: 8 total, 8 up, 8 in 2021-10-08T19:36:04.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:04 smithi157 ceph-mon[32847]: pgmap v718: 260 pgs: 260 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:36:04.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:04.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:04 smithi157 ceph-mon[42114]: osdmap e467: 8 total, 8 up, 8 in 2021-10-08T19:36:04.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:04 smithi157 ceph-mon[42114]: pgmap v718: 260 pgs: 260 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:36:05.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:05 smithi196 ceph-mon[34258]: osdmap e468: 8 total, 8 up, 8 in 2021-10-08T19:36:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-87"}]: dispatch 2021-10-08T19:36:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-87"}]: dispatch 2021-10-08T19:36:05.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[32847]: osdmap e468: 8 total, 8 up, 8 in 2021-10-08T19:36:05.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:05.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:05.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-87"}]: dispatch 2021-10-08T19:36:05.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-87"}]: dispatch 2021-10-08T19:36:05.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[42114]: osdmap e468: 8 total, 8 up, 8 in 2021-10-08T19:36:05.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:05.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:05.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-87"}]: dispatch 2021-10-08T19:36:05.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-87"}]: dispatch 2021-10-08T19:36:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:06 smithi196 ceph-mon[34258]: osdmap e469: 8 total, 8 up, 8 in 2021-10-08T19:36:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:06 smithi196 ceph-mon[34258]: pgmap v721: 196 pgs: 196 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:06.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:06 smithi157 ceph-mon[32847]: osdmap e469: 8 total, 8 up, 8 in 2021-10-08T19:36:06.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:06 smithi157 ceph-mon[32847]: pgmap v721: 196 pgs: 196 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:06.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:06 smithi157 ceph-mon[42114]: osdmap e469: 8 total, 8 up, 8 in 2021-10-08T19:36:06.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:06 smithi157 ceph-mon[42114]: pgmap v721: 196 pgs: 196 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:07.534 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:07 smithi157 ceph-mon[32847]: osdmap e470: 8 total, 8 up, 8 in 2021-10-08T19:36:07.534 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:07.534 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:07.535 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:07 smithi157 ceph-mon[42114]: osdmap e470: 8 total, 8 up, 8 in 2021-10-08T19:36:07.535 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:07.535 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:07.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:36:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:36:07.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:07 smithi196 ceph-mon[34258]: osdmap e470: 8 total, 8 up, 8 in 2021-10-08T19:36:07.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:07.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:07] "GET /metrics HTTP/1.1" 200 156551 "" "Prometheus/2.18.1" 2021-10-08T19:36:08.422 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-90","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:08.422 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[32847]: osdmap e471: 8 total, 8 up, 8 in 2021-10-08T19:36:08.422 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:08.423 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:08.423 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:08.423 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:08.424 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[32847]: pgmap v724: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:36:08.424 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:08.424 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[32847]: osdmap e472: 8 total, 8 up, 8 in 2021-10-08T19:36:08.424 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-90","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:08.425 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[42114]: osdmap e471: 8 total, 8 up, 8 in 2021-10-08T19:36:08.425 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:08.425 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:08.425 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:08.426 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:08.426 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[42114]: pgmap v724: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:36:08.426 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:08.426 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:08 smithi157 ceph-mon[42114]: osdmap e472: 8 total, 8 up, 8 in 2021-10-08T19:36:08.427 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:08 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:36:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:08.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-90","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:08.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:08 smithi196 ceph-mon[34258]: osdmap e471: 8 total, 8 up, 8 in 2021-10-08T19:36:08.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:08.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:08.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:08.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:08.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:08 smithi196 ceph-mon[34258]: pgmap v724: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:36:08.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:08.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:08 smithi196 ceph-mon[34258]: osdmap e472: 8 total, 8 up, 8 in 2021-10-08T19:36:09.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:36:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:09.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:09 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:09.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:09 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:36:09.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:09 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:36:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:09.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:09 smithi157 ceph-mon[32847]: osdmap e473: 8 total, 8 up, 8 in 2021-10-08T19:36:09.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:09 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:09.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:09 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:36:09.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:09 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:36:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:09.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:09 smithi157 ceph-mon[42114]: osdmap e473: 8 total, 8 up, 8 in 2021-10-08T19:36:09.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:09 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:09.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:09 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:36:09.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:09 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:36:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:09.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:09 smithi196 ceph-mon[34258]: osdmap e473: 8 total, 8 up, 8 in 2021-10-08T19:36:10.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[42114]: pgmap v727: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:36:10.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[42114]: osdmap e474: 8 total, 8 up, 8 in 2021-10-08T19:36:10.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:10.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:10.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-90"}]: dispatch 2021-10-08T19:36:10.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-90"}]: dispatch 2021-10-08T19:36:10.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[32847]: pgmap v727: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:36:10.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[32847]: osdmap e474: 8 total, 8 up, 8 in 2021-10-08T19:36:10.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:10.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:10.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-90"}]: dispatch 2021-10-08T19:36:10.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-90"}]: dispatch 2021-10-08T19:36:10.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:10 smithi196 ceph-mon[34258]: pgmap v727: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:36:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:10 smithi196 ceph-mon[34258]: osdmap e474: 8 total, 8 up, 8 in 2021-10-08T19:36:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-90"}]: dispatch 2021-10-08T19:36:10.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-90"}]: dispatch 2021-10-08T19:36:12.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:12 smithi157 ceph-mon[32847]: osdmap e475: 8 total, 8 up, 8 in 2021-10-08T19:36:12.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:12 smithi157 ceph-mon[32847]: pgmap v730: 196 pgs: 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:36:12.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:12 smithi157 ceph-mon[42114]: osdmap e475: 8 total, 8 up, 8 in 2021-10-08T19:36:12.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:12 smithi157 ceph-mon[42114]: pgmap v730: 196 pgs: 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:36:12.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:12 smithi196 ceph-mon[34258]: osdmap e475: 8 total, 8 up, 8 in 2021-10-08T19:36:12.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:12 smithi196 ceph-mon[34258]: pgmap v730: 196 pgs: 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:36:13.524 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:13 smithi157 ceph-mon[32847]: osdmap e476: 8 total, 8 up, 8 in 2021-10-08T19:36:13.524 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:13.525 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:13.525 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:13 smithi157 ceph-mon[42114]: osdmap e476: 8 total, 8 up, 8 in 2021-10-08T19:36:13.525 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:13.525 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:13.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:13 smithi196 ceph-mon[34258]: osdmap e476: 8 total, 8 up, 8 in 2021-10-08T19:36:13.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:13.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:13.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:13.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:13.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:13.524Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:36:14.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-92","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:14.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:14 smithi157 ceph-mon[32847]: osdmap e477: 8 total, 8 up, 8 in 2021-10-08T19:36:14.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:14.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:14 smithi157 ceph-mon[32847]: pgmap v733: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:36:14.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-92","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:14.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:14 smithi157 ceph-mon[42114]: osdmap e477: 8 total, 8 up, 8 in 2021-10-08T19:36:14.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:14.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:14 smithi157 ceph-mon[42114]: pgmap v733: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:36:14.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-92","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:14.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:14 smithi196 ceph-mon[34258]: osdmap e477: 8 total, 8 up, 8 in 2021-10-08T19:36:14.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:14.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:14 smithi196 ceph-mon[34258]: pgmap v733: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:36:15.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:15 smithi157 ceph-mon[32847]: osdmap e478: 8 total, 8 up, 8 in 2021-10-08T19:36:15.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:15 smithi157 ceph-mon[42114]: osdmap e478: 8 total, 8 up, 8 in 2021-10-08T19:36:15.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:15 smithi196 ceph-mon[34258]: osdmap e478: 8 total, 8 up, 8 in 2021-10-08T19:36:16.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[32847]: osdmap e479: 8 total, 8 up, 8 in 2021-10-08T19:36:16.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:16.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:16.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-92"}]: dispatch 2021-10-08T19:36:16.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-92"}]: dispatch 2021-10-08T19:36:16.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[32847]: pgmap v736: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:16.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[42114]: osdmap e479: 8 total, 8 up, 8 in 2021-10-08T19:36:16.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:16.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:16.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-92"}]: dispatch 2021-10-08T19:36:16.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-92"}]: dispatch 2021-10-08T19:36:16.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:16 smithi157 ceph-mon[42114]: pgmap v736: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:16.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:16 smithi196 ceph-mon[34258]: osdmap e479: 8 total, 8 up, 8 in 2021-10-08T19:36:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-92"}]: dispatch 2021-10-08T19:36:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-92"}]: dispatch 2021-10-08T19:36:16.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:16 smithi196 ceph-mon[34258]: pgmap v736: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:17.533 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:17 smithi157 ceph-mon[32847]: osdmap e480: 8 total, 8 up, 8 in 2021-10-08T19:36:17.534 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:17 smithi157 ceph-mon[42114]: osdmap e480: 8 total, 8 up, 8 in 2021-10-08T19:36:17.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:17 smithi196 ceph-mon[34258]: osdmap e480: 8 total, 8 up, 8 in 2021-10-08T19:36:17.617 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:36:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:36:17.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:17] "GET /metrics HTTP/1.1" 200 156551 "" "Prometheus/2.18.1" 2021-10-08T19:36:18.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[32847]: osdmap e481: 8 total, 8 up, 8 in 2021-10-08T19:36:18.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:18.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:18.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:18.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[32847]: pgmap v739: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:36:18.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[42114]: osdmap e481: 8 total, 8 up, 8 in 2021-10-08T19:36:18.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:18.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:18.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:18.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:18 smithi157 ceph-mon[42114]: pgmap v739: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:36:18.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:18 smithi196 ceph-mon[34258]: osdmap e481: 8 total, 8 up, 8 in 2021-10-08T19:36:18.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:18.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:18.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:18.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:18 smithi196 ceph-mon[34258]: pgmap v739: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:36:19.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:36:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:19.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-94","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:19.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:19 smithi157 ceph-mon[32847]: osdmap e482: 8 total, 8 up, 8 in 2021-10-08T19:36:19.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:19.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-94","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:19.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:19 smithi157 ceph-mon[42114]: osdmap e482: 8 total, 8 up, 8 in 2021-10-08T19:36:19.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:19.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-94","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:19.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:19 smithi196 ceph-mon[34258]: osdmap e482: 8 total, 8 up, 8 in 2021-10-08T19:36:19.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:20.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:20 smithi157 ceph-mon[32847]: osdmap e483: 8 total, 8 up, 8 in 2021-10-08T19:36:20.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:20 smithi157 ceph-mon[32847]: pgmap v742: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:36:20.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:20 smithi157 ceph-mon[42114]: osdmap e483: 8 total, 8 up, 8 in 2021-10-08T19:36:20.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:20 smithi157 ceph-mon[42114]: pgmap v742: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:36:20.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:20 smithi196 ceph-mon[34258]: osdmap e483: 8 total, 8 up, 8 in 2021-10-08T19:36:20.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:20 smithi196 ceph-mon[34258]: pgmap v742: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:36:21.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:21 smithi157 ceph-mon[32847]: osdmap e484: 8 total, 8 up, 8 in 2021-10-08T19:36:21.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:21 smithi157 ceph-mon[42114]: osdmap e484: 8 total, 8 up, 8 in 2021-10-08T19:36:21.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:21 smithi196 ceph-mon[34258]: osdmap e484: 8 total, 8 up, 8 in 2021-10-08T19:36:22.546 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:22 smithi157 ceph-mon[32847]: pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2021-10-08T19:36:22.547 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:22 smithi157 ceph-mon[42114]: pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2021-10-08T19:36:22.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:22 smithi196 ceph-mon[34258]: pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2021-10-08T19:36:22.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:22 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:36:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:23.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:23 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:23.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:23 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:36:23.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:23 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:36:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:23 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:23 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:36:23.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:23 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:36:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:23.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:23.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:23.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:23.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:23.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:23.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:36:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:23 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:23 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:36:23.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:23 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:36:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:24.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:24 smithi157 ceph-mon[42114]: pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2021-10-08T19:36:24.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:24 smithi157 ceph-mon[32847]: pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2021-10-08T19:36:24.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:24 smithi196 ceph-mon[34258]: pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2021-10-08T19:36:27.205 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:26 smithi196 ceph-mon[34258]: pgmap v746: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2021-10-08T19:36:27.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:26 smithi157 ceph-mon[32847]: pgmap v746: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2021-10-08T19:36:27.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:26 smithi157 ceph-mon[42114]: pgmap v746: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2021-10-08T19:36:27.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:36:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:36:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:27] "GET /metrics HTTP/1.1" 200 157644 "" "Prometheus/2.18.1" 2021-10-08T19:36:28.889 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:36:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:29.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:29.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:28 smithi157 ceph-mon[32847]: pgmap v747: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 948 B/s wr, 4 op/s 2021-10-08T19:36:29.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:29.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:28 smithi157 ceph-mon[42114]: pgmap v747: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 948 B/s wr, 4 op/s 2021-10-08T19:36:29.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:29.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:28 smithi196 ceph-mon[34258]: pgmap v747: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 948 B/s wr, 4 op/s 2021-10-08T19:36:30.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:30 smithi157 ceph-mon[32847]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2021-10-08T19:36:30.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:30 smithi157 ceph-mon[42114]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2021-10-08T19:36:30.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:30 smithi196 ceph-mon[34258]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2021-10-08T19:36:31.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: osdmap e485: 8 total, 8 up, 8 in 2021-10-08T19:36:31.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:36:31.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:36:31.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:36:31.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:31.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:31.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:31.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: osdmap e485: 8 total, 8 up, 8 in 2021-10-08T19:36:31.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:36:31.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:36:31.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:36:31.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.835 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.836 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:31.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:31.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: osdmap e485: 8 total, 8 up, 8 in 2021-10-08T19:36:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:36:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:36:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:36:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.870 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:36:31.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:31.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:31.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:32.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:32 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi196 to 3013M 2021-10-08T19:36:32.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:32 smithi157 ceph-mon[32847]: Adjusting osd_memory_target on smithi157 to 3013M 2021-10-08T19:36:32.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:32 smithi157 ceph-mon[32847]: pgmap v750: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:32.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:32 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi196 to 3013M 2021-10-08T19:36:32.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:32 smithi157 ceph-mon[42114]: Adjusting osd_memory_target on smithi157 to 3013M 2021-10-08T19:36:32.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:32 smithi157 ceph-mon[42114]: pgmap v750: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:32.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:32 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi196 to 3013M 2021-10-08T19:36:32.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:32 smithi196 ceph-mon[34258]: Adjusting osd_memory_target on smithi157 to 3013M 2021-10-08T19:36:32.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:32 smithi196 ceph-mon[34258]: pgmap v750: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:33.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:33.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:33.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:36:35.311 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:34 smithi157 ceph-mon[32847]: pgmap v751: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:35.313 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:34 smithi157 ceph-mon[32847]: osdmap e486: 8 total, 8 up, 8 in 2021-10-08T19:36:35.314 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:34 smithi157 ceph-mon[42114]: pgmap v751: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:35.314 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:34 smithi157 ceph-mon[42114]: osdmap e486: 8 total, 8 up, 8 in 2021-10-08T19:36:35.314 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:35 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:36:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:35.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:34 smithi196 ceph-mon[34258]: pgmap v751: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:35.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:34 smithi196 ceph-mon[34258]: osdmap e486: 8 total, 8 up, 8 in 2021-10-08T19:36:36.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:36.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:36:36.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:36:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:36.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:36.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:36.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:36.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:36.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[32847]: pgmap v753: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:36.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:36.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:36:36.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:36:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:36.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:36.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:36.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:36.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:36.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:36 smithi157 ceph-mon[42114]: pgmap v753: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:36.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:36.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:36 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:36:36.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:36 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:36:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:36.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:36.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:36.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:36.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:36.619 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:36 smithi196 ceph-mon[34258]: pgmap v753: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:37.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:37] "GET /metrics HTTP/1.1" 200 157702 "" "Prometheus/2.18.1" 2021-10-08T19:36:37.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:37 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.10", "id": [2, 7]}]: dispatch 2021-10-08T19:36:37.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:37 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:36:37.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:37 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.10", "id": [2, 7]}]: dispatch 2021-10-08T19:36:37.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:37 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:36:37.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:37 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.10", "id": [2, 7]}]: dispatch 2021-10-08T19:36:37.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:37 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:36:37.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:37 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.10", "id": [2, 7]}]: dispatch 2021-10-08T19:36:37.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:37 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:36:37.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:37 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.10", "id": [2, 7]}]: dispatch 2021-10-08T19:36:37.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:37 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:36:37.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:37 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.10", "id": [2, 7]}]: dispatch 2021-10-08T19:36:37.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:37 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:36:37.618 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:36:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:36:38.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:38.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.10", "id": [2, 7]}]': finished 2021-10-08T19:36:38.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]': finished 2021-10-08T19:36:38.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[32847]: osdmap e487: 8 total, 8 up, 8 in 2021-10-08T19:36:38.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[32847]: pgmap v755: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:38.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:38.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.10", "id": [2, 7]}]': finished 2021-10-08T19:36:38.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]': finished 2021-10-08T19:36:38.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[42114]: osdmap e487: 8 total, 8 up, 8 in 2021-10-08T19:36:38.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:38 smithi157 ceph-mon[42114]: pgmap v755: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:38.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:38.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:38 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.10", "id": [2, 7]}]': finished 2021-10-08T19:36:38.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:38 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]': finished 2021-10-08T19:36:38.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:38 smithi196 ceph-mon[34258]: osdmap e487: 8 total, 8 up, 8 in 2021-10-08T19:36:38.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:38 smithi196 ceph-mon[34258]: pgmap v755: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:36:39.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:36:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:39.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:39 smithi157 ceph-mon[32847]: osdmap e488: 8 total, 8 up, 8 in 2021-10-08T19:36:39.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:39 smithi157 ceph-mon[42114]: osdmap e488: 8 total, 8 up, 8 in 2021-10-08T19:36:39.620 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:39 smithi196 ceph-mon[34258]: osdmap e488: 8 total, 8 up, 8 in 2021-10-08T19:36:40.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:40 smithi157 ceph-mon[32847]: pgmap v757: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:36:40.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:40 smithi157 ceph-mon[42114]: pgmap v757: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:36:40.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:40 smithi196 ceph-mon[34258]: pgmap v757: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:36:42.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:42.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:42.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-94"}]: dispatch 2021-10-08T19:36:42.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-94"}]: dispatch 2021-10-08T19:36:42.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:42.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:42.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-94"}]: dispatch 2021-10-08T19:36:42.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-94"}]: dispatch 2021-10-08T19:36:42.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-94"}]: dispatch 2021-10-08T19:36:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-94"}]: dispatch 2021-10-08T19:36:43.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[32847]: osdmap e489: 8 total, 8 up, 8 in 2021-10-08T19:36:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[32847]: pgmap v759: 196 pgs: 196 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[32847]: osdmap e490: 8 total, 8 up, 8 in 2021-10-08T19:36:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:43.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[42114]: osdmap e489: 8 total, 8 up, 8 in 2021-10-08T19:36:43.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[42114]: pgmap v759: 196 pgs: 196 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:43.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[42114]: osdmap e490: 8 total, 8 up, 8 in 2021-10-08T19:36:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:43.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:42 smithi196 ceph-mon[34258]: osdmap e489: 8 total, 8 up, 8 in 2021-10-08T19:36:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:42 smithi196 ceph-mon[34258]: pgmap v759: 196 pgs: 196 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:42 smithi196 ceph-mon[34258]: osdmap e490: 8 total, 8 up, 8 in 2021-10-08T19:36:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:43.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:43.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:43.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:43.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:43.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:36:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-96","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:44 smithi157 ceph-mon[32847]: osdmap e491: 8 total, 8 up, 8 in 2021-10-08T19:36:44.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:44.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:44 smithi157 ceph-mon[32847]: pgmap v762: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:44.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-96","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:44.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:44 smithi157 ceph-mon[42114]: osdmap e491: 8 total, 8 up, 8 in 2021-10-08T19:36:44.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:44.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:44 smithi157 ceph-mon[42114]: pgmap v762: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:44.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-96","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:44 smithi196 ceph-mon[34258]: osdmap e491: 8 total, 8 up, 8 in 2021-10-08T19:36:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:44.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:44 smithi196 ceph-mon[34258]: pgmap v762: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:45.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:45 smithi157 ceph-mon[32847]: osdmap e492: 8 total, 8 up, 8 in 2021-10-08T19:36:45.907 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:45 smithi157 ceph-mon[42114]: osdmap e492: 8 total, 8 up, 8 in 2021-10-08T19:36:45.908 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:45 smithi196 ceph-mon[34258]: osdmap e492: 8 total, 8 up, 8 in 2021-10-08T19:36:46.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:46 smithi157 ceph-mon[32847]: pgmap v764: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 239 B/s wr, 1 op/s 2021-10-08T19:36:46.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:46 smithi157 ceph-mon[42114]: pgmap v764: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 239 B/s wr, 1 op/s 2021-10-08T19:36:46.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:46 smithi196 ceph-mon[34258]: pgmap v764: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 239 B/s wr, 1 op/s 2021-10-08T19:36:47.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:36:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:36:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:47] "GET /metrics HTTP/1.1" 200 157702 "" "Prometheus/2.18.1" 2021-10-08T19:36:48.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:48 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:36:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:48.893 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:36:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:48 smithi157 ceph-mon[32847]: pgmap v765: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 2 op/s 2021-10-08T19:36:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:48 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:48 smithi157 ceph-mon[42114]: pgmap v765: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 2 op/s 2021-10-08T19:36:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:48 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:48 smithi196 ceph-mon[34258]: pgmap v765: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 2 op/s 2021-10-08T19:36:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:48 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:36:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:49 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:36:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:49 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:36:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:50.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:49 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:36:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:49 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:36:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:50.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:49 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:36:50.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:49 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:36:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:50 smithi157 ceph-mon[32847]: pgmap v766: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 703 B/s rd, 703 B/s wr, 2 op/s 2021-10-08T19:36:51.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:50 smithi157 ceph-mon[42114]: pgmap v766: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 703 B/s rd, 703 B/s wr, 2 op/s 2021-10-08T19:36:51.373 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:50 smithi196 ceph-mon[34258]: pgmap v766: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 703 B/s rd, 703 B/s wr, 2 op/s 2021-10-08T19:36:53.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:52 smithi157 ceph-mon[32847]: pgmap v767: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 618 B/s wr, 2 op/s 2021-10-08T19:36:53.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:52 smithi157 ceph-mon[42114]: pgmap v767: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 618 B/s wr, 2 op/s 2021-10-08T19:36:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:52 smithi196 ceph-mon[34258]: pgmap v767: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 618 B/s wr, 2 op/s 2021-10-08T19:36:53.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:53.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:53.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:53.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:53.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:36:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:36:53.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:36:54.866 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:36:54 smithi196 conmon[53867]: 2021-10-08T19:36:54.591+0000 7f64e651b700 -1 snap_mapper.add_oid found existing snaps mapped on 64:9de3d32a:test-rados-api-smithi157-88568-97::foo:31, removing 2021-10-08T19:36:54.902 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:36:54 smithi157 conmon[59794]: 2021-10-08T19:36:54.591+0000 7f3c8f39b700 -1 snap_mapper.add_oid found existing snaps mapped on 64:9de3d32a:test-rados-api-smithi157-88568-97::foo:31, removing 2021-10-08T19:36:54.902 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:36:54 smithi157 conmon[47549]: 2021-10-08T19:36:54.591+0000 7efcdec11700 -1 snap_mapper.add_oid found existing snaps mapped on 64:9de3d32a:test-rados-api-smithi157-88568-97::foo:31, removing 2021-10-08T19:36:55.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[42114]: pgmap v768: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:36:55.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:55.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:55.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-96"}]: dispatch 2021-10-08T19:36:55.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-96"}]: dispatch 2021-10-08T19:36:55.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[32847]: pgmap v768: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:36:55.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:55.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:55.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-96"}]: dispatch 2021-10-08T19:36:55.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-96"}]: dispatch 2021-10-08T19:36:55.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:54 smithi196 ceph-mon[34258]: pgmap v768: 228 pgs: 228 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:36:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:36:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-96"}]: dispatch 2021-10-08T19:36:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-96"}]: dispatch 2021-10-08T19:36:56.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:56 smithi157 ceph-mon[32847]: osdmap e493: 8 total, 8 up, 8 in 2021-10-08T19:36:56.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:56 smithi157 ceph-mon[32847]: pgmap v770: 196 pgs: 196 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2021-10-08T19:36:56.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:56 smithi157 ceph-mon[42114]: osdmap e493: 8 total, 8 up, 8 in 2021-10-08T19:36:56.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:56 smithi157 ceph-mon[42114]: pgmap v770: 196 pgs: 196 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2021-10-08T19:36:56.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:56 smithi196 ceph-mon[34258]: osdmap e493: 8 total, 8 up, 8 in 2021-10-08T19:36:56.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:56 smithi196 ceph-mon[34258]: pgmap v770: 196 pgs: 196 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2021-10-08T19:36:57.577 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:36:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:36:57.579 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:57 smithi196 ceph-mon[34258]: osdmap e494: 8 total, 8 up, 8 in 2021-10-08T19:36:57.579 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:57.579 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:57.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:36:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:57] "GET /metrics HTTP/1.1" 200 157709 "" "Prometheus/2.18.1" 2021-10-08T19:36:57.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:57 smithi157 ceph-mon[32847]: osdmap e494: 8 total, 8 up, 8 in 2021-10-08T19:36:57.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:57.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:57.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:57 smithi157 ceph-mon[42114]: osdmap e494: 8 total, 8 up, 8 in 2021-10-08T19:36:57.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:57.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:58.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:58.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-98","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:58.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[32847]: osdmap e495: 8 total, 8 up, 8 in 2021-10-08T19:36:58.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:36:58.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:36:58.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[32847]: pgmap v773: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:36:58.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:58.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-98","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:58.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[42114]: osdmap e495: 8 total, 8 up, 8 in 2021-10-08T19:36:58.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:36:58.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:36:58.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:58 smithi157 ceph-mon[42114]: pgmap v773: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:36:58.867 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:36:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:36:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:58.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-98","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:58.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:58 smithi196 ceph-mon[34258]: osdmap e495: 8 total, 8 up, 8 in 2021-10-08T19:36:58.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:36:58.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:36:58.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:58 smithi196 ceph-mon[34258]: pgmap v773: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:36:59.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:36:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:59 smithi196 ceph-mon[34258]: osdmap e496: 8 total, 8 up, 8 in 2021-10-08T19:36:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-98", "mode": "writeback"}]: dispatch 2021-10-08T19:36:59.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:36:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:37:00.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:59 smithi157 ceph-mon[32847]: osdmap e496: 8 total, 8 up, 8 in 2021-10-08T19:37:00.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:00.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:36:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:00.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:37:00.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:59 smithi157 ceph-mon[42114]: osdmap e496: 8 total, 8 up, 8 in 2021-10-08T19:37:00.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:00.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:36:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:00.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:00 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-98", "mode": "writeback"}]': finished 2021-10-08T19:37:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:00 smithi196 ceph-mon[34258]: osdmap e497: 8 total, 8 up, 8 in 2021-10-08T19:37:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:00.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:00 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:00.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:00 smithi196 ceph-mon[34258]: pgmap v776: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:01.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:01.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-98", "mode": "writeback"}]': finished 2021-10-08T19:37:01.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[42114]: osdmap e497: 8 total, 8 up, 8 in 2021-10-08T19:37:01.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:01.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:01.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[42114]: pgmap v776: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-98", "mode": "writeback"}]': finished 2021-10-08T19:37:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[32847]: osdmap e497: 8 total, 8 up, 8 in 2021-10-08T19:37:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:00 smithi157 ceph-mon[32847]: pgmap v776: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:01.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-98"}]': finished 2021-10-08T19:37:01.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:01 smithi196 ceph-mon[34258]: osdmap e498: 8 total, 8 up, 8 in 2021-10-08T19:37:01.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:37:01.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:01 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:37:02.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-98"}]': finished 2021-10-08T19:37:02.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:01 smithi157 ceph-mon[32847]: osdmap e498: 8 total, 8 up, 8 in 2021-10-08T19:37:02.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:37:02.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:01 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:37:02.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-98"}]': finished 2021-10-08T19:37:02.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:01 smithi157 ceph-mon[42114]: osdmap e498: 8 total, 8 up, 8 in 2021-10-08T19:37:02.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:37:02.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:01 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:37:02.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:02 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:37:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:02.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:02.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:37:02.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[42114]: osdmap e499: 8 total, 8 up, 8 in 2021-10-08T19:37:02.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:37:02.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:37:02.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[42114]: pgmap v779: 228 pgs: 228 active+clean; 8.4 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:02.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:02.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:02.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:37:02.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[32847]: osdmap e499: 8 total, 8 up, 8 in 2021-10-08T19:37:02.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:37:02.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:37:02.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[32847]: pgmap v779: 228 pgs: 228 active+clean; 8.4 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:02.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:02 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:02.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:02 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:02.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:37:02.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:02 smithi196 ceph-mon[34258]: osdmap e499: 8 total, 8 up, 8 in 2021-10-08T19:37:02.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:37:02.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:02 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:37:02.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:02 smithi196 ceph-mon[34258]: pgmap v779: 228 pgs: 228 active+clean; 8.4 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:02.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:02 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:03.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:37:03.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:37:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:03.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_count","val": "1"}]': finished 2021-10-08T19:37:03.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[32847]: osdmap e500: 8 total, 8 up, 8 in 2021-10-08T19:37:03.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:03.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:03.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:37:03.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:37:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:03.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_count","val": "1"}]': finished 2021-10-08T19:37:03.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[42114]: osdmap e500: 8 total, 8 up, 8 in 2021-10-08T19:37:03.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:03.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:03 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:03.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:03.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:03.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:03.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:03.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:03.526Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:37:03.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:03 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:37:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:03 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:37:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_count","val": "1"}]': finished 2021-10-08T19:37:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:03 smithi196 ceph-mon[34258]: osdmap e500: 8 total, 8 up, 8 in 2021-10-08T19:37:03.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:03.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:03 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:05.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:37:05.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[32847]: osdmap e501: 8 total, 8 up, 8 in 2021-10-08T19:37:05.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:37:05.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:37:05.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[32847]: pgmap v782: 228 pgs: 228 active+clean; 8.4 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:05.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:37:05.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[42114]: osdmap e501: 8 total, 8 up, 8 in 2021-10-08T19:37:05.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:37:05.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:37:05.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:04 smithi157 ceph-mon[42114]: pgmap v782: 228 pgs: 228 active+clean; 8.4 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:37:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:04 smithi196 ceph-mon[34258]: osdmap e501: 8 total, 8 up, 8 in 2021-10-08T19:37:05.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:37:05.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:04 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:37:05.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:04 smithi196 ceph-mon[34258]: pgmap v782: 228 pgs: 228 active+clean; 8.4 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:06.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "target_max_objects","val": "250"}]': finished 2021-10-08T19:37:06.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:05 smithi157 ceph-mon[32847]: osdmap e502: 8 total, 8 up, 8 in 2021-10-08T19:37:06.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:06.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:05 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:06.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "target_max_objects","val": "250"}]': finished 2021-10-08T19:37:06.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:05 smithi157 ceph-mon[42114]: osdmap e502: 8 total, 8 up, 8 in 2021-10-08T19:37:06.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:06.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:05 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:06.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-98","var": "target_max_objects","val": "250"}]': finished 2021-10-08T19:37:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:05 smithi196 ceph-mon[34258]: osdmap e502: 8 total, 8 up, 8 in 2021-10-08T19:37:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:06.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:05 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:07.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:37:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[32847]: osdmap e503: 8 total, 8 up, 8 in 2021-10-08T19:37:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[32847]: pgmap v785: 228 pgs: 228 active+clean; 8.4 MiB data, 469 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:07.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:37:07.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[42114]: osdmap e503: 8 total, 8 up, 8 in 2021-10-08T19:37:07.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:07.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:07.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:06 smithi157 ceph-mon[42114]: pgmap v785: 228 pgs: 228 active+clean; 8.4 MiB data, 469 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:37:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:06 smithi196 ceph-mon[34258]: osdmap e503: 8 total, 8 up, 8 in 2021-10-08T19:37:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:07.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:06 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98"}]: dispatch 2021-10-08T19:37:07.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:06 smithi196 ceph-mon[34258]: pgmap v785: 228 pgs: 228 active+clean; 8.4 MiB data, 469 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:07.617 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:37:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:37:07.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98"}]': finished 2021-10-08T19:37:07.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:07 smithi157 ceph-mon[32847]: osdmap e504: 8 total, 8 up, 8 in 2021-10-08T19:37:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:07] "GET /metrics HTTP/1.1" 200 157682 "" "Prometheus/2.18.1" 2021-10-08T19:37:07.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98"}]': finished 2021-10-08T19:37:07.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:07 smithi157 ceph-mon[42114]: osdmap e504: 8 total, 8 up, 8 in 2021-10-08T19:37:08.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-98"}]': finished 2021-10-08T19:37:08.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:07 smithi196 ceph-mon[34258]: osdmap e504: 8 total, 8 up, 8 in 2021-10-08T19:37:08.757 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:08.757 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:08 smithi157 ceph-mon[42114]: osdmap e505: 8 total, 8 up, 8 in 2021-10-08T19:37:08.758 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:08 smithi157 ceph-mon[42114]: pgmap v788: 196 pgs: 196 active+clean; 8.4 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:08.758 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:08.758 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:08 smithi157 ceph-mon[32847]: osdmap e505: 8 total, 8 up, 8 in 2021-10-08T19:37:08.759 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:08 smithi157 ceph-mon[32847]: pgmap v788: 196 pgs: 196 active+clean; 8.4 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:09.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:37:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:09.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:08 smithi196 ceph-mon[34258]: osdmap e505: 8 total, 8 up, 8 in 2021-10-08T19:37:09.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:08 smithi196 ceph-mon[34258]: pgmap v788: 196 pgs: 196 active+clean; 8.4 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:10.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:09 smithi157 ceph-mon[32847]: osdmap e506: 8 total, 8 up, 8 in 2021-10-08T19:37:10.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:10.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:09 smithi157 ceph-mon[42114]: osdmap e506: 8 total, 8 up, 8 in 2021-10-08T19:37:10.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:10.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:10.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:09 smithi196 ceph-mon[34258]: osdmap e506: 8 total, 8 up, 8 in 2021-10-08T19:37:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:10.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-100","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:10.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[42114]: osdmap e507: 8 total, 8 up, 8 in 2021-10-08T19:37:10.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:10.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:10.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[42114]: pgmap v791: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:10.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-100","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:10.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[32847]: osdmap e507: 8 total, 8 up, 8 in 2021-10-08T19:37:10.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:10.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:10.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:10 smithi157 ceph-mon[32847]: pgmap v791: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-100","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:10 smithi196 ceph-mon[34258]: osdmap e507: 8 total, 8 up, 8 in 2021-10-08T19:37:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:11.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:10 smithi196 ceph-mon[34258]: pgmap v791: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:12.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:11 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:37:12.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:11 smithi157 ceph-mon[32847]: osdmap e508: 8 total, 8 up, 8 in 2021-10-08T19:37:12.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:12.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:11 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:12.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:11 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:37:12.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:11 smithi157 ceph-mon[42114]: osdmap e508: 8 total, 8 up, 8 in 2021-10-08T19:37:12.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:12.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:11 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:12.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:11 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:37:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:11 smithi196 ceph-mon[34258]: osdmap e508: 8 total, 8 up, 8 in 2021-10-08T19:37:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:12.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:11 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:13.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-100"}]': finished 2021-10-08T19:37:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[32847]: osdmap e509: 8 total, 8 up, 8 in 2021-10-08T19:37:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-100", "mode": "writeback"}]: dispatch 2021-10-08T19:37:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-100", "mode": "writeback"}]: dispatch 2021-10-08T19:37:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[32847]: pgmap v794: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:13.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-100"}]': finished 2021-10-08T19:37:13.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[42114]: osdmap e509: 8 total, 8 up, 8 in 2021-10-08T19:37:13.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-100", "mode": "writeback"}]: dispatch 2021-10-08T19:37:13.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-100", "mode": "writeback"}]: dispatch 2021-10-08T19:37:13.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:12 smithi157 ceph-mon[42114]: pgmap v794: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-6", "overlaypool": "test-rados-api-smithi157-88568-100"}]': finished 2021-10-08T19:37:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:12 smithi196 ceph-mon[34258]: osdmap e509: 8 total, 8 up, 8 in 2021-10-08T19:37:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-100", "mode": "writeback"}]: dispatch 2021-10-08T19:37:13.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:12 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-100", "mode": "writeback"}]: dispatch 2021-10-08T19:37:13.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:12 smithi196 ceph-mon[34258]: pgmap v794: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:13.833 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:13 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:37:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:13.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:13.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-100", "mode": "writeback"}]': finished 2021-10-08T19:37:13.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[42114]: osdmap e510: 8 total, 8 up, 8 in 2021-10-08T19:37:13.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:13.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:13.835 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:13.836 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:13.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:13.836 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:13.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:13.836 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:13.526Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:37:13.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:13.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-100", "mode": "writeback"}]': finished 2021-10-08T19:37:13.837 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[32847]: osdmap e510: 8 total, 8 up, 8 in 2021-10-08T19:37:13.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:13.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:13.838 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:13 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:14.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:13 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:14.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-100", "mode": "writeback"}]': finished 2021-10-08T19:37:14.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:13 smithi196 ceph-mon[34258]: osdmap e510: 8 total, 8 up, 8 in 2021-10-08T19:37:14.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:14.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:14.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:13 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:37:15.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:37:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:37:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[32847]: osdmap e511: 8 total, 8 up, 8 in 2021-10-08T19:37:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[32847]: pgmap v797: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:15.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:37:15.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:37:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:37:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[42114]: osdmap e511: 8 total, 8 up, 8 in 2021-10-08T19:37:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:15.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:14 smithi157 ceph-mon[42114]: pgmap v797: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:15.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:14 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:37:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:14 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:37:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:37:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:14 smithi196 ceph-mon[34258]: osdmap e511: 8 total, 8 up, 8 in 2021-10-08T19:37:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:14 smithi196 ceph-mon[34258]: pgmap v797: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:16.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:37:16.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:15 smithi157 ceph-mon[42114]: osdmap e512: 8 total, 8 up, 8 in 2021-10-08T19:37:16.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:16.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:37:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:15 smithi157 ceph-mon[32847]: osdmap e512: 8 total, 8 up, 8 in 2021-10-08T19:37:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:16.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:16.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:37:16.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:15 smithi196 ceph-mon[34258]: osdmap e512: 8 total, 8 up, 8 in 2021-10-08T19:37:16.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:16.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:17.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:37:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[32847]: osdmap e513: 8 total, 8 up, 8 in 2021-10-08T19:37:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:37:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:37:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[32847]: pgmap v800: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2021-10-08T19:37:17.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[32847]: osdmap e514: 8 total, 8 up, 8 in 2021-10-08T19:37:17.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:17.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:37:17.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[42114]: osdmap e513: 8 total, 8 up, 8 in 2021-10-08T19:37:17.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:37:17.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:37:17.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[42114]: pgmap v800: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:17.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2021-10-08T19:37:17.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:16 smithi157 ceph-mon[42114]: osdmap e514: 8 total, 8 up, 8 in 2021-10-08T19:37:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:16 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:37:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:16 smithi196 ceph-mon[34258]: osdmap e513: 8 total, 8 up, 8 in 2021-10-08T19:37:17.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:37:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:37:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:16 smithi196 ceph-mon[34258]: pgmap v800: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:16 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2021-10-08T19:37:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:16 smithi196 ceph-mon[34258]: osdmap e514: 8 total, 8 up, 8 in 2021-10-08T19:37:17.617 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:37:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:37:17.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:17.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:17 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:17.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:17] "GET /metrics HTTP/1.1" 200 157682 "" "Prometheus/2.18.1" 2021-10-08T19:37:17.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:17.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:17 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:18.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:18.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:17 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]: dispatch 2021-10-08T19:37:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:37:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[32847]: osdmap e515: 8 total, 8 up, 8 in 2021-10-08T19:37:19.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:19.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:19.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[32847]: pgmap v803: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:19.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:19.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:37:19.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[42114]: osdmap e515: 8 total, 8 up, 8 in 2021-10-08T19:37:19.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:19.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:19.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:18 smithi157 ceph-mon[42114]: pgmap v803: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:19.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:37:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-6"}]': finished 2021-10-08T19:37:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:18 smithi196 ceph-mon[34258]: osdmap e515: 8 total, 8 up, 8 in 2021-10-08T19:37:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/526385666' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100"}]: dispatch 2021-10-08T19:37:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:18 smithi196 ceph-mon[34258]: pgmap v803: 228 pgs: 228 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:20.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100"}]': finished 2021-10-08T19:37:20.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:19 smithi157 ceph-mon[32847]: osdmap e516: 8 total, 8 up, 8 in 2021-10-08T19:37:20.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100"}]': finished 2021-10-08T19:37:20.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:19 smithi157 ceph-mon[42114]: osdmap e516: 8 total, 8 up, 8 in 2021-10-08T19:37:20.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-6", "tierpool": "test-rados-api-smithi157-88568-100"}]': finished 2021-10-08T19:37:20.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:19 smithi196 ceph-mon[34258]: osdmap e516: 8 total, 8 up, 8 in 2021-10-08T19:37:21.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:20 smithi157 ceph-mon[32847]: osdmap e517: 8 total, 8 up, 8 in 2021-10-08T19:37:21.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:20 smithi157 ceph-mon[32847]: pgmap v806: 196 pgs: 196 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:21.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:20 smithi157 ceph-mon[32847]: osdmap e518: 8 total, 8 up, 8 in 2021-10-08T19:37:21.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:20 smithi157 ceph-mon[42114]: osdmap e517: 8 total, 8 up, 8 in 2021-10-08T19:37:21.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:20 smithi157 ceph-mon[42114]: pgmap v806: 196 pgs: 196 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:21.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:20 smithi157 ceph-mon[42114]: osdmap e518: 8 total, 8 up, 8 in 2021-10-08T19:37:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:20 smithi196 ceph-mon[34258]: osdmap e517: 8 total, 8 up, 8 in 2021-10-08T19:37:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:20 smithi196 ceph-mon[34258]: pgmap v806: 196 pgs: 196 active+clean; 8.4 MiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:20 smithi196 ceph-mon[34258]: osdmap e518: 8 total, 8 up, 8 in 2021-10-08T19:37:22.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:22.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:22.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:22.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:37:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:22 smithi157 ceph-mon[32847]: osdmap e519: 8 total, 8 up, 8 in 2021-10-08T19:37:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:22 smithi157 ceph-mon[32847]: pgmap v809: 164 pgs: 164 active+clean; 582 KiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:23.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:37:23.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:22 smithi157 ceph-mon[42114]: osdmap e519: 8 total, 8 up, 8 in 2021-10-08T19:37:23.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:23.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:22 smithi157 ceph-mon[42114]: pgmap v809: 164 pgs: 164 active+clean; 582 KiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:23.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:37:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:22 smithi196 ceph-mon[34258]: osdmap e519: 8 total, 8 up, 8 in 2021-10-08T19:37:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:22 smithi196 ceph-mon[34258]: pgmap v809: 164 pgs: 164 active+clean; 582 KiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:23.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:23.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:23.526Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:37:24.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:23 smithi157 ceph-mon[42114]: osdmap e520: 8 total, 8 up, 8 in 2021-10-08T19:37:24.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-102"}]': finished 2021-10-08T19:37:24.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:23 smithi157 ceph-mon[42114]: osdmap e521: 8 total, 8 up, 8 in 2021-10-08T19:37:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:23 smithi157 ceph-mon[32847]: osdmap e520: 8 total, 8 up, 8 in 2021-10-08T19:37:24.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-102"}]': finished 2021-10-08T19:37:24.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:23 smithi157 ceph-mon[32847]: osdmap e521: 8 total, 8 up, 8 in 2021-10-08T19:37:24.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:23 smithi196 ceph-mon[34258]: osdmap e520: 8 total, 8 up, 8 in 2021-10-08T19:37:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-102"}]': finished 2021-10-08T19:37:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:23 smithi196 ceph-mon[34258]: osdmap e521: 8 total, 8 up, 8 in 2021-10-08T19:37:25.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:25 smithi157 ceph-mon[32847]: pgmap v812: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:25.581 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:25 smithi157 ceph-mon[32847]: osdmap e522: 8 total, 8 up, 8 in 2021-10-08T19:37:25.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:25 smithi157 ceph-mon[42114]: pgmap v812: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:25.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:25 smithi157 ceph-mon[42114]: osdmap e522: 8 total, 8 up, 8 in 2021-10-08T19:37:25.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:25 smithi196 ceph-mon[34258]: pgmap v812: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:25.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:25 smithi196 ceph-mon[34258]: osdmap e522: 8 total, 8 up, 8 in 2021-10-08T19:37:27.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:26 smithi157 ceph-mon[32847]: osdmap e523: 8 total, 8 up, 8 in 2021-10-08T19:37:27.088 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:27.088 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:26 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:27.088 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:26 smithi157 ceph-mon[32847]: pgmap v815: 204 pgs: 40 unknown, 164 active+clean; 582 KiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:27.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:26 smithi157 ceph-mon[42114]: osdmap e523: 8 total, 8 up, 8 in 2021-10-08T19:37:27.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:27.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:26 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:27.089 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:26 smithi157 ceph-mon[42114]: pgmap v815: 204 pgs: 40 unknown, 164 active+clean; 582 KiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:27.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:26 smithi196 ceph-mon[34258]: osdmap e523: 8 total, 8 up, 8 in 2021-10-08T19:37:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:26 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:26 smithi196 ceph-mon[34258]: pgmap v815: 204 pgs: 40 unknown, 164 active+clean; 582 KiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:27.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:37:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:37:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:27 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:27 smithi157 ceph-mon[32847]: osdmap e524: 8 total, 8 up, 8 in 2021-10-08T19:37:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:27] "GET /metrics HTTP/1.1" 200 156573 "" "Prometheus/2.18.1" 2021-10-08T19:37:27.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:27 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:27.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:27 smithi157 ceph-mon[42114]: osdmap e524: 8 total, 8 up, 8 in 2021-10-08T19:37:28.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:27 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:28.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:27 smithi196 ceph-mon[34258]: osdmap e524: 8 total, 8 up, 8 in 2021-10-08T19:37:29.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:29.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[32847]: osdmap e525: 8 total, 8 up, 8 in 2021-10-08T19:37:29.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[32847]: pgmap v818: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 434 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:29.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[42114]: osdmap e525: 8 total, 8 up, 8 in 2021-10-08T19:37:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:28 smithi157 ceph-mon[42114]: pgmap v818: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 434 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:29.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:37:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:28 smithi196 ceph-mon[34258]: osdmap e525: 8 total, 8 up, 8 in 2021-10-08T19:37:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:28 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:28 smithi196 ceph-mon[34258]: pgmap v818: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 434 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:29.761 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:29 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:37:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:30.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:37:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[32847]: osdmap e526: 8 total, 8 up, 8 in 2021-10-08T19:37:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:30.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:30.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:30.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:37:30.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:30.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[42114]: osdmap e526: 8 total, 8 up, 8 in 2021-10-08T19:37:30.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:30.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:30.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:29 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:30.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:29 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:37:30.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-105-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:30.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:29 smithi196 ceph-mon[34258]: osdmap e526: 8 total, 8 up, 8 in 2021-10-08T19:37:30.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:29 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:30.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:29 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:30.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:29 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:37:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:37:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]': finished 2021-10-08T19:37:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[32847]: osdmap e527: 8 total, 8 up, 8 in 2021-10-08T19:37:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-105", "overlaypool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-105", "overlaypool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[32847]: pgmap v821: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 434 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:31.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:37:31.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:37:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:31.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]': finished 2021-10-08T19:37:31.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[42114]: osdmap e527: 8 total, 8 up, 8 in 2021-10-08T19:37:31.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-105", "overlaypool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:31.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-105", "overlaypool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:31.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:30 smithi157 ceph-mon[42114]: pgmap v821: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 434 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:31.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:30 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:37:31.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:30 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:37:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:31.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]': finished 2021-10-08T19:37:31.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:30 smithi196 ceph-mon[34258]: osdmap e527: 8 total, 8 up, 8 in 2021-10-08T19:37:31.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:30 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-105", "overlaypool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:31.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:30 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-105", "overlaypool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:31.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:30 smithi196 ceph-mon[34258]: pgmap v821: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 434 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:32.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-105", "overlaypool": "test-rados-api-smithi157-88568-105-cache"}]': finished 2021-10-08T19:37:32.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[42114]: osdmap e528: 8 total, 8 up, 8 in 2021-10-08T19:37:32.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:32.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:32.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:37:32.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:37:32.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:37:32.084 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:32.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-105", "overlaypool": "test-rados-api-smithi157-88568-105-cache"}]': finished 2021-10-08T19:37:32.085 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[32847]: osdmap e528: 8 total, 8 up, 8 in 2021-10-08T19:37:32.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:32.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:32.086 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:37:32.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:37:32.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:37:32.087 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-105", "overlaypool": "test-rados-api-smithi157-88568-105-cache"}]': finished 2021-10-08T19:37:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:31 smithi196 ceph-mon[34258]: osdmap e528: 8 total, 8 up, 8 in 2021-10-08T19:37:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:32.133 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:37:32.134 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:37:32.138 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:37:32.138 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-105-cache", "mode": "writeback"}]': finished 2021-10-08T19:37:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[32847]: osdmap e529: 8 total, 8 up, 8 in 2021-10-08T19:37:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-105"}]: dispatch 2021-10-08T19:37:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-105"}]: dispatch 2021-10-08T19:37:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[32847]: pgmap v824: 236 pgs: 236 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-105-cache", "mode": "writeback"}]': finished 2021-10-08T19:37:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[42114]: osdmap e529: 8 total, 8 up, 8 in 2021-10-08T19:37:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-105"}]: dispatch 2021-10-08T19:37:33.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-105"}]: dispatch 2021-10-08T19:37:33.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:32 smithi157 ceph-mon[42114]: pgmap v824: 236 pgs: 236 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:32 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-105-cache", "mode": "writeback"}]': finished 2021-10-08T19:37:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:32 smithi196 ceph-mon[34258]: osdmap e529: 8 total, 8 up, 8 in 2021-10-08T19:37:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-105"}]: dispatch 2021-10-08T19:37:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-105"}]: dispatch 2021-10-08T19:37:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:32 smithi196 ceph-mon[34258]: pgmap v824: 236 pgs: 236 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:33.792 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:33.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:33.792 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:33.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:33.792 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:33.527Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:37:34.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-105"}]': finished 2021-10-08T19:37:34.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:33 smithi157 ceph-mon[32847]: osdmap e530: 8 total, 8 up, 8 in 2021-10-08T19:37:34.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:34.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:34.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-105"}]': finished 2021-10-08T19:37:34.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:33 smithi157 ceph-mon[42114]: osdmap e530: 8 total, 8 up, 8 in 2021-10-08T19:37:34.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:34.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:34.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-105"}]': finished 2021-10-08T19:37:34.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:33 smithi196 ceph-mon[34258]: osdmap e530: 8 total, 8 up, 8 in 2021-10-08T19:37:34.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/477506269' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:34.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]: dispatch 2021-10-08T19:37:35.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:34 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:34 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]': finished 2021-10-08T19:37:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:34 smithi157 ceph-mon[42114]: osdmap e531: 8 total, 8 up, 8 in 2021-10-08T19:37:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:34 smithi157 ceph-mon[42114]: pgmap v827: 236 pgs: 236 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:34 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:34 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]': finished 2021-10-08T19:37:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:34 smithi157 ceph-mon[32847]: osdmap e531: 8 total, 8 up, 8 in 2021-10-08T19:37:35.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:34 smithi157 ceph-mon[32847]: pgmap v827: 236 pgs: 236 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:35.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:34 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:34 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-105", "tierpool": "test-rados-api-smithi157-88568-105-cache"}]': finished 2021-10-08T19:37:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:34 smithi196 ceph-mon[34258]: osdmap e531: 8 total, 8 up, 8 in 2021-10-08T19:37:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:34 smithi196 ceph-mon[34258]: pgmap v827: 236 pgs: 236 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:35.817 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[32847]: osdmap e532: 8 total, 8 up, 8 in 2021-10-08T19:37:35.817 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:35.817 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:35.818 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:35.818 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:35.818 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[42114]: osdmap e532: 8 total, 8 up, 8 in 2021-10-08T19:37:35.818 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:35.819 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:35.820 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:35.820 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:36.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:35 smithi196 ceph-mon[34258]: osdmap e532: 8 total, 8 up, 8 in 2021-10-08T19:37:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:36.822 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[42114]: osdmap e533: 8 total, 8 up, 8 in 2021-10-08T19:37:36.822 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:36.822 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:36.823 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:36.823 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:36.823 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:36.823 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:36.824 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[42114]: pgmap v830: 172 pgs: 172 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:37.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[32847]: osdmap e533: 8 total, 8 up, 8 in 2021-10-08T19:37:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:36 smithi157 ceph-mon[32847]: pgmap v830: 172 pgs: 172 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:36 smithi196 ceph-mon[34258]: osdmap e533: 8 total, 8 up, 8 in 2021-10-08T19:37:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:37.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:37.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:37.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:37.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:37.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:37.124 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:36 smithi196 ceph-mon[34258]: pgmap v830: 172 pgs: 172 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:37.619 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:37:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:37:37.822 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:37] "GET /metrics HTTP/1.1" 200 157650 "" "Prometheus/2.18.1" 2021-10-08T19:37:38.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:37:38.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:37 smithi157 ceph-mon[32847]: osdmap e534: 8 total, 8 up, 8 in 2021-10-08T19:37:38.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:38.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:38.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:37:38.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:37 smithi157 ceph-mon[42114]: osdmap e534: 8 total, 8 up, 8 in 2021-10-08T19:37:38.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:38.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:38.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:37:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:37 smithi196 ceph-mon[34258]: osdmap e534: 8 total, 8 up, 8 in 2021-10-08T19:37:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:38.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:39.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:37:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:38 smithi196 ceph-mon[34258]: pgmap v833: 172 pgs: 172 active+clean; 582 KiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:38 smithi196 ceph-mon[34258]: osdmap e535: 8 total, 8 up, 8 in 2021-10-08T19:37:39.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:38 smithi157 ceph-mon[32847]: pgmap v833: 172 pgs: 172 active+clean; 582 KiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:38 smithi157 ceph-mon[32847]: osdmap e535: 8 total, 8 up, 8 in 2021-10-08T19:37:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:38 smithi157 ceph-mon[42114]: pgmap v833: 172 pgs: 172 active+clean; 582 KiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:38 smithi157 ceph-mon[42114]: osdmap e535: 8 total, 8 up, 8 in 2021-10-08T19:37:39.835 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:39 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:37:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:40.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:39 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:40.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:39 smithi196 ceph-mon[34258]: osdmap e536: 8 total, 8 up, 8 in 2021-10-08T19:37:40.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:39 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:39 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:39 smithi157 ceph-mon[32847]: osdmap e536: 8 total, 8 up, 8 in 2021-10-08T19:37:40.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:39 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:39 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:39 smithi157 ceph-mon[42114]: osdmap e536: 8 total, 8 up, 8 in 2021-10-08T19:37:40.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:39 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:41.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:40 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:37:41.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:40 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:37:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:41.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:40 smithi196 ceph-mon[34258]: osdmap e537: 8 total, 8 up, 8 in 2021-10-08T19:37:41.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:41.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:41.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:40 smithi196 ceph-mon[34258]: pgmap v836: 212 pgs: 40 unknown, 172 active+clean; 582 KiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:41.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:40 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:41.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:40 smithi196 ceph-mon[34258]: osdmap e538: 8 total, 8 up, 8 in 2021-10-08T19:37:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:37:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:37:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[32847]: osdmap e537: 8 total, 8 up, 8 in 2021-10-08T19:37:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[32847]: pgmap v836: 212 pgs: 40 unknown, 172 active+clean; 582 KiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:41.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[32847]: osdmap e538: 8 total, 8 up, 8 in 2021-10-08T19:37:41.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:37:41.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:37:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:41.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[42114]: osdmap e537: 8 total, 8 up, 8 in 2021-10-08T19:37:41.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:41.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[42114]: pgmap v836: 212 pgs: 40 unknown, 172 active+clean; 582 KiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:40 smithi157 ceph-mon[42114]: osdmap e538: 8 total, 8 up, 8 in 2021-10-08T19:37:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]': finished 2021-10-08T19:37:42.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:41 smithi196 ceph-mon[34258]: osdmap e539: 8 total, 8 up, 8 in 2021-10-08T19:37:42.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-107", "overlaypool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:41 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-107", "overlaypool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]': finished 2021-10-08T19:37:42.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[42114]: osdmap e539: 8 total, 8 up, 8 in 2021-10-08T19:37:42.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-107", "overlaypool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-107", "overlaypool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]': finished 2021-10-08T19:37:42.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[32847]: osdmap e539: 8 total, 8 up, 8 in 2021-10-08T19:37:42.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-107", "overlaypool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:42.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:41 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-107", "overlaypool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:42 smithi196 ceph-mon[34258]: pgmap v839: 212 pgs: 212 active+clean; 582 KiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-107", "overlaypool": "test-rados-api-smithi157-88568-107-cache"}]': finished 2021-10-08T19:37:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:42 smithi196 ceph-mon[34258]: osdmap e540: 8 total, 8 up, 8 in 2021-10-08T19:37:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:43.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:42 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:43.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[42114]: pgmap v839: 212 pgs: 212 active+clean; 582 KiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:43.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-107", "overlaypool": "test-rados-api-smithi157-88568-107-cache"}]': finished 2021-10-08T19:37:43.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[42114]: osdmap e540: 8 total, 8 up, 8 in 2021-10-08T19:37:43.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:43.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[32847]: pgmap v839: 212 pgs: 212 active+clean; 582 KiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-107", "overlaypool": "test-rados-api-smithi157-88568-107-cache"}]': finished 2021-10-08T19:37:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[32847]: osdmap e540: 8 total, 8 up, 8 in 2021-10-08T19:37:43.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:43.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:42 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:37:43.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:43.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:43.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:43.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:43.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:43.527Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:37:44.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:43 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-107-cache", "mode": "writeback"}]': finished 2021-10-08T19:37:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:43 smithi196 ceph-mon[34258]: osdmap e541: 8 total, 8 up, 8 in 2021-10-08T19:37:44.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:44.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:43 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:44.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:44.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-107-cache", "mode": "writeback"}]': finished 2021-10-08T19:37:44.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[32847]: osdmap e541: 8 total, 8 up, 8 in 2021-10-08T19:37:44.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:44.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:44.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:44.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-107-cache", "mode": "writeback"}]': finished 2021-10-08T19:37:44.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[42114]: osdmap e541: 8 total, 8 up, 8 in 2021-10-08T19:37:44.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:44.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:43 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:37:45.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:44 smithi196 ceph-mon[34258]: pgmap v842: 212 pgs: 212 active+clean; 582 KiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:45.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:37:45.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:44 smithi196 ceph-mon[34258]: osdmap e542: 8 total, 8 up, 8 in 2021-10-08T19:37:45.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:45.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:44 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:45.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[42114]: pgmap v842: 212 pgs: 212 active+clean; 582 KiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:45.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:37:45.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[42114]: osdmap e542: 8 total, 8 up, 8 in 2021-10-08T19:37:45.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:45.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:45.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[32847]: pgmap v842: 212 pgs: 212 active+clean; 582 KiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:45.334 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:37:45.335 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[32847]: osdmap e542: 8 total, 8 up, 8 in 2021-10-08T19:37:45.336 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:45.337 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:44 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:37:47.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:46 smithi196 ceph-mon[34258]: pgmap v845: 212 pgs: 212 active+clean; 582 KiB data, 442 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:47.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:37:47.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:46 smithi196 ceph-mon[34258]: osdmap e543: 8 total, 8 up, 8 in 2021-10-08T19:37:47.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:47.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:46 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:47.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[32847]: pgmap v845: 212 pgs: 212 active+clean; 582 KiB data, 442 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:37:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[32847]: osdmap e543: 8 total, 8 up, 8 in 2021-10-08T19:37:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:47.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:47.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[42114]: pgmap v845: 212 pgs: 212 active+clean; 582 KiB data, 442 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:47.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:37:47.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[42114]: osdmap e543: 8 total, 8 up, 8 in 2021-10-08T19:37:47.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:47.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:46 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:37:47.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:37:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:37:47.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:47] "GET /metrics HTTP/1.1" 200 157650 "" "Prometheus/2.18.1" 2021-10-08T19:37:48.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:48.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:37:48.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[32847]: osdmap e544: 8 total, 8 up, 8 in 2021-10-08T19:37:48.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:37:48.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:37:48.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:48.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:37:48.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[42114]: osdmap e544: 8 total, 8 up, 8 in 2021-10-08T19:37:48.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:37:48.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:47 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:37:48.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:47 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:37:48.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:37:48.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:47 smithi196 ceph-mon[34258]: osdmap e544: 8 total, 8 up, 8 in 2021-10-08T19:37:48.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:37:48.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:47 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:37:49.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:37:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:48 smithi196 ceph-mon[34258]: pgmap v847: 212 pgs: 212 active+clean; 582 KiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:48 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2021-10-08T19:37:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:48 smithi196 ceph-mon[34258]: osdmap e545: 8 total, 8 up, 8 in 2021-10-08T19:37:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:48 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:49.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[32847]: pgmap v847: 212 pgs: 212 active+clean; 582 KiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2021-10-08T19:37:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[32847]: osdmap e545: 8 total, 8 up, 8 in 2021-10-08T19:37:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:49.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:49.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[42114]: pgmap v847: 212 pgs: 212 active+clean; 582 KiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:49.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-107-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2021-10-08T19:37:49.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[42114]: osdmap e545: 8 total, 8 up, 8 in 2021-10-08T19:37:49.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:49.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:48 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:50.001 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:50.002 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:49 smithi196 ceph-mon[34258]: osdmap e546: 8 total, 8 up, 8 in 2021-10-08T19:37:50.002 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:50.002 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:49 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:50.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:49 smithi157 ceph-mon[32847]: osdmap e546: 8 total, 8 up, 8 in 2021-10-08T19:37:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:49 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:50.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:49 smithi157 ceph-mon[42114]: osdmap e546: 8 total, 8 up, 8 in 2021-10-08T19:37:50.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:50.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:49 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]: dispatch 2021-10-08T19:37:51.300 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:50 smithi196 ceph-mon[34258]: pgmap v850: 212 pgs: 212 active+clean; 582 KiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:51.300 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]': finished 2021-10-08T19:37:51.300 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:50 smithi196 ceph-mon[34258]: osdmap e547: 8 total, 8 up, 8 in 2021-10-08T19:37:51.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:50 smithi157 ceph-mon[32847]: pgmap v850: 212 pgs: 212 active+clean; 582 KiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]': finished 2021-10-08T19:37:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:50 smithi157 ceph-mon[32847]: osdmap e547: 8 total, 8 up, 8 in 2021-10-08T19:37:51.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:50 smithi157 ceph-mon[42114]: pgmap v850: 212 pgs: 212 active+clean; 582 KiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-107", "tierpool": "test-rados-api-smithi157-88568-107-cache"}]': finished 2021-10-08T19:37:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:50 smithi157 ceph-mon[42114]: osdmap e547: 8 total, 8 up, 8 in 2021-10-08T19:37:52.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:51 smithi157 ceph-mon[32847]: osdmap e548: 8 total, 8 up, 8 in 2021-10-08T19:37:52.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:51 smithi157 ceph-mon[42114]: osdmap e548: 8 total, 8 up, 8 in 2021-10-08T19:37:52.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:51 smithi196 ceph-mon[34258]: osdmap e548: 8 total, 8 up, 8 in 2021-10-08T19:37:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[32847]: pgmap v853: 180 pgs: 180 active+clean; 582 KiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[32847]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:37:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[32847]: osdmap e549: 8 total, 8 up, 8 in 2021-10-08T19:37:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:53.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[42114]: pgmap v853: 180 pgs: 180 active+clean; 582 KiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:53.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[42114]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:37:53.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[42114]: osdmap e549: 8 total, 8 up, 8 in 2021-10-08T19:37:53.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:53.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:52 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:53.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:52 smithi196 ceph-mon[34258]: pgmap v853: 180 pgs: 180 active+clean; 582 KiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:37:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:52 smithi196 ceph-mon[34258]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:37:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:52 smithi196 ceph-mon[34258]: osdmap e549: 8 total, 8 up, 8 in 2021-10-08T19:37:53.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:53.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:52 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:53.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:53.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:37:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:37:53.527Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:37:54.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:54.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:53 smithi157 ceph-mon[32847]: osdmap e550: 8 total, 8 up, 8 in 2021-10-08T19:37:54.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:54.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:53 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:54.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:54.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:53 smithi157 ceph-mon[42114]: osdmap e550: 8 total, 8 up, 8 in 2021-10-08T19:37:54.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:54.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:53 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:54.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:54.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:53 smithi196 ceph-mon[34258]: osdmap e550: 8 total, 8 up, 8 in 2021-10-08T19:37:54.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3710949166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:54.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:53 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]: dispatch 2021-10-08T19:37:55.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:54 smithi157 ceph-mon[32847]: pgmap v856: 172 pgs: 172 active+clean; 582 KiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:54 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:54 smithi157 ceph-mon[32847]: osdmap e551: 8 total, 8 up, 8 in 2021-10-08T19:37:55.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:54 smithi157 ceph-mon[42114]: pgmap v856: 172 pgs: 172 active+clean; 582 KiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:55.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:54 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:55.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:54 smithi157 ceph-mon[42114]: osdmap e551: 8 total, 8 up, 8 in 2021-10-08T19:37:55.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:54 smithi196 ceph-mon[34258]: pgmap v856: 172 pgs: 172 active+clean; 582 KiB data, 444 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:54 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-107"}]': finished 2021-10-08T19:37:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:54 smithi196 ceph-mon[34258]: osdmap e551: 8 total, 8 up, 8 in 2021-10-08T19:37:56.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:55 smithi157 ceph-mon[32847]: osdmap e552: 8 total, 8 up, 8 in 2021-10-08T19:37:56.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:56.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:55 smithi157 ceph-mon[42114]: osdmap e552: 8 total, 8 up, 8 in 2021-10-08T19:37:56.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:55 smithi196 ceph-mon[34258]: osdmap e552: 8 total, 8 up, 8 in 2021-10-08T19:37:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:56.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:56 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:57.280 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:56 smithi196 ceph-mon[34258]: pgmap v859: 164 pgs: 164 active+clean; 582 KiB data, 444 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:57.280 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-102"}]': finished 2021-10-08T19:37:57.280 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:56 smithi196 ceph-mon[34258]: osdmap e553: 8 total, 8 up, 8 in 2021-10-08T19:37:57.281 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:57.281 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:56 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:57.281 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-102"}]': finished 2021-10-08T19:37:57.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[42114]: pgmap v859: 164 pgs: 164 active+clean; 582 KiB data, 444 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:57.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-102"}]': finished 2021-10-08T19:37:57.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[42114]: osdmap e553: 8 total, 8 up, 8 in 2021-10-08T19:37:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-102"}]': finished 2021-10-08T19:37:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[32847]: pgmap v859: 164 pgs: 164 active+clean; 582 KiB data, 444 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-102"}]': finished 2021-10-08T19:37:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[32847]: osdmap e553: 8 total, 8 up, 8 in 2021-10-08T19:37:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-102"}]: dispatch 2021-10-08T19:37:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:37:57.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2692213049' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-102"}]': finished 2021-10-08T19:37:57.617 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:37:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:37:57.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:37:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:57] "GET /metrics HTTP/1.1" 200 158758 "" "Prometheus/2.18.1" 2021-10-08T19:37:58.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:37:58.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:58.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[32847]: osdmap e554: 8 total, 8 up, 8 in 2021-10-08T19:37:58.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:37:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:37:58.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:58.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:37:58.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:58.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[42114]: osdmap e554: 8 total, 8 up, 8 in 2021-10-08T19:37:58.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:37:58.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:37:58.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:57 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:37:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:57 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:57 smithi196 ceph-mon[34258]: osdmap e554: 8 total, 8 up, 8 in 2021-10-08T19:37:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:37:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:37:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:37:59.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:37:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:37:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:59.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:59.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[32847]: pgmap v862: 164 pgs: 164 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-10-08T19:37:59.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:37:59.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[32847]: osdmap e555: 8 total, 8 up, 8 in 2021-10-08T19:37:59.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:37:59.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:59.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[42114]: pgmap v862: 164 pgs: 164 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-10-08T19:37:59.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:37:59.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[42114]: osdmap e555: 8 total, 8 up, 8 in 2021-10-08T19:37:59.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:37:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:37:59.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:59 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:59.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:59 smithi196 ceph-mon[34258]: pgmap v862: 164 pgs: 164 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-10-08T19:37:59.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi157-88568-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:37:59.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:59 smithi196 ceph-mon[34258]: osdmap e555: 8 total, 8 up, 8 in 2021-10-08T19:37:59.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:37:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:00.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:00 smithi157 ceph-mon[32847]: osdmap e556: 8 total, 8 up, 8 in 2021-10-08T19:38:00.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:00 smithi157 ceph-mon[32847]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:00.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:00.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:00 smithi157 ceph-mon[32847]: osdmap e557: 8 total, 8 up, 8 in 2021-10-08T19:38:00.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:00 smithi157 ceph-mon[42114]: osdmap e556: 8 total, 8 up, 8 in 2021-10-08T19:38:00.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:00 smithi157 ceph-mon[42114]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:00.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:00.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:00 smithi157 ceph-mon[42114]: osdmap e557: 8 total, 8 up, 8 in 2021-10-08T19:38:00.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:00 smithi196 ceph-mon[34258]: osdmap e556: 8 total, 8 up, 8 in 2021-10-08T19:38:00.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:00 smithi196 ceph-mon[34258]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:00.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi157-88568-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:00.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:00 smithi196 ceph-mon[34258]: osdmap e557: 8 total, 8 up, 8 in 2021-10-08T19:38:01.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:01 smithi157 ceph-mon[32847]: pgmap v865: 164 pgs: 164 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:01.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:01 smithi157 ceph-mon[32847]: osdmap e558: 8 total, 8 up, 8 in 2021-10-08T19:38:01.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:01.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:01 smithi157 ceph-mon[42114]: pgmap v865: 164 pgs: 164 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:01.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:01 smithi157 ceph-mon[42114]: osdmap e558: 8 total, 8 up, 8 in 2021-10-08T19:38:01.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:01.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:01 smithi196 ceph-mon[34258]: pgmap v865: 164 pgs: 164 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:01.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:01 smithi196 ceph-mon[34258]: osdmap e558: 8 total, 8 up, 8 in 2021-10-08T19:38:01.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:02 smithi157 ceph-mon[32847]: pgmap v868: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 455 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:03.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-110","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:03.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:02 smithi157 ceph-mon[32847]: osdmap e559: 8 total, 8 up, 8 in 2021-10-08T19:38:03.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:03.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:02 smithi157 ceph-mon[42114]: pgmap v868: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 455 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:03.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-110","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:03.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:02 smithi157 ceph-mon[42114]: osdmap e559: 8 total, 8 up, 8 in 2021-10-08T19:38:03.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:03.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:02 smithi196 ceph-mon[34258]: pgmap v868: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 455 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-110","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:02 smithi196 ceph-mon[34258]: osdmap e559: 8 total, 8 up, 8 in 2021-10-08T19:38:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:03.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:03.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:03.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:03.528Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:38:04.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:04.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:03 smithi157 ceph-mon[32847]: osdmap e560: 8 total, 8 up, 8 in 2021-10-08T19:38:04.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-110"}]: dispatch 2021-10-08T19:38:04.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:04.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:03 smithi157 ceph-mon[42114]: osdmap e560: 8 total, 8 up, 8 in 2021-10-08T19:38:04.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-110"}]: dispatch 2021-10-08T19:38:04.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:04.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:03 smithi196 ceph-mon[34258]: osdmap e560: 8 total, 8 up, 8 in 2021-10-08T19:38:04.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-110"}]: dispatch 2021-10-08T19:38:05.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:04 smithi157 ceph-mon[32847]: pgmap v871: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 455 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:05.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-110"}]': finished 2021-10-08T19:38:05.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:04 smithi157 ceph-mon[32847]: osdmap e561: 8 total, 8 up, 8 in 2021-10-08T19:38:05.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:05.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:04 smithi157 ceph-mon[42114]: pgmap v871: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 455 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:05.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-110"}]': finished 2021-10-08T19:38:05.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:04 smithi157 ceph-mon[42114]: osdmap e561: 8 total, 8 up, 8 in 2021-10-08T19:38:05.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:05.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:04 smithi196 ceph-mon[34258]: pgmap v871: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 455 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:05.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-110"}]': finished 2021-10-08T19:38:05.372 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:04 smithi196 ceph-mon[34258]: osdmap e561: 8 total, 8 up, 8 in 2021-10-08T19:38:05.372 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:05.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:05 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:38:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:06.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:06.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:05 smithi157 ceph-mon[32847]: osdmap e562: 8 total, 8 up, 8 in 2021-10-08T19:38:06.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:05 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110"}]: dispatch 2021-10-08T19:38:06.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:05 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:06.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:06.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:05 smithi157 ceph-mon[42114]: osdmap e562: 8 total, 8 up, 8 in 2021-10-08T19:38:06.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:05 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110"}]: dispatch 2021-10-08T19:38:06.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:05 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:06.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:05 smithi196 ceph-mon[34258]: osdmap e562: 8 total, 8 up, 8 in 2021-10-08T19:38:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:05 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110"}]: dispatch 2021-10-08T19:38:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:05 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:07.291 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:06 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:38:07.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:06 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:38:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:07.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:06 smithi196 ceph-mon[34258]: pgmap v874: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 455 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:07.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110"}]': finished 2021-10-08T19:38:07.294 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:06 smithi196 ceph-mon[34258]: osdmap e563: 8 total, 8 up, 8 in 2021-10-08T19:38:07.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:38:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:38:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[32847]: pgmap v874: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 455 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110"}]': finished 2021-10-08T19:38:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[32847]: osdmap e563: 8 total, 8 up, 8 in 2021-10-08T19:38:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:38:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:38:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[42114]: pgmap v874: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 455 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:07.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-110"}]': finished 2021-10-08T19:38:07.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:06 smithi157 ceph-mon[42114]: osdmap e563: 8 total, 8 up, 8 in 2021-10-08T19:38:07.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:38:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:38:07.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:07] "GET /metrics HTTP/1.1" 200 157667 "" "Prometheus/2.18.1" 2021-10-08T19:38:08.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:07 smithi157 ceph-mon[32847]: osdmap e564: 8 total, 8 up, 8 in 2021-10-08T19:38:08.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:07 smithi157 ceph-mon[42114]: osdmap e564: 8 total, 8 up, 8 in 2021-10-08T19:38:08.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:07 smithi196 ceph-mon[34258]: osdmap e564: 8 total, 8 up, 8 in 2021-10-08T19:38:08.971 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:38:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[32847]: pgmap v877: 172 pgs: 172 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[32847]: osdmap e565: 8 total, 8 up, 8 in 2021-10-08T19:38:09.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:09.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:09.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[42114]: pgmap v877: 172 pgs: 172 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:09.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:09.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[42114]: osdmap e565: 8 total, 8 up, 8 in 2021-10-08T19:38:09.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:09.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:08 smithi196 ceph-mon[34258]: pgmap v877: 172 pgs: 172 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:08 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:08 smithi196 ceph-mon[34258]: osdmap e565: 8 total, 8 up, 8 in 2021-10-08T19:38:09.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:10.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-112","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:10.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:09 smithi157 ceph-mon[42114]: osdmap e566: 8 total, 8 up, 8 in 2021-10-08T19:38:10.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:10.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-112","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:10.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:09 smithi157 ceph-mon[32847]: osdmap e566: 8 total, 8 up, 8 in 2021-10-08T19:38:10.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:10.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-112","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:10.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:09 smithi196 ceph-mon[34258]: osdmap e566: 8 total, 8 up, 8 in 2021-10-08T19:38:10.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:11.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:10 smithi157 ceph-mon[32847]: pgmap v880: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:11.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:11.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:10 smithi157 ceph-mon[32847]: osdmap e567: 8 total, 8 up, 8 in 2021-10-08T19:38:11.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-112"}]: dispatch 2021-10-08T19:38:11.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:10 smithi157 ceph-mon[42114]: pgmap v880: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:11.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:11.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:10 smithi157 ceph-mon[42114]: osdmap e567: 8 total, 8 up, 8 in 2021-10-08T19:38:11.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-112"}]: dispatch 2021-10-08T19:38:11.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:10 smithi196 ceph-mon[34258]: pgmap v880: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:11.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:11.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:10 smithi196 ceph-mon[34258]: osdmap e567: 8 total, 8 up, 8 in 2021-10-08T19:38:11.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-112"}]: dispatch 2021-10-08T19:38:12.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-112"}]': finished 2021-10-08T19:38:12.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:11 smithi157 ceph-mon[32847]: osdmap e568: 8 total, 8 up, 8 in 2021-10-08T19:38:12.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-112", "mode": "writeback"}]: dispatch 2021-10-08T19:38:12.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:11 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:12.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-112"}]': finished 2021-10-08T19:38:12.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:11 smithi157 ceph-mon[42114]: osdmap e568: 8 total, 8 up, 8 in 2021-10-08T19:38:12.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-112", "mode": "writeback"}]: dispatch 2021-10-08T19:38:12.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:11 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:12.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-112"}]': finished 2021-10-08T19:38:12.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:11 smithi196 ceph-mon[34258]: osdmap e568: 8 total, 8 up, 8 in 2021-10-08T19:38:12.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-112", "mode": "writeback"}]: dispatch 2021-10-08T19:38:12.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:11 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:13.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:12 smithi157 ceph-mon[32847]: pgmap v883: 204 pgs: 204 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:13.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-112", "mode": "writeback"}]': finished 2021-10-08T19:38:13.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:12 smithi157 ceph-mon[32847]: osdmap e569: 8 total, 8 up, 8 in 2021-10-08T19:38:13.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:13.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:12 smithi157 ceph-mon[42114]: pgmap v883: 204 pgs: 204 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:13.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-112", "mode": "writeback"}]': finished 2021-10-08T19:38:13.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:12 smithi157 ceph-mon[42114]: osdmap e569: 8 total, 8 up, 8 in 2021-10-08T19:38:13.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:13.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:12 smithi196 ceph-mon[34258]: pgmap v883: 204 pgs: 204 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:13.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-112", "mode": "writeback"}]': finished 2021-10-08T19:38:13.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:12 smithi196 ceph-mon[34258]: osdmap e569: 8 total, 8 up, 8 in 2021-10-08T19:38:13.372 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:13.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:13.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:13.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:13.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:13.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:13.528Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:38:14.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:14.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:14 smithi157 ceph-mon[32847]: osdmap e570: 8 total, 8 up, 8 in 2021-10-08T19:38:14.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112"}]: dispatch 2021-10-08T19:38:14.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:14 smithi157 ceph-mon[32847]: pgmap v886: 204 pgs: 204 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:14.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:14.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:14 smithi157 ceph-mon[42114]: osdmap e570: 8 total, 8 up, 8 in 2021-10-08T19:38:14.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112"}]: dispatch 2021-10-08T19:38:14.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:14 smithi157 ceph-mon[42114]: pgmap v886: 204 pgs: 204 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:14.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:14.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:14 smithi196 ceph-mon[34258]: osdmap e570: 8 total, 8 up, 8 in 2021-10-08T19:38:14.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112"}]: dispatch 2021-10-08T19:38:14.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:14 smithi196 ceph-mon[34258]: pgmap v886: 204 pgs: 204 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:15.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:15 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:15.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112"}]': finished 2021-10-08T19:38:15.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:15 smithi157 ceph-mon[32847]: osdmap e571: 8 total, 8 up, 8 in 2021-10-08T19:38:15.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:15 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:15.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112"}]': finished 2021-10-08T19:38:15.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:15 smithi157 ceph-mon[42114]: osdmap e571: 8 total, 8 up, 8 in 2021-10-08T19:38:15.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:15 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:15.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-112"}]': finished 2021-10-08T19:38:15.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:15 smithi196 ceph-mon[34258]: osdmap e571: 8 total, 8 up, 8 in 2021-10-08T19:38:16.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:16 smithi157 ceph-mon[32847]: osdmap e572: 8 total, 8 up, 8 in 2021-10-08T19:38:16.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:16 smithi157 ceph-mon[32847]: pgmap v889: 172 pgs: 172 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:16.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:16 smithi157 ceph-mon[32847]: osdmap e573: 8 total, 8 up, 8 in 2021-10-08T19:38:16.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:16.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:16 smithi157 ceph-mon[42114]: osdmap e572: 8 total, 8 up, 8 in 2021-10-08T19:38:16.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:16 smithi157 ceph-mon[42114]: pgmap v889: 172 pgs: 172 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:16.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:16 smithi157 ceph-mon[42114]: osdmap e573: 8 total, 8 up, 8 in 2021-10-08T19:38:16.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:16.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:16 smithi196 ceph-mon[34258]: osdmap e572: 8 total, 8 up, 8 in 2021-10-08T19:38:16.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:16 smithi196 ceph-mon[34258]: pgmap v889: 172 pgs: 172 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:16 smithi196 ceph-mon[34258]: osdmap e573: 8 total, 8 up, 8 in 2021-10-08T19:38:16.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:17.366 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:38:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:38:17.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:17] "GET /metrics HTTP/1.1" 200 157667 "" "Prometheus/2.18.1" 2021-10-08T19:38:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-114","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:18 smithi157 ceph-mon[32847]: osdmap e574: 8 total, 8 up, 8 in 2021-10-08T19:38:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:18 smithi157 ceph-mon[32847]: pgmap v892: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:18.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-114","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:18.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:18 smithi157 ceph-mon[42114]: osdmap e574: 8 total, 8 up, 8 in 2021-10-08T19:38:18.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:18.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:18 smithi157 ceph-mon[42114]: pgmap v892: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:18.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-114","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:18 smithi196 ceph-mon[34258]: osdmap e574: 8 total, 8 up, 8 in 2021-10-08T19:38:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:18 smithi196 ceph-mon[34258]: pgmap v892: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:18.866 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:38:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:19.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:19 smithi157 ceph-mon[32847]: osdmap e575: 8 total, 8 up, 8 in 2021-10-08T19:38:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:19.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:19 smithi157 ceph-mon[42114]: osdmap e575: 8 total, 8 up, 8 in 2021-10-08T19:38:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:19.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:19 smithi196 ceph-mon[34258]: osdmap e575: 8 total, 8 up, 8 in 2021-10-08T19:38:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:20.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:20.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:20 smithi157 ceph-mon[32847]: osdmap e576: 8 total, 8 up, 8 in 2021-10-08T19:38:20.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-114"}]: dispatch 2021-10-08T19:38:20.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:20 smithi157 ceph-mon[32847]: pgmap v895: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:20.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:20.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:20 smithi157 ceph-mon[42114]: osdmap e576: 8 total, 8 up, 8 in 2021-10-08T19:38:20.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-114"}]: dispatch 2021-10-08T19:38:20.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:20 smithi157 ceph-mon[42114]: pgmap v895: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:20.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:20 smithi196 ceph-mon[34258]: osdmap e576: 8 total, 8 up, 8 in 2021-10-08T19:38:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-114"}]: dispatch 2021-10-08T19:38:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:20 smithi196 ceph-mon[34258]: pgmap v895: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:21.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-114"}]': finished 2021-10-08T19:38:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[32847]: osdmap e577: 8 total, 8 up, 8 in 2021-10-08T19:38:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-114", "mode": "writeback"}]: dispatch 2021-10-08T19:38:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-114", "mode": "writeback"}]': finished 2021-10-08T19:38:21.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[32847]: osdmap e578: 8 total, 8 up, 8 in 2021-10-08T19:38:21.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-114"}]': finished 2021-10-08T19:38:21.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[42114]: osdmap e577: 8 total, 8 up, 8 in 2021-10-08T19:38:21.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-114", "mode": "writeback"}]: dispatch 2021-10-08T19:38:21.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:21.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-114", "mode": "writeback"}]': finished 2021-10-08T19:38:21.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:21 smithi157 ceph-mon[42114]: osdmap e578: 8 total, 8 up, 8 in 2021-10-08T19:38:21.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-114"}]': finished 2021-10-08T19:38:21.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:21 smithi196 ceph-mon[34258]: osdmap e577: 8 total, 8 up, 8 in 2021-10-08T19:38:21.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-114", "mode": "writeback"}]: dispatch 2021-10-08T19:38:21.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:21 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:21.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-114", "mode": "writeback"}]': finished 2021-10-08T19:38:21.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:21 smithi196 ceph-mon[34258]: osdmap e578: 8 total, 8 up, 8 in 2021-10-08T19:38:22.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "236.5"}]: dispatch 2021-10-08T19:38:22.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:22 smithi157 ceph-mon[32847]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "236.5"}]: dispatch 2021-10-08T19:38:22.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:22 smithi157 ceph-mon[32847]: pgmap v898: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:38:22.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "236.5"}]: dispatch 2021-10-08T19:38:22.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:22 smithi157 ceph-mon[42114]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "236.5"}]: dispatch 2021-10-08T19:38:22.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:22 smithi157 ceph-mon[42114]: pgmap v898: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:38:22.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "236.5"}]: dispatch 2021-10-08T19:38:22.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:22 smithi196 ceph-mon[34258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "236.5"}]: dispatch 2021-10-08T19:38:22.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:22 smithi196 ceph-mon[34258]: pgmap v898: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:38:23.528 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:23 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:23.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:23.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:23.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:23.528Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:38:24.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:24 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:24.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:24 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:38:24.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:24 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:24.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:24 smithi157 ceph-mon[32847]: pgmap v899: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:38:24.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:24 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:24.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:24 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:38:24.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:24 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:24.586 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:24 smithi157 ceph-mon[42114]: pgmap v899: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:38:24.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:24 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:24.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:24 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:38:24.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:24 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:24.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:24 smithi196 ceph-mon[34258]: pgmap v899: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:38:25.827 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:25 smithi157 ceph-mon[42114]: 236.5 scrub ok 2021-10-08T19:38:25.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:25 smithi157 ceph-mon[32847]: 236.5 scrub ok 2021-10-08T19:38:25.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:25 smithi196 ceph-mon[34258]: 236.5 scrub ok 2021-10-08T19:38:26.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:26 smithi196 ceph-mon[34258]: pgmap v900: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2021-10-08T19:38:27.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:26 smithi157 ceph-mon[42114]: pgmap v900: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2021-10-08T19:38:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:26 smithi157 ceph-mon[32847]: pgmap v900: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2021-10-08T19:38:27.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:38:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:38:27.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:27] "GET /metrics HTTP/1.1" 200 157704 "" "Prometheus/2.18.1" 2021-10-08T19:38:28.922 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:38:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:29.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:29.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:28 smithi157 ceph-mon[32847]: pgmap v901: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 895 B/s wr, 2 op/s 2021-10-08T19:38:29.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:29.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:28 smithi157 ceph-mon[42114]: pgmap v901: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 895 B/s wr, 2 op/s 2021-10-08T19:38:29.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:29.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:28 smithi196 ceph-mon[34258]: pgmap v901: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 895 B/s wr, 2 op/s 2021-10-08T19:38:30.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:30 smithi196 ceph-mon[34258]: pgmap v902: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 727 B/s wr, 2 op/s 2021-10-08T19:38:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:30 smithi157 ceph-mon[32847]: pgmap v902: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 727 B/s wr, 2 op/s 2021-10-08T19:38:31.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:30 smithi157 ceph-mon[42114]: pgmap v902: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 727 B/s wr, 2 op/s 2021-10-08T19:38:31.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:31 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:38:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:32 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:38:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:32 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:38:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:38:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:38:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:38:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:32 smithi196 ceph-mon[34258]: pgmap v903: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 660 B/s wr, 2 op/s 2021-10-08T19:38:32.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:32.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:38:32.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:38:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:32.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:38:32.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:38:32.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:38:32.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:32.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[32847]: pgmap v903: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 660 B/s wr, 2 op/s 2021-10-08T19:38:32.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:32.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:38:32.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:38:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:32.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:38:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:38:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:38:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:32 smithi157 ceph-mon[42114]: pgmap v903: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 660 B/s wr, 2 op/s 2021-10-08T19:38:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:33.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:33.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:33.528Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:38:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:34 smithi157 ceph-mon[32847]: pgmap v904: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:38:35.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:34 smithi157 ceph-mon[42114]: pgmap v904: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:38:35.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:34 smithi196 ceph-mon[34258]: pgmap v904: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:38:36.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:36.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:35 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:36.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:36.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:36.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:36.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:35 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:36.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:36.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:36.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:35 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:37.323 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:36 smithi196 ceph-mon[34258]: pgmap v905: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:38:37.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:36 smithi157 ceph-mon[32847]: pgmap v905: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:38:37.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:36 smithi157 ceph-mon[42114]: pgmap v905: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:38:37.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:38:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:38:37.830 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:37] "GET /metrics HTTP/1.1" 200 157730 "" "Prometheus/2.18.1" 2021-10-08T19:38:38.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:37 smithi157 ceph-mon[42114]: osdmap e579: 8 total, 8 up, 8 in 2021-10-08T19:38:38.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:38.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:37 smithi157 ceph-mon[32847]: osdmap e579: 8 total, 8 up, 8 in 2021-10-08T19:38:38.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:38.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:37 smithi196 ceph-mon[34258]: osdmap e579: 8 total, 8 up, 8 in 2021-10-08T19:38:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:38.944 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:38:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:39.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:39.463 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[42114]: pgmap v907: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:38:39.463 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:39.464 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[42114]: osdmap e580: 8 total, 8 up, 8 in 2021-10-08T19:38:39.464 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114"}]: dispatch 2021-10-08T19:38:39.465 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:39.465 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[32847]: pgmap v907: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:38:39.465 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:39.466 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[32847]: osdmap e580: 8 total, 8 up, 8 in 2021-10-08T19:38:39.466 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114"}]: dispatch 2021-10-08T19:38:39.467 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:39.467 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:38 smithi196 ceph-mon[34258]: pgmap v907: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:38:39.468 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:39.468 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:38 smithi196 ceph-mon[34258]: osdmap e580: 8 total, 8 up, 8 in 2021-10-08T19:38:39.468 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114"}]: dispatch 2021-10-08T19:38:40.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:39 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:39 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114"}]': finished 2021-10-08T19:38:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:39 smithi157 ceph-mon[32847]: osdmap e581: 8 total, 8 up, 8 in 2021-10-08T19:38:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:39 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:39 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114"}]': finished 2021-10-08T19:38:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:39 smithi157 ceph-mon[42114]: osdmap e581: 8 total, 8 up, 8 in 2021-10-08T19:38:40.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:39 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:39 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-114"}]': finished 2021-10-08T19:38:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:39 smithi196 ceph-mon[34258]: osdmap e581: 8 total, 8 up, 8 in 2021-10-08T19:38:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:40 smithi157 ceph-mon[32847]: pgmap v910: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:38:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:40 smithi157 ceph-mon[32847]: osdmap e582: 8 total, 8 up, 8 in 2021-10-08T19:38:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:40 smithi157 ceph-mon[32847]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:41.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:40 smithi157 ceph-mon[42114]: pgmap v910: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:38:41.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:40 smithi157 ceph-mon[42114]: osdmap e582: 8 total, 8 up, 8 in 2021-10-08T19:38:41.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:40 smithi157 ceph-mon[42114]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:41.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:40 smithi196 ceph-mon[34258]: pgmap v910: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:38:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:40 smithi196 ceph-mon[34258]: osdmap e582: 8 total, 8 up, 8 in 2021-10-08T19:38:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:40 smithi196 ceph-mon[34258]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:42.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:41 smithi157 ceph-mon[32847]: osdmap e583: 8 total, 8 up, 8 in 2021-10-08T19:38:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:42.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:41 smithi157 ceph-mon[42114]: osdmap e583: 8 total, 8 up, 8 in 2021-10-08T19:38:42.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:42.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:41 smithi196 ceph-mon[34258]: osdmap e583: 8 total, 8 up, 8 in 2021-10-08T19:38:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:43.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:42 smithi157 ceph-mon[32847]: pgmap v913: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 466 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-116","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:42 smithi157 ceph-mon[32847]: osdmap e584: 8 total, 8 up, 8 in 2021-10-08T19:38:43.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:42 smithi157 ceph-mon[42114]: pgmap v913: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 466 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:43.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-116","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:43.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:42 smithi157 ceph-mon[42114]: osdmap e584: 8 total, 8 up, 8 in 2021-10-08T19:38:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:42 smithi196 ceph-mon[34258]: pgmap v913: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 466 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-116","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:42 smithi196 ceph-mon[34258]: osdmap e584: 8 total, 8 up, 8 in 2021-10-08T19:38:43.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:43.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:43.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:43.529Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:38:44.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:43 smithi196 ceph-mon[34258]: osdmap e585: 8 total, 8 up, 8 in 2021-10-08T19:38:44.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:44.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:43 smithi157 ceph-mon[32847]: osdmap e585: 8 total, 8 up, 8 in 2021-10-08T19:38:44.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:44.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:43 smithi157 ceph-mon[42114]: osdmap e585: 8 total, 8 up, 8 in 2021-10-08T19:38:44.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:45.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[42114]: pgmap v916: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 466 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:45.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:45.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[42114]: osdmap e586: 8 total, 8 up, 8 in 2021-10-08T19:38:45.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-116"}]: dispatch 2021-10-08T19:38:45.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-116"}]': finished 2021-10-08T19:38:45.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[42114]: osdmap e587: 8 total, 8 up, 8 in 2021-10-08T19:38:45.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-116", "mode": "writeback"}]: dispatch 2021-10-08T19:38:45.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[32847]: pgmap v916: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 466 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:45.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:45.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[32847]: osdmap e586: 8 total, 8 up, 8 in 2021-10-08T19:38:45.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-116"}]: dispatch 2021-10-08T19:38:45.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-116"}]': finished 2021-10-08T19:38:45.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[32847]: osdmap e587: 8 total, 8 up, 8 in 2021-10-08T19:38:45.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-116", "mode": "writeback"}]: dispatch 2021-10-08T19:38:45.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:44 smithi196 ceph-mon[34258]: pgmap v916: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 466 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:45.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:45.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:44 smithi196 ceph-mon[34258]: osdmap e586: 8 total, 8 up, 8 in 2021-10-08T19:38:45.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-116"}]: dispatch 2021-10-08T19:38:45.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-116"}]': finished 2021-10-08T19:38:45.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:44 smithi196 ceph-mon[34258]: osdmap e587: 8 total, 8 up, 8 in 2021-10-08T19:38:45.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-116", "mode": "writeback"}]: dispatch 2021-10-08T19:38:46.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:45 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:46.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-116", "mode": "writeback"}]': finished 2021-10-08T19:38:46.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:45 smithi196 ceph-mon[34258]: osdmap e588: 8 total, 8 up, 8 in 2021-10-08T19:38:46.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:45 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:46.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-116", "mode": "writeback"}]': finished 2021-10-08T19:38:46.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:45 smithi157 ceph-mon[32847]: osdmap e588: 8 total, 8 up, 8 in 2021-10-08T19:38:46.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:45 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:46.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-116", "mode": "writeback"}]': finished 2021-10-08T19:38:46.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:45 smithi157 ceph-mon[42114]: osdmap e588: 8 total, 8 up, 8 in 2021-10-08T19:38:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:46 smithi157 ceph-mon[32847]: pgmap v920: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 466 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:46 smithi157 ceph-mon[32847]: osdmap e589: 8 total, 8 up, 8 in 2021-10-08T19:38:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:47.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:46 smithi157 ceph-mon[42114]: pgmap v920: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 466 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:47.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:46 smithi157 ceph-mon[42114]: osdmap e589: 8 total, 8 up, 8 in 2021-10-08T19:38:47.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:47.334 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:46 smithi196 ceph-mon[34258]: pgmap v920: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 466 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:47.335 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:46 smithi196 ceph-mon[34258]: osdmap e589: 8 total, 8 up, 8 in 2021-10-08T19:38:47.335 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:47.620 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:38:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:38:47.830 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:47] "GET /metrics HTTP/1.1" 200 157730 "" "Prometheus/2.18.1" 2021-10-08T19:38:48.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:48.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:48.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:48 smithi196 ceph-mon[34258]: osdmap e590: 8 total, 8 up, 8 in 2021-10-08T19:38:48.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116"}]: dispatch 2021-10-08T19:38:48.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:48 smithi196 ceph-mon[34258]: pgmap v923: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 525 B/s wr, 2 op/s 2021-10-08T19:38:48.868 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:38:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[32847]: osdmap e590: 8 total, 8 up, 8 in 2021-10-08T19:38:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116"}]: dispatch 2021-10-08T19:38:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[32847]: pgmap v923: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 525 B/s wr, 2 op/s 2021-10-08T19:38:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[42114]: osdmap e590: 8 total, 8 up, 8 in 2021-10-08T19:38:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116"}]: dispatch 2021-10-08T19:38:49.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:48 smithi157 ceph-mon[42114]: pgmap v923: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 525 B/s wr, 2 op/s 2021-10-08T19:38:50.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:49 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116"}]': finished 2021-10-08T19:38:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:49 smithi196 ceph-mon[34258]: osdmap e591: 8 total, 8 up, 8 in 2021-10-08T19:38:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:49 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:50.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:49 smithi196 ceph-mon[34258]: osdmap e592: 8 total, 8 up, 8 in 2021-10-08T19:38:50.330 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:49 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:38:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:50.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:50.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116"}]': finished 2021-10-08T19:38:50.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[32847]: osdmap e591: 8 total, 8 up, 8 in 2021-10-08T19:38:50.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:50.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[32847]: osdmap e592: 8 total, 8 up, 8 in 2021-10-08T19:38:50.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:50.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-116"}]': finished 2021-10-08T19:38:50.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[42114]: osdmap e591: 8 total, 8 up, 8 in 2021-10-08T19:38:50.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:50.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:49 smithi157 ceph-mon[42114]: osdmap e592: 8 total, 8 up, 8 in 2021-10-08T19:38:51.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[32847]: pgmap v926: 172 pgs: 172 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:38:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:38:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:38:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:51.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[32847]: osdmap e593: 8 total, 8 up, 8 in 2021-10-08T19:38:51.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[42114]: pgmap v926: 172 pgs: 172 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:38:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:51.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:38:51.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:38:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:51.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[42114]: osdmap e593: 8 total, 8 up, 8 in 2021-10-08T19:38:51.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:51.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:50 smithi196 ceph-mon[34258]: pgmap v926: 172 pgs: 172 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:38:51.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:50 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:51.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:50 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:38:51.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:50 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:38:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:51.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:50 smithi196 ceph-mon[34258]: osdmap e593: 8 total, 8 up, 8 in 2021-10-08T19:38:51.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-118","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:52 smithi196 ceph-mon[34258]: osdmap e594: 8 total, 8 up, 8 in 2021-10-08T19:38:52.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:52.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:52 smithi196 ceph-mon[34258]: pgmap v929: 204 pgs: 204 active+clean; 582 KiB data, 473 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:52.943 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-118","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:52.944 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:52 smithi157 ceph-mon[32847]: osdmap e594: 8 total, 8 up, 8 in 2021-10-08T19:38:52.944 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:52.944 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:52 smithi157 ceph-mon[32847]: pgmap v929: 204 pgs: 204 active+clean; 582 KiB data, 473 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:52.944 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-118","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:52.945 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:52 smithi157 ceph-mon[42114]: osdmap e594: 8 total, 8 up, 8 in 2021-10-08T19:38:52.945 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:52.945 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:52 smithi157 ceph-mon[42114]: pgmap v929: 204 pgs: 204 active+clean; 582 KiB data, 473 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:53.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:53.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:53 smithi157 ceph-mon[32847]: osdmap e595: 8 total, 8 up, 8 in 2021-10-08T19:38:53.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-118"}]: dispatch 2021-10-08T19:38:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:53 smithi157 ceph-mon[42114]: osdmap e595: 8 total, 8 up, 8 in 2021-10-08T19:38:53.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-118"}]: dispatch 2021-10-08T19:38:53.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:53.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:53.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:53.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:53.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:38:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:38:53.529Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:38:53.871 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:53.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:53 smithi196 ceph-mon[34258]: osdmap e595: 8 total, 8 up, 8 in 2021-10-08T19:38:53.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-118"}]: dispatch 2021-10-08T19:38:54.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-118"}]': finished 2021-10-08T19:38:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:54 smithi196 ceph-mon[34258]: osdmap e596: 8 total, 8 up, 8 in 2021-10-08T19:38:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-118", "mode": "writeback"}]: dispatch 2021-10-08T19:38:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:54 smithi196 ceph-mon[34258]: pgmap v932: 204 pgs: 204 active+clean; 582 KiB data, 473 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:54.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:54 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-118", "mode": "writeback"}]': finished 2021-10-08T19:38:54.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:54 smithi196 ceph-mon[34258]: osdmap e597: 8 total, 8 up, 8 in 2021-10-08T19:38:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-118"}]': finished 2021-10-08T19:38:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[32847]: osdmap e596: 8 total, 8 up, 8 in 2021-10-08T19:38:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-118", "mode": "writeback"}]: dispatch 2021-10-08T19:38:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[32847]: pgmap v932: 204 pgs: 204 active+clean; 582 KiB data, 473 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:55.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-118", "mode": "writeback"}]': finished 2021-10-08T19:38:55.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[32847]: osdmap e597: 8 total, 8 up, 8 in 2021-10-08T19:38:55.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-118"}]': finished 2021-10-08T19:38:55.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[42114]: osdmap e596: 8 total, 8 up, 8 in 2021-10-08T19:38:55.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-118", "mode": "writeback"}]: dispatch 2021-10-08T19:38:55.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[42114]: pgmap v932: 204 pgs: 204 active+clean; 582 KiB data, 473 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:55.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:55.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-118", "mode": "writeback"}]': finished 2021-10-08T19:38:55.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:54 smithi157 ceph-mon[42114]: osdmap e597: 8 total, 8 up, 8 in 2021-10-08T19:38:55.897 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:56.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:56.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:38:56.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:56.872 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:56 smithi196 ceph-mon[34258]: osdmap e598: 8 total, 8 up, 8 in 2021-10-08T19:38:56.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118"}]: dispatch 2021-10-08T19:38:56.873 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:56 smithi196 ceph-mon[34258]: pgmap v935: 204 pgs: 204 active+clean; 582 KiB data, 473 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:57.077 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:56 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:38:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:57.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:57.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:56 smithi157 ceph-mon[32847]: osdmap e598: 8 total, 8 up, 8 in 2021-10-08T19:38:57.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118"}]: dispatch 2021-10-08T19:38:57.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:56 smithi157 ceph-mon[32847]: pgmap v935: 204 pgs: 204 active+clean; 582 KiB data, 473 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:57.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:38:57.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:56 smithi157 ceph-mon[42114]: osdmap e598: 8 total, 8 up, 8 in 2021-10-08T19:38:57.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118"}]: dispatch 2021-10-08T19:38:57.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:56 smithi157 ceph-mon[42114]: pgmap v935: 204 pgs: 204 active+clean; 582 KiB data, 473 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:57.617 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:38:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:38:57.832 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:38:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:57] "GET /metrics HTTP/1.1" 200 157668 "" "Prometheus/2.18.1" 2021-10-08T19:38:58.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:57 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:58.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118"}]': finished 2021-10-08T19:38:58.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:57 smithi196 ceph-mon[34258]: osdmap e599: 8 total, 8 up, 8 in 2021-10-08T19:38:58.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:57 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:58.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:57 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:38:58.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:57 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:38:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:58.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:58.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118"}]': finished 2021-10-08T19:38:58.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[42114]: osdmap e599: 8 total, 8 up, 8 in 2021-10-08T19:38:58.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:58.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:38:58.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:38:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:58.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-118"}]': finished 2021-10-08T19:38:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[32847]: osdmap e599: 8 total, 8 up, 8 in 2021-10-08T19:38:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:38:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:38:58.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:57 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:38:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:59.119 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:38:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:38:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:59.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:59.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:58 smithi196 ceph-mon[34258]: osdmap e600: 8 total, 8 up, 8 in 2021-10-08T19:38:59.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:58 smithi196 ceph-mon[34258]: pgmap v938: 172 pgs: 172 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:59.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:58 smithi196 ceph-mon[34258]: osdmap e601: 8 total, 8 up, 8 in 2021-10-08T19:38:59.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:38:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:59.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:59.351 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[42114]: osdmap e600: 8 total, 8 up, 8 in 2021-10-08T19:38:59.352 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[42114]: pgmap v938: 172 pgs: 172 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:59.352 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[42114]: osdmap e601: 8 total, 8 up, 8 in 2021-10-08T19:38:59.352 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:59.354 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:59.354 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[32847]: osdmap e600: 8 total, 8 up, 8 in 2021-10-08T19:38:59.354 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[32847]: pgmap v938: 172 pgs: 172 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:59.354 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[32847]: osdmap e601: 8 total, 8 up, 8 in 2021-10-08T19:38:59.355 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:38:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:01.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-120","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:01.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:00 smithi157 ceph-mon[42114]: osdmap e602: 8 total, 8 up, 8 in 2021-10-08T19:39:01.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:01.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:00 smithi157 ceph-mon[42114]: pgmap v941: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:01.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-120","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:00 smithi157 ceph-mon[32847]: osdmap e602: 8 total, 8 up, 8 in 2021-10-08T19:39:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:01.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:00 smithi157 ceph-mon[32847]: pgmap v941: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:01.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-120","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:00 smithi196 ceph-mon[34258]: osdmap e602: 8 total, 8 up, 8 in 2021-10-08T19:39:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:00 smithi196 ceph-mon[34258]: pgmap v941: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:02.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:02.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:01 smithi157 ceph-mon[32847]: osdmap e603: 8 total, 8 up, 8 in 2021-10-08T19:39:02.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-120"}]: dispatch 2021-10-08T19:39:02.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:02.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:01 smithi157 ceph-mon[42114]: osdmap e603: 8 total, 8 up, 8 in 2021-10-08T19:39:02.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-120"}]: dispatch 2021-10-08T19:39:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:01 smithi196 ceph-mon[34258]: osdmap e603: 8 total, 8 up, 8 in 2021-10-08T19:39:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-120"}]: dispatch 2021-10-08T19:39:03.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-120"}]': finished 2021-10-08T19:39:03.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[32847]: osdmap e604: 8 total, 8 up, 8 in 2021-10-08T19:39:03.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-120", "mode": "writeback"}]: dispatch 2021-10-08T19:39:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[32847]: pgmap v944: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-120", "mode": "writeback"}]': finished 2021-10-08T19:39:03.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-120"}]': finished 2021-10-08T19:39:03.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[42114]: osdmap e604: 8 total, 8 up, 8 in 2021-10-08T19:39:03.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-120", "mode": "writeback"}]: dispatch 2021-10-08T19:39:03.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[42114]: pgmap v944: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:03.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:03.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-120", "mode": "writeback"}]': finished 2021-10-08T19:39:03.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-120"}]': finished 2021-10-08T19:39:03.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:02 smithi196 ceph-mon[34258]: osdmap e604: 8 total, 8 up, 8 in 2021-10-08T19:39:03.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-120", "mode": "writeback"}]: dispatch 2021-10-08T19:39:03.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:02 smithi196 ceph-mon[34258]: pgmap v944: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:03.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:02 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:03.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-120", "mode": "writeback"}]': finished 2021-10-08T19:39:03.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:03 smithi157 ceph-mon[32847]: osdmap e605: 8 total, 8 up, 8 in 2021-10-08T19:39:03.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:03.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:03 smithi157 ceph-mon[42114]: osdmap e605: 8 total, 8 up, 8 in 2021-10-08T19:39:03.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:03.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:03.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:03.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:03.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:03.836 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:03.529Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:39:04.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:03 smithi196 ceph-mon[34258]: osdmap e605: 8 total, 8 up, 8 in 2021-10-08T19:39:04.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:05.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:05.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[42114]: osdmap e606: 8 total, 8 up, 8 in 2021-10-08T19:39:05.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120"}]: dispatch 2021-10-08T19:39:05.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[42114]: pgmap v947: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:05.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:05.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120"}]': finished 2021-10-08T19:39:05.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[42114]: osdmap e607: 8 total, 8 up, 8 in 2021-10-08T19:39:05.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:05.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[32847]: osdmap e606: 8 total, 8 up, 8 in 2021-10-08T19:39:05.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120"}]: dispatch 2021-10-08T19:39:05.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[32847]: pgmap v947: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:05.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:05.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120"}]': finished 2021-10-08T19:39:05.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:04 smithi157 ceph-mon[32847]: osdmap e607: 8 total, 8 up, 8 in 2021-10-08T19:39:05.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:05.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:04 smithi196 ceph-mon[34258]: osdmap e606: 8 total, 8 up, 8 in 2021-10-08T19:39:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120"}]: dispatch 2021-10-08T19:39:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:04 smithi196 ceph-mon[34258]: pgmap v947: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:04 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:04 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-120"}]': finished 2021-10-08T19:39:05.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:04 smithi196 ceph-mon[34258]: osdmap e607: 8 total, 8 up, 8 in 2021-10-08T19:39:07.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:06 smithi157 ceph-mon[32847]: osdmap e608: 8 total, 8 up, 8 in 2021-10-08T19:39:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:06 smithi157 ceph-mon[32847]: pgmap v950: 172 pgs: 172 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:07.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:06 smithi157 ceph-mon[42114]: osdmap e608: 8 total, 8 up, 8 in 2021-10-08T19:39:07.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:06 smithi157 ceph-mon[42114]: pgmap v950: 172 pgs: 172 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:07.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:06 smithi196 ceph-mon[34258]: osdmap e608: 8 total, 8 up, 8 in 2021-10-08T19:39:07.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:06 smithi196 ceph-mon[34258]: pgmap v950: 172 pgs: 172 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:07.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:39:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:39:07.827 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:07 smithi157 ceph-mon[42114]: osdmap e609: 8 total, 8 up, 8 in 2021-10-08T19:39:07.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:07.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:07 smithi157 ceph-mon[32847]: osdmap e609: 8 total, 8 up, 8 in 2021-10-08T19:39:07.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:07.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:07] "GET /metrics HTTP/1.1" 200 156588 "" "Prometheus/2.18.1" 2021-10-08T19:39:08.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:07 smithi196 ceph-mon[34258]: osdmap e609: 8 total, 8 up, 8 in 2021-10-08T19:39:08.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-122","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:08 smithi157 ceph-mon[32847]: osdmap e610: 8 total, 8 up, 8 in 2021-10-08T19:39:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:08 smithi157 ceph-mon[32847]: pgmap v953: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:09.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:09.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-122","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:09.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:08 smithi157 ceph-mon[42114]: osdmap e610: 8 total, 8 up, 8 in 2021-10-08T19:39:09.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:08 smithi157 ceph-mon[42114]: pgmap v953: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:09.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:39:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:09.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:09.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-122","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:08 smithi196 ceph-mon[34258]: osdmap e610: 8 total, 8 up, 8 in 2021-10-08T19:39:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:08 smithi196 ceph-mon[34258]: pgmap v953: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:10.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:09 smithi157 ceph-mon[32847]: osdmap e611: 8 total, 8 up, 8 in 2021-10-08T19:39:10.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:10.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:09 smithi157 ceph-mon[42114]: osdmap e611: 8 total, 8 up, 8 in 2021-10-08T19:39:10.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:09 smithi196 ceph-mon[34258]: osdmap e611: 8 total, 8 up, 8 in 2021-10-08T19:39:10.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:10.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:10.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:10 smithi196 ceph-mon[34258]: osdmap e612: 8 total, 8 up, 8 in 2021-10-08T19:39:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-122"}]: dispatch 2021-10-08T19:39:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:10 smithi196 ceph-mon[34258]: pgmap v956: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-122"}]': finished 2021-10-08T19:39:10.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:10 smithi196 ceph-mon[34258]: osdmap e613: 8 total, 8 up, 8 in 2021-10-08T19:39:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[32847]: osdmap e612: 8 total, 8 up, 8 in 2021-10-08T19:39:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-122"}]: dispatch 2021-10-08T19:39:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[32847]: pgmap v956: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-122"}]': finished 2021-10-08T19:39:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[32847]: osdmap e613: 8 total, 8 up, 8 in 2021-10-08T19:39:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[42114]: osdmap e612: 8 total, 8 up, 8 in 2021-10-08T19:39:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-122"}]: dispatch 2021-10-08T19:39:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[42114]: pgmap v956: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-122"}]': finished 2021-10-08T19:39:11.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:10 smithi157 ceph-mon[42114]: osdmap e613: 8 total, 8 up, 8 in 2021-10-08T19:39:12.069 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-122", "mode": "writeback"}]: dispatch 2021-10-08T19:39:12.070 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:11 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:12.070 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-122", "mode": "writeback"}]': finished 2021-10-08T19:39:12.071 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:11 smithi196 ceph-mon[34258]: osdmap e614: 8 total, 8 up, 8 in 2021-10-08T19:39:12.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-122", "mode": "writeback"}]: dispatch 2021-10-08T19:39:12.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:11 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:12.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-122", "mode": "writeback"}]': finished 2021-10-08T19:39:12.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:11 smithi157 ceph-mon[42114]: osdmap e614: 8 total, 8 up, 8 in 2021-10-08T19:39:12.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-122", "mode": "writeback"}]: dispatch 2021-10-08T19:39:12.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:11 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:12.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-122", "mode": "writeback"}]': finished 2021-10-08T19:39:12.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:11 smithi157 ceph-mon[32847]: osdmap e614: 8 total, 8 up, 8 in 2021-10-08T19:39:13.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:12 smithi157 ceph-mon[42114]: pgmap v959: 204 pgs: 204 active+clean; 582 KiB data, 479 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2021-10-08T19:39:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:12 smithi157 ceph-mon[32847]: pgmap v959: 204 pgs: 204 active+clean; 582 KiB data, 479 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2021-10-08T19:39:13.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:12 smithi196 ceph-mon[34258]: pgmap v959: 204 pgs: 204 active+clean; 582 KiB data, 479 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2021-10-08T19:39:13.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:13 smithi157 ceph-mon[42114]: osdmap e615: 8 total, 8 up, 8 in 2021-10-08T19:39:13.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:13 smithi157 ceph-mon[32847]: osdmap e615: 8 total, 8 up, 8 in 2021-10-08T19:39:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:13.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:13.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:13.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:13.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:13.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:13.530Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:39:14.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:13 smithi196 ceph-mon[34258]: osdmap e615: 8 total, 8 up, 8 in 2021-10-08T19:39:14.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[42114]: osdmap e616: 8 total, 8 up, 8 in 2021-10-08T19:39:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122"}]: dispatch 2021-10-08T19:39:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[42114]: pgmap v962: 204 pgs: 204 active+clean; 582 KiB data, 479 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2021-10-08T19:39:15.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:15.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122"}]': finished 2021-10-08T19:39:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[32847]: osdmap e616: 8 total, 8 up, 8 in 2021-10-08T19:39:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122"}]: dispatch 2021-10-08T19:39:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[32847]: pgmap v962: 204 pgs: 204 active+clean; 582 KiB data, 479 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2021-10-08T19:39:15.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:15.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122"}]': finished 2021-10-08T19:39:15.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:14 smithi196 ceph-mon[34258]: osdmap e616: 8 total, 8 up, 8 in 2021-10-08T19:39:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122"}]: dispatch 2021-10-08T19:39:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:14 smithi196 ceph-mon[34258]: pgmap v962: 204 pgs: 204 active+clean; 582 KiB data, 479 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2021-10-08T19:39:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:14 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-122"}]': finished 2021-10-08T19:39:16.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:15 smithi157 ceph-mon[32847]: osdmap e617: 8 total, 8 up, 8 in 2021-10-08T19:39:16.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:15 smithi157 ceph-mon[42114]: osdmap e617: 8 total, 8 up, 8 in 2021-10-08T19:39:16.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:15 smithi196 ceph-mon[34258]: osdmap e617: 8 total, 8 up, 8 in 2021-10-08T19:39:17.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:16 smithi157 ceph-mon[32847]: osdmap e618: 8 total, 8 up, 8 in 2021-10-08T19:39:17.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:16 smithi157 ceph-mon[32847]: pgmap v965: 172 pgs: 172 active+clean; 582 KiB data, 479 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:17.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:16 smithi157 ceph-mon[42114]: osdmap e618: 8 total, 8 up, 8 in 2021-10-08T19:39:17.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:16 smithi157 ceph-mon[42114]: pgmap v965: 172 pgs: 172 active+clean; 582 KiB data, 479 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:17.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:16 smithi196 ceph-mon[34258]: osdmap e618: 8 total, 8 up, 8 in 2021-10-08T19:39:17.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:16 smithi196 ceph-mon[34258]: pgmap v965: 172 pgs: 172 active+clean; 582 KiB data, 479 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:17.385 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:17 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:39:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:17.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:39:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:39:17.726 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:17] "GET /metrics HTTP/1.1" 200 156588 "" "Prometheus/2.18.1" 2021-10-08T19:39:18.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:17 smithi157 ceph-mon[42114]: osdmap e619: 8 total, 8 up, 8 in 2021-10-08T19:39:18.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:18.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:17 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:18.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:17 smithi157 ceph-mon[32847]: osdmap e619: 8 total, 8 up, 8 in 2021-10-08T19:39:18.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:18.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:17 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:18.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:17 smithi196 ceph-mon[34258]: osdmap e619: 8 total, 8 up, 8 in 2021-10-08T19:39:18.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:18.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:17 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:39:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:39:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-124","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[32847]: osdmap e620: 8 total, 8 up, 8 in 2021-10-08T19:39:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[32847]: pgmap v968: 204 pgs: 4 creating+peering, 28 unknown, 172 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:19.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:39:19.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:39:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:19.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:19.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-124","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:19.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[42114]: osdmap e620: 8 total, 8 up, 8 in 2021-10-08T19:39:19.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:19.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:18 smithi157 ceph-mon[42114]: pgmap v968: 204 pgs: 4 creating+peering, 28 unknown, 172 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:19.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:39:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:18 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:39:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:18 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:39:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:19.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-124","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:18 smithi196 ceph-mon[34258]: osdmap e620: 8 total, 8 up, 8 in 2021-10-08T19:39:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:19.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:18 smithi196 ceph-mon[34258]: pgmap v968: 204 pgs: 4 creating+peering, 28 unknown, 172 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:20.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:20.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[42114]: osdmap e621: 8 total, 8 up, 8 in 2021-10-08T19:39:20.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-124"}]: dispatch 2021-10-08T19:39:20.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-124"}]': finished 2021-10-08T19:39:20.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[42114]: osdmap e622: 8 total, 8 up, 8 in 2021-10-08T19:39:20.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-124", "mode": "writeback"}]: dispatch 2021-10-08T19:39:20.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:20.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[32847]: osdmap e621: 8 total, 8 up, 8 in 2021-10-08T19:39:20.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-124"}]: dispatch 2021-10-08T19:39:20.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-124"}]': finished 2021-10-08T19:39:20.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[32847]: osdmap e622: 8 total, 8 up, 8 in 2021-10-08T19:39:20.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-124", "mode": "writeback"}]: dispatch 2021-10-08T19:39:20.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:20.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:19 smithi196 ceph-mon[34258]: osdmap e621: 8 total, 8 up, 8 in 2021-10-08T19:39:20.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-124"}]: dispatch 2021-10-08T19:39:20.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-124"}]': finished 2021-10-08T19:39:20.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:19 smithi196 ceph-mon[34258]: osdmap e622: 8 total, 8 up, 8 in 2021-10-08T19:39:20.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-124", "mode": "writeback"}]: dispatch 2021-10-08T19:39:21.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[42114]: pgmap v971: 204 pgs: 4 creating+peering, 28 unknown, 172 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:21.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:21.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-124", "mode": "writeback"}]': finished 2021-10-08T19:39:21.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[42114]: osdmap e623: 8 total, 8 up, 8 in 2021-10-08T19:39:21.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:21.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[32847]: pgmap v971: 204 pgs: 4 creating+peering, 28 unknown, 172 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:21.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:21.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-124", "mode": "writeback"}]': finished 2021-10-08T19:39:21.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[32847]: osdmap e623: 8 total, 8 up, 8 in 2021-10-08T19:39:21.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:21.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:20 smithi196 ceph-mon[34258]: pgmap v971: 204 pgs: 4 creating+peering, 28 unknown, 172 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:20 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-124", "mode": "writeback"}]': finished 2021-10-08T19:39:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:20 smithi196 ceph-mon[34258]: osdmap e623: 8 total, 8 up, 8 in 2021-10-08T19:39:21.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:22.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:22 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:39:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:22.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:22.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[32847]: osdmap e624: 8 total, 8 up, 8 in 2021-10-08T19:39:22.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124"}]: dispatch 2021-10-08T19:39:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[32847]: pgmap v974: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:39:22.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:22.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:22.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[42114]: osdmap e624: 8 total, 8 up, 8 in 2021-10-08T19:39:22.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124"}]: dispatch 2021-10-08T19:39:22.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[42114]: pgmap v974: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:39:22.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:22 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:22.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:22 smithi196 ceph-mon[34258]: osdmap e624: 8 total, 8 up, 8 in 2021-10-08T19:39:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124"}]: dispatch 2021-10-08T19:39:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:22 smithi196 ceph-mon[34258]: pgmap v974: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:39:22.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:22 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:23.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:23.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:23.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:23.530Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:39:24.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:23 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:39:24.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:23 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:39:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:24.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:23 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:24.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124"}]': finished 2021-10-08T19:39:24.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:23 smithi196 ceph-mon[34258]: osdmap e625: 8 total, 8 up, 8 in 2021-10-08T19:39:24.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:39:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:39:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124"}]': finished 2021-10-08T19:39:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[32847]: osdmap e625: 8 total, 8 up, 8 in 2021-10-08T19:39:24.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:39:24.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:39:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:24.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:24.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-124"}]': finished 2021-10-08T19:39:24.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:23 smithi157 ceph-mon[42114]: osdmap e625: 8 total, 8 up, 8 in 2021-10-08T19:39:25.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:24 smithi196 ceph-mon[34258]: osdmap e626: 8 total, 8 up, 8 in 2021-10-08T19:39:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:24 smithi196 ceph-mon[34258]: pgmap v977: 172 pgs: 172 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:24 smithi196 ceph-mon[34258]: osdmap e627: 8 total, 8 up, 8 in 2021-10-08T19:39:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:25.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:24 smithi157 ceph-mon[42114]: osdmap e626: 8 total, 8 up, 8 in 2021-10-08T19:39:25.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:24 smithi157 ceph-mon[42114]: pgmap v977: 172 pgs: 172 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:25.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:24 smithi157 ceph-mon[42114]: osdmap e627: 8 total, 8 up, 8 in 2021-10-08T19:39:25.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:25.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:24 smithi157 ceph-mon[32847]: osdmap e626: 8 total, 8 up, 8 in 2021-10-08T19:39:25.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:24 smithi157 ceph-mon[32847]: pgmap v977: 172 pgs: 172 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:25.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:24 smithi157 ceph-mon[32847]: osdmap e627: 8 total, 8 up, 8 in 2021-10-08T19:39:25.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:26.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-126","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:26.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:26 smithi196 ceph-mon[34258]: osdmap e628: 8 total, 8 up, 8 in 2021-10-08T19:39:26.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:26.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:26 smithi196 ceph-mon[34258]: pgmap v980: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:27.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-126","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:26 smithi157 ceph-mon[32847]: osdmap e628: 8 total, 8 up, 8 in 2021-10-08T19:39:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:26 smithi157 ceph-mon[32847]: pgmap v980: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:27.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-126","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:27.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:26 smithi157 ceph-mon[42114]: osdmap e628: 8 total, 8 up, 8 in 2021-10-08T19:39:27.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:27.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:26 smithi157 ceph-mon[42114]: pgmap v980: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:27.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:27 smithi157 ceph-mon[32847]: osdmap e629: 8 total, 8 up, 8 in 2021-10-08T19:39:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-126"}]: dispatch 2021-10-08T19:39:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:27] "GET /metrics HTTP/1.1" 200 157743 "" "Prometheus/2.18.1" 2021-10-08T19:39:27.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:27.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:27 smithi157 ceph-mon[42114]: osdmap e629: 8 total, 8 up, 8 in 2021-10-08T19:39:27.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-126"}]: dispatch 2021-10-08T19:39:27.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:27.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:27 smithi196 ceph-mon[34258]: osdmap e629: 8 total, 8 up, 8 in 2021-10-08T19:39:27.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-126"}]: dispatch 2021-10-08T19:39:27.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:39:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:39:29.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:29.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-126"}]': finished 2021-10-08T19:39:29.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[32847]: osdmap e630: 8 total, 8 up, 8 in 2021-10-08T19:39:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-126", "mode": "writeback"}]: dispatch 2021-10-08T19:39:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[32847]: pgmap v983: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-126", "mode": "writeback"}]': finished 2021-10-08T19:39:29.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[32847]: osdmap e631: 8 total, 8 up, 8 in 2021-10-08T19:39:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-126"}]': finished 2021-10-08T19:39:29.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[42114]: osdmap e630: 8 total, 8 up, 8 in 2021-10-08T19:39:29.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-126", "mode": "writeback"}]: dispatch 2021-10-08T19:39:29.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[42114]: pgmap v983: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:29.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:29.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-126", "mode": "writeback"}]': finished 2021-10-08T19:39:29.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:28 smithi157 ceph-mon[42114]: osdmap e631: 8 total, 8 up, 8 in 2021-10-08T19:39:29.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:39:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-126"}]': finished 2021-10-08T19:39:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:28 smithi196 ceph-mon[34258]: osdmap e630: 8 total, 8 up, 8 in 2021-10-08T19:39:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-126", "mode": "writeback"}]: dispatch 2021-10-08T19:39:29.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:28 smithi196 ceph-mon[34258]: pgmap v983: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:29.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:28 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:29.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-126", "mode": "writeback"}]': finished 2021-10-08T19:39:29.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:28 smithi196 ceph-mon[34258]: osdmap e631: 8 total, 8 up, 8 in 2021-10-08T19:39:30.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:30 smithi196 ceph-mon[34258]: pgmap v985: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:31.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:30 smithi157 ceph-mon[32847]: pgmap v985: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:31.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:30 smithi157 ceph-mon[42114]: pgmap v985: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:31.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:39:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:39:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:39:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:39:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:39:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:39:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:32.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:39:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:39:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:39:32.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:32.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:32 smithi196 ceph-mon[34258]: pgmap v986: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 2 op/s 2021-10-08T19:39:33.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:32 smithi157 ceph-mon[32847]: pgmap v986: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 2 op/s 2021-10-08T19:39:33.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:32 smithi157 ceph-mon[42114]: pgmap v986: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 2 op/s 2021-10-08T19:39:33.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:33 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:33.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:33 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:33.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:33.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:33.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:33.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:33.530Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:39:34.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:33 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[32847]: osdmap e632: 8 total, 8 up, 8 in 2021-10-08T19:39:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126"}]: dispatch 2021-10-08T19:39:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[32847]: pgmap v988: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 326 B/s wr, 1 op/s 2021-10-08T19:39:35.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[42114]: osdmap e632: 8 total, 8 up, 8 in 2021-10-08T19:39:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126"}]: dispatch 2021-10-08T19:39:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[42114]: pgmap v988: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 326 B/s wr, 1 op/s 2021-10-08T19:39:35.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:34 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:34 smithi196 ceph-mon[34258]: osdmap e632: 8 total, 8 up, 8 in 2021-10-08T19:39:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:34 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126"}]: dispatch 2021-10-08T19:39:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:34 smithi196 ceph-mon[34258]: pgmap v988: 204 pgs: 204 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 326 B/s wr, 1 op/s 2021-10-08T19:39:35.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:34 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:35.771 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2021-10-08T19:39:35.772 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:39:35.772 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9028 ms) 2021-10-08T19:39:35.772 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2021-10-08T19:39:35.773 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:39:35.773 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6042 ms) 2021-10-08T19:39:35.773 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2021-10-08T19:39:35.773 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:39:35.774 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5038 ms) 2021-10-08T19:39:35.774 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2021-10-08T19:39:35.775 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:39:35.775 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25375 ms) 2021-10-08T19:39:35.775 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2021-10-08T19:39:35.775 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:39:35.776 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (13997 ms) 2021-10-08T19:39:35.776 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2021-10-08T19:39:35.777 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12080 ms) 2021-10-08T19:39:35.777 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2021-10-08T19:39:35.777 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2021-10-08T19:39:35.778 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: 00000010 69 73 |is| 2021-10-08T19:39:35.778 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: 00000012 2021-10-08T19:39:35.779 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12080 ms) 2021-10-08T19:39:35.779 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] 47 tests from LibRadosTwoPoolsPP (548306 ms total) 2021-10-08T19:39:35.780 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: 2021-10-08T19:39:35.780 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2021-10-08T19:39:35.780 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2021-10-08T19:39:35.781 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1133 ms) 2021-10-08T19:39:35.781 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2021-10-08T19:39:35.781 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (10936 ms) 2021-10-08T19:39:35.782 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2021-10-08T19:39:35.782 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18101 ms) 2021-10-08T19:39:35.783 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2021-10-08T19:39:35.783 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (2 ms) 2021-10-08T19:39:35.783 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30172 ms total) 2021-10-08T19:39:35.784 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: 2021-10-08T19:39:35.784 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2021-10-08T19:39:35.784 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2021-10-08T19:39:35.784 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7034 ms) 2021-10-08T19:39:35.785 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2021-10-08T19:39:35.785 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8040 ms) 2021-10-08T19:39:35.785 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2021-10-08T19:39:35.785 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: waiting for scrub... 2021-10-08T19:39:35.786 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: done waiting 2021-10-08T19:39:35.786 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24943 ms) 2021-10-08T19:39:35.786 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2021-10-08T19:39:35.786 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9628 ms) 2021-10-08T19:39:35.786 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2021-10-08T19:39:35.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8035 ms) 2021-10-08T19:39:35.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2021-10-08T19:39:35.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8040 ms) 2021-10-08T19:39:35.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2021-10-08T19:39:35.787 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10065 ms) 2021-10-08T19:39:35.788 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2021-10-08T19:39:35.788 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7878 ms) 2021-10-08T19:39:35.788 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2021-10-08T19:39:35.788 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (12170 ms) 2021-10-08T19:39:36.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126"}]': finished 2021-10-08T19:39:36.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:35 smithi157 ceph-mon[32847]: osdmap e633: 8 total, 8 up, 8 in 2021-10-08T19:39:36.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126"}]': finished 2021-10-08T19:39:36.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:35 smithi157 ceph-mon[42114]: osdmap e633: 8 total, 8 up, 8 in 2021-10-08T19:39:36.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-126"}]': finished 2021-10-08T19:39:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:35 smithi196 ceph-mon[34258]: osdmap e633: 8 total, 8 up, 8 in 2021-10-08T19:39:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[32847]: osdmap e634: 8 total, 8 up, 8 in 2021-10-08T19:39:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[32847]: pgmap v991: 172 pgs: 172 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:39:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:37.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[42114]: osdmap e634: 8 total, 8 up, 8 in 2021-10-08T19:39:37.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:37.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:37.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[42114]: pgmap v991: 172 pgs: 172 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:39:37.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:37.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:37.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:36 smithi196 ceph-mon[34258]: osdmap e634: 8 total, 8 up, 8 in 2021-10-08T19:39:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:36 smithi196 ceph-mon[34258]: pgmap v991: 172 pgs: 172 active+clean; 582 KiB data, 476 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:39:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:37.786 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:39:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:39:37.786 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:37] "GET /metrics HTTP/1.1" 200 157736 "" "Prometheus/2.18.1" 2021-10-08T19:39:37.787 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:37 smithi157 ceph-mon[32847]: osdmap e635: 8 total, 8 up, 8 in 2021-10-08T19:39:37.787 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:38.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:37 smithi157 ceph-mon[42114]: osdmap e635: 8 total, 8 up, 8 in 2021-10-08T19:39:38.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:38.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:37 smithi196 ceph-mon[34258]: osdmap e635: 8 total, 8 up, 8 in 2021-10-08T19:39:38.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:39.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:39.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-128","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:39.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[42114]: osdmap e636: 8 total, 8 up, 8 in 2021-10-08T19:39:39.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[42114]: pgmap v994: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:39:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[42114]: osdmap e637: 8 total, 8 up, 8 in 2021-10-08T19:39:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-128"}]: dispatch 2021-10-08T19:39:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-128","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[32847]: osdmap e636: 8 total, 8 up, 8 in 2021-10-08T19:39:39.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[32847]: pgmap v994: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:39:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[32847]: osdmap e637: 8 total, 8 up, 8 in 2021-10-08T19:39:39.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:38 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-128"}]: dispatch 2021-10-08T19:39:39.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:39:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-128","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:38 smithi196 ceph-mon[34258]: osdmap e636: 8 total, 8 up, 8 in 2021-10-08T19:39:39.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:38 smithi196 ceph-mon[34258]: pgmap v994: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:39:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:38 smithi196 ceph-mon[34258]: osdmap e637: 8 total, 8 up, 8 in 2021-10-08T19:39:39.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:38 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-128"}]: dispatch 2021-10-08T19:39:41.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-128"}]': finished 2021-10-08T19:39:41.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:40 smithi157 ceph-mon[32847]: osdmap e638: 8 total, 8 up, 8 in 2021-10-08T19:39:41.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-128", "mode": "writeback"}]: dispatch 2021-10-08T19:39:41.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:40 smithi157 ceph-mon[32847]: pgmap v997: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:41.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-128"}]': finished 2021-10-08T19:39:41.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:40 smithi157 ceph-mon[42114]: osdmap e638: 8 total, 8 up, 8 in 2021-10-08T19:39:41.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-128", "mode": "writeback"}]: dispatch 2021-10-08T19:39:41.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:40 smithi157 ceph-mon[42114]: pgmap v997: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:41.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-128"}]': finished 2021-10-08T19:39:41.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:40 smithi196 ceph-mon[34258]: osdmap e638: 8 total, 8 up, 8 in 2021-10-08T19:39:41.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-128", "mode": "writeback"}]: dispatch 2021-10-08T19:39:41.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:40 smithi196 ceph-mon[34258]: pgmap v997: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 477 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:42.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:41 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:42.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-128", "mode": "writeback"}]': finished 2021-10-08T19:39:42.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:41 smithi157 ceph-mon[32847]: osdmap e639: 8 total, 8 up, 8 in 2021-10-08T19:39:42.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:42.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:41 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:42.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-128", "mode": "writeback"}]': finished 2021-10-08T19:39:42.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:41 smithi157 ceph-mon[42114]: osdmap e639: 8 total, 8 up, 8 in 2021-10-08T19:39:42.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:42.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:41 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-128", "mode": "writeback"}]': finished 2021-10-08T19:39:42.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:41 smithi196 ceph-mon[34258]: osdmap e639: 8 total, 8 up, 8 in 2021-10-08T19:39:42.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:43.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[32847]: osdmap e640: 8 total, 8 up, 8 in 2021-10-08T19:39:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128"}]: dispatch 2021-10-08T19:39:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[32847]: pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2021-10-08T19:39:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128"}]': finished 2021-10-08T19:39:43.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[32847]: osdmap e641: 8 total, 8 up, 8 in 2021-10-08T19:39:43.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[42114]: osdmap e640: 8 total, 8 up, 8 in 2021-10-08T19:39:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128"}]: dispatch 2021-10-08T19:39:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[42114]: pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2021-10-08T19:39:43.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:43.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128"}]': finished 2021-10-08T19:39:43.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:42 smithi157 ceph-mon[42114]: osdmap e641: 8 total, 8 up, 8 in 2021-10-08T19:39:43.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:42 smithi196 ceph-mon[34258]: osdmap e640: 8 total, 8 up, 8 in 2021-10-08T19:39:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128"}]: dispatch 2021-10-08T19:39:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:42 smithi196 ceph-mon[34258]: pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2021-10-08T19:39:43.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:42 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:43.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-128"}]': finished 2021-10-08T19:39:43.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:42 smithi196 ceph-mon[34258]: osdmap e641: 8 total, 8 up, 8 in 2021-10-08T19:39:43.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:43.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:43.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:43.530Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:39:44.577 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:44 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:39:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:45.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:44 smithi157 ceph-mon[32847]: osdmap e642: 8 total, 8 up, 8 in 2021-10-08T19:39:45.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:44 smithi157 ceph-mon[32847]: pgmap v1003: 172 pgs: 172 active+clean; 582 KiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:45.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:44 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:45.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:44 smithi157 ceph-mon[42114]: osdmap e642: 8 total, 8 up, 8 in 2021-10-08T19:39:45.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:44 smithi157 ceph-mon[42114]: pgmap v1003: 172 pgs: 172 active+clean; 582 KiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:45.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:44 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:45.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:44 smithi196 ceph-mon[34258]: osdmap e642: 8 total, 8 up, 8 in 2021-10-08T19:39:45.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:44 smithi196 ceph-mon[34258]: pgmap v1003: 172 pgs: 172 active+clean; 582 KiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:45.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:44 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:46.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:45 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:39:46.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:45 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:39:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:46.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:45 smithi157 ceph-mon[32847]: osdmap e643: 8 total, 8 up, 8 in 2021-10-08T19:39:46.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:46.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:45 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:39:46.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:45 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:39:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:46.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:45 smithi157 ceph-mon[42114]: osdmap e643: 8 total, 8 up, 8 in 2021-10-08T19:39:46.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:46.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:45 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:39:46.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:45 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:39:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:46.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:45 smithi196 ceph-mon[34258]: osdmap e643: 8 total, 8 up, 8 in 2021-10-08T19:39:46.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:47.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-130","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:46 smithi157 ceph-mon[32847]: osdmap e644: 8 total, 8 up, 8 in 2021-10-08T19:39:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:46 smithi157 ceph-mon[32847]: pgmap v1006: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 483 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-130","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:46 smithi157 ceph-mon[42114]: osdmap e644: 8 total, 8 up, 8 in 2021-10-08T19:39:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:47.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:46 smithi157 ceph-mon[42114]: pgmap v1006: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 483 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:47.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-130","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:47.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:46 smithi196 ceph-mon[34258]: osdmap e644: 8 total, 8 up, 8 in 2021-10-08T19:39:47.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:47.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:46 smithi196 ceph-mon[34258]: pgmap v1006: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 483 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:47.819 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:47] "GET /metrics HTTP/1.1" 200 157736 "" "Prometheus/2.18.1" 2021-10-08T19:39:47.819 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:47.820 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:47 smithi157 ceph-mon[42114]: osdmap e645: 8 total, 8 up, 8 in 2021-10-08T19:39:47.820 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]: dispatch 2021-10-08T19:39:47.820 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:39:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:39:48.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:48.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:47 smithi157 ceph-mon[32847]: osdmap e645: 8 total, 8 up, 8 in 2021-10-08T19:39:48.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]: dispatch 2021-10-08T19:39:48.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:47 smithi196 ceph-mon[34258]: osdmap e645: 8 total, 8 up, 8 in 2021-10-08T19:39:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]: dispatch 2021-10-08T19:39:48.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:48 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:39:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:49.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]': finished 2021-10-08T19:39:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[32847]: osdmap e646: 8 total, 8 up, 8 in 2021-10-08T19:39:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-130", "mode": "writeback"}]: dispatch 2021-10-08T19:39:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[32847]: pgmap v1009: 204 pgs: 204 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]': finished 2021-10-08T19:39:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[42114]: osdmap e646: 8 total, 8 up, 8 in 2021-10-08T19:39:49.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-130", "mode": "writeback"}]: dispatch 2021-10-08T19:39:49.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[42114]: pgmap v1009: 204 pgs: 204 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:49.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:49.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:48 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:49.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:39:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]': finished 2021-10-08T19:39:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:48 smithi196 ceph-mon[34258]: osdmap e646: 8 total, 8 up, 8 in 2021-10-08T19:39:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-130", "mode": "writeback"}]: dispatch 2021-10-08T19:39:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:48 smithi196 ceph-mon[34258]: pgmap v1009: 204 pgs: 204 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:48 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:39:49.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:48 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:50.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:49 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:39:50.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:49 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:39:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:50.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-130", "mode": "writeback"}]': finished 2021-10-08T19:39:50.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:49 smithi196 ceph-mon[34258]: osdmap e647: 8 total, 8 up, 8 in 2021-10-08T19:39:50.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:49 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:39:50.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:49 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:39:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:50.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-130", "mode": "writeback"}]': finished 2021-10-08T19:39:50.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:49 smithi157 ceph-mon[42114]: osdmap e647: 8 total, 8 up, 8 in 2021-10-08T19:39:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:49 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:39:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:49 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:39:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-130", "mode": "writeback"}]': finished 2021-10-08T19:39:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:49 smithi157 ceph-mon[32847]: osdmap e647: 8 total, 8 up, 8 in 2021-10-08T19:39:51.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:50 smithi196 ceph-mon[34258]: osdmap e648: 8 total, 8 up, 8 in 2021-10-08T19:39:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:50 smithi196 ceph-mon[34258]: pgmap v1012: 204 pgs: 204 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:51.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:50 smithi157 ceph-mon[32847]: osdmap e648: 8 total, 8 up, 8 in 2021-10-08T19:39:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:50 smithi157 ceph-mon[32847]: pgmap v1012: 204 pgs: 204 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:51.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:50 smithi157 ceph-mon[42114]: osdmap e648: 8 total, 8 up, 8 in 2021-10-08T19:39:51.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:50 smithi157 ceph-mon[42114]: pgmap v1012: 204 pgs: 204 active+clean; 582 KiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:52.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:51 smithi196 ceph-mon[34258]: osdmap e649: 8 total, 8 up, 8 in 2021-10-08T19:39:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:52.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:51 smithi157 ceph-mon[42114]: osdmap e649: 8 total, 8 up, 8 in 2021-10-08T19:39:52.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:52.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:51 smithi157 ceph-mon[32847]: osdmap e649: 8 total, 8 up, 8 in 2021-10-08T19:39:52.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:53.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:52 smithi196 ceph-mon[34258]: osdmap e650: 8 total, 8 up, 8 in 2021-10-08T19:39:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]: dispatch 2021-10-08T19:39:53.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:52 smithi196 ceph-mon[34258]: pgmap v1015: 204 pgs: 204 active+clean; 582 KiB data, 485 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:39:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:52 smithi157 ceph-mon[32847]: osdmap e650: 8 total, 8 up, 8 in 2021-10-08T19:39:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]: dispatch 2021-10-08T19:39:53.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:52 smithi157 ceph-mon[32847]: pgmap v1015: 204 pgs: 204 active+clean; 582 KiB data, 485 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:39:53.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:53.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:52 smithi157 ceph-mon[42114]: osdmap e650: 8 total, 8 up, 8 in 2021-10-08T19:39:53.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]: dispatch 2021-10-08T19:39:53.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:52 smithi157 ceph-mon[42114]: pgmap v1015: 204 pgs: 204 active+clean; 582 KiB data, 485 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:39:53.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:53.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:53.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:39:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:39:53.531Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:39:54.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]': finished 2021-10-08T19:39:54.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:53 smithi196 ceph-mon[34258]: osdmap e651: 8 total, 8 up, 8 in 2021-10-08T19:39:54.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]': finished 2021-10-08T19:39:54.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:53 smithi157 ceph-mon[32847]: osdmap e651: 8 total, 8 up, 8 in 2021-10-08T19:39:54.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-130"}]': finished 2021-10-08T19:39:54.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:53 smithi157 ceph-mon[42114]: osdmap e651: 8 total, 8 up, 8 in 2021-10-08T19:39:55.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:54 smithi196 ceph-mon[34258]: osdmap e652: 8 total, 8 up, 8 in 2021-10-08T19:39:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:54 smithi196 ceph-mon[34258]: pgmap v1018: 204 pgs: 204 active+clean; 582 KiB data, 485 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:39:55.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:54 smithi157 ceph-mon[32847]: osdmap e652: 8 total, 8 up, 8 in 2021-10-08T19:39:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:55.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:54 smithi157 ceph-mon[32847]: pgmap v1018: 204 pgs: 204 active+clean; 582 KiB data, 485 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:39:55.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:54 smithi157 ceph-mon[42114]: osdmap e652: 8 total, 8 up, 8 in 2021-10-08T19:39:55.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:39:55.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:54 smithi157 ceph-mon[42114]: pgmap v1018: 204 pgs: 204 active+clean; 582 KiB data, 485 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:39:56.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:55 smithi157 ceph-mon[32847]: osdmap e653: 8 total, 8 up, 8 in 2021-10-08T19:39:56.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130"}]: dispatch 2021-10-08T19:39:56.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:56.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:55 smithi157 ceph-mon[42114]: osdmap e653: 8 total, 8 up, 8 in 2021-10-08T19:39:56.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130"}]: dispatch 2021-10-08T19:39:56.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:39:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:55 smithi196 ceph-mon[34258]: osdmap e653: 8 total, 8 up, 8 in 2021-10-08T19:39:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130"}]: dispatch 2021-10-08T19:39:57.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:56 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130"}]': finished 2021-10-08T19:39:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:56 smithi157 ceph-mon[32847]: osdmap e654: 8 total, 8 up, 8 in 2021-10-08T19:39:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:56 smithi157 ceph-mon[32847]: pgmap v1021: 204 pgs: 204 active+clean; 582 KiB data, 485 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:56 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130"}]': finished 2021-10-08T19:39:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:56 smithi157 ceph-mon[42114]: osdmap e654: 8 total, 8 up, 8 in 2021-10-08T19:39:57.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:56 smithi157 ceph-mon[42114]: pgmap v1021: 204 pgs: 204 active+clean; 582 KiB data, 485 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:57.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:56 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-130"}]': finished 2021-10-08T19:39:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:56 smithi196 ceph-mon[34258]: osdmap e654: 8 total, 8 up, 8 in 2021-10-08T19:39:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:56 smithi196 ceph-mon[34258]: pgmap v1021: 204 pgs: 204 active+clean; 582 KiB data, 485 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:57.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:39:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:57] "GET /metrics HTTP/1.1" 200 157701 "" "Prometheus/2.18.1" 2021-10-08T19:39:57.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:39:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:39:58.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:57 smithi157 ceph-mon[32847]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:58.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:57 smithi157 ceph-mon[32847]: osdmap e655: 8 total, 8 up, 8 in 2021-10-08T19:39:58.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:57 smithi157 ceph-mon[42114]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:58.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:57 smithi157 ceph-mon[42114]: osdmap e655: 8 total, 8 up, 8 in 2021-10-08T19:39:58.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:57 smithi196 ceph-mon[34258]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:58.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:57 smithi196 ceph-mon[34258]: osdmap e655: 8 total, 8 up, 8 in 2021-10-08T19:39:58.888 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:39:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:39:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:58 smithi157 ceph-mon[32847]: osdmap e656: 8 total, 8 up, 8 in 2021-10-08T19:39:59.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:59.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:58 smithi157 ceph-mon[32847]: pgmap v1024: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:59.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:59.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:58 smithi157 ceph-mon[42114]: osdmap e656: 8 total, 8 up, 8 in 2021-10-08T19:39:59.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:59.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:58 smithi157 ceph-mon[42114]: pgmap v1024: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:59.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:58 smithi196 ceph-mon[34258]: osdmap e656: 8 total, 8 up, 8 in 2021-10-08T19:39:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:58 smithi196 ceph-mon[34258]: pgmap v1024: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:00.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-132","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:00.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[32847]: osdmap e657: 8 total, 8 up, 8 in 2021-10-08T19:40:00.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:00.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:00.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[32847]: osdmap e658: 8 total, 8 up, 8 in 2021-10-08T19:40:00.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-132"}]: dispatch 2021-10-08T19:40:00.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-132","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:00.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[42114]: osdmap e657: 8 total, 8 up, 8 in 2021-10-08T19:40:00.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:00.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:00.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[42114]: osdmap e658: 8 total, 8 up, 8 in 2021-10-08T19:40:00.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:39:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-132"}]: dispatch 2021-10-08T19:40:00.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-132","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:59 smithi196 ceph-mon[34258]: osdmap e657: 8 total, 8 up, 8 in 2021-10-08T19:40:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:59 smithi196 ceph-mon[34258]: osdmap e658: 8 total, 8 up, 8 in 2021-10-08T19:40:00.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:39:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-132"}]: dispatch 2021-10-08T19:40:01.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[32847]: pgmap v1027: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:01.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[32847]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2021-10-08T19:40:01.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[32847]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-10-08T19:40:01.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[32847]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:40:01.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[32847]: application not enabled on pool 'test-rados-api-smithi157-88568-109' 2021-10-08T19:40:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[32847]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:40:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-132"}]': finished 2021-10-08T19:40:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[32847]: osdmap e659: 8 total, 8 up, 8 in 2021-10-08T19:40:01.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-132", "mode": "writeback"}]: dispatch 2021-10-08T19:40:01.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[42114]: pgmap v1027: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:01.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[42114]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2021-10-08T19:40:01.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[42114]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-10-08T19:40:01.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[42114]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:40:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[42114]: application not enabled on pool 'test-rados-api-smithi157-88568-109' 2021-10-08T19:40:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[42114]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:40:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-132"}]': finished 2021-10-08T19:40:01.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[42114]: osdmap e659: 8 total, 8 up, 8 in 2021-10-08T19:40:01.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-132", "mode": "writeback"}]: dispatch 2021-10-08T19:40:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:00 smithi196 ceph-mon[34258]: pgmap v1027: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:01.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:00 smithi196 ceph-mon[34258]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2021-10-08T19:40:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:00 smithi196 ceph-mon[34258]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-10-08T19:40:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:00 smithi196 ceph-mon[34258]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:40:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:00 smithi196 ceph-mon[34258]: application not enabled on pool 'test-rados-api-smithi157-88568-109' 2021-10-08T19:40:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:00 smithi196 ceph-mon[34258]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:40:01.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-132"}]': finished 2021-10-08T19:40:01.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:00 smithi196 ceph-mon[34258]: osdmap e659: 8 total, 8 up, 8 in 2021-10-08T19:40:01.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-132", "mode": "writeback"}]: dispatch 2021-10-08T19:40:02.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:01 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:02.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-132", "mode": "writeback"}]': finished 2021-10-08T19:40:02.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:01 smithi157 ceph-mon[32847]: osdmap e660: 8 total, 8 up, 8 in 2021-10-08T19:40:02.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:02.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:01 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:02.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-132", "mode": "writeback"}]': finished 2021-10-08T19:40:02.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:01 smithi157 ceph-mon[42114]: osdmap e660: 8 total, 8 up, 8 in 2021-10-08T19:40:02.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:02.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:01 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:02.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-132", "mode": "writeback"}]': finished 2021-10-08T19:40:02.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:01 smithi196 ceph-mon[34258]: osdmap e660: 8 total, 8 up, 8 in 2021-10-08T19:40:02.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:03.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:02 smithi157 ceph-mon[32847]: pgmap v1030: 204 pgs: 204 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:40:03.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:40:03.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:02 smithi157 ceph-mon[32847]: osdmap e661: 8 total, 8 up, 8 in 2021-10-08T19:40:03.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132"}]: dispatch 2021-10-08T19:40:03.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:02 smithi157 ceph-mon[42114]: pgmap v1030: 204 pgs: 204 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:40:03.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:40:03.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:02 smithi157 ceph-mon[42114]: osdmap e661: 8 total, 8 up, 8 in 2021-10-08T19:40:03.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132"}]: dispatch 2021-10-08T19:40:03.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:02 smithi196 ceph-mon[34258]: pgmap v1030: 204 pgs: 204 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:40:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:40:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:02 smithi196 ceph-mon[34258]: osdmap e661: 8 total, 8 up, 8 in 2021-10-08T19:40:03.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132"}]: dispatch 2021-10-08T19:40:03.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:03.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:03.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:03.531Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:40:04.283 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:03 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:04.283 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132"}]': finished 2021-10-08T19:40:04.283 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:03 smithi196 ceph-mon[34258]: osdmap e662: 8 total, 8 up, 8 in 2021-10-08T19:40:04.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:03 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:04.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132"}]': finished 2021-10-08T19:40:04.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:03 smithi157 ceph-mon[32847]: osdmap e662: 8 total, 8 up, 8 in 2021-10-08T19:40:04.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:03 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:04.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-132"}]': finished 2021-10-08T19:40:04.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:03 smithi157 ceph-mon[42114]: osdmap e662: 8 total, 8 up, 8 in 2021-10-08T19:40:05.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:04 smithi196 ceph-mon[34258]: pgmap v1033: 204 pgs: 204 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:40:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:04 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:40:05.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:04 smithi196 ceph-mon[34258]: osdmap e663: 8 total, 8 up, 8 in 2021-10-08T19:40:05.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:04 smithi157 ceph-mon[32847]: pgmap v1033: 204 pgs: 204 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:40:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:04 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:40:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:04 smithi157 ceph-mon[32847]: osdmap e663: 8 total, 8 up, 8 in 2021-10-08T19:40:05.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:04 smithi157 ceph-mon[42114]: pgmap v1033: 204 pgs: 204 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:40:05.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:04 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:40:05.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:04 smithi157 ceph-mon[42114]: osdmap e663: 8 total, 8 up, 8 in 2021-10-08T19:40:06.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:06 smithi196 ceph-mon[34258]: osdmap e664: 8 total, 8 up, 8 in 2021-10-08T19:40:06.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:06 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:06.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:06 smithi196 ceph-mon[34258]: pgmap v1036: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:06 smithi157 ceph-mon[32847]: osdmap e664: 8 total, 8 up, 8 in 2021-10-08T19:40:07.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:06 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:07.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:06 smithi157 ceph-mon[32847]: pgmap v1036: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:07.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:06 smithi157 ceph-mon[42114]: osdmap e664: 8 total, 8 up, 8 in 2021-10-08T19:40:07.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:06 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:07.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:06 smithi157 ceph-mon[42114]: pgmap v1036: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:07.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-134","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:07.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:07 smithi157 ceph-mon[32847]: osdmap e665: 8 total, 8 up, 8 in 2021-10-08T19:40:07.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:07.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:07] "GET /metrics HTTP/1.1" 200 157669 "" "Prometheus/2.18.1" 2021-10-08T19:40:07.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-134","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:07.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:07 smithi157 ceph-mon[42114]: osdmap e665: 8 total, 8 up, 8 in 2021-10-08T19:40:07.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:07.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:40:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:40:07.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-134","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:07.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:07 smithi196 ceph-mon[34258]: osdmap e665: 8 total, 8 up, 8 in 2021-10-08T19:40:07.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:09.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:09.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[32847]: osdmap e666: 8 total, 8 up, 8 in 2021-10-08T19:40:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-134"}]: dispatch 2021-10-08T19:40:09.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[32847]: pgmap v1039: 204 pgs: 204 active+clean; 582 KiB data, 490 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:09.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:09.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:09.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[42114]: osdmap e666: 8 total, 8 up, 8 in 2021-10-08T19:40:09.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-134"}]: dispatch 2021-10-08T19:40:09.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:08 smithi157 ceph-mon[42114]: pgmap v1039: 204 pgs: 204 active+clean; 582 KiB data, 490 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:09.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:40:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:09.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:08 smithi196 ceph-mon[34258]: osdmap e666: 8 total, 8 up, 8 in 2021-10-08T19:40:09.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-134"}]: dispatch 2021-10-08T19:40:09.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:08 smithi196 ceph-mon[34258]: pgmap v1039: 204 pgs: 204 active+clean; 582 KiB data, 490 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:10.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-134"}]': finished 2021-10-08T19:40:10.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:09 smithi157 ceph-mon[42114]: osdmap e667: 8 total, 8 up, 8 in 2021-10-08T19:40:10.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-134", "mode": "writeback"}]: dispatch 2021-10-08T19:40:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-134"}]': finished 2021-10-08T19:40:10.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:09 smithi157 ceph-mon[32847]: osdmap e667: 8 total, 8 up, 8 in 2021-10-08T19:40:10.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-134", "mode": "writeback"}]: dispatch 2021-10-08T19:40:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-134"}]': finished 2021-10-08T19:40:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:09 smithi196 ceph-mon[34258]: osdmap e667: 8 total, 8 up, 8 in 2021-10-08T19:40:10.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-134", "mode": "writeback"}]: dispatch 2021-10-08T19:40:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-134", "mode": "writeback"}]': finished 2021-10-08T19:40:11.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[32847]: osdmap e668: 8 total, 8 up, 8 in 2021-10-08T19:40:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:11.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[32847]: pgmap v1042: 204 pgs: 204 active+clean; 582 KiB data, 490 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:11.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-134", "mode": "writeback"}]': finished 2021-10-08T19:40:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[42114]: osdmap e668: 8 total, 8 up, 8 in 2021-10-08T19:40:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:11.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:10 smithi157 ceph-mon[42114]: pgmap v1042: 204 pgs: 204 active+clean; 582 KiB data, 490 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:11.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:10 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:11.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-134", "mode": "writeback"}]': finished 2021-10-08T19:40:11.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:10 smithi196 ceph-mon[34258]: osdmap e668: 8 total, 8 up, 8 in 2021-10-08T19:40:11.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:11.122 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:10 smithi196 ceph-mon[34258]: pgmap v1042: 204 pgs: 204 active+clean; 582 KiB data, 490 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:11.830 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:11 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:40:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:11.831 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:40:11.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:11 smithi157 ceph-mon[32847]: osdmap e669: 8 total, 8 up, 8 in 2021-10-08T19:40:11.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134"}]: dispatch 2021-10-08T19:40:11.832 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:11 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:11.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:40:11.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:11 smithi157 ceph-mon[42114]: osdmap e669: 8 total, 8 up, 8 in 2021-10-08T19:40:11.833 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134"}]: dispatch 2021-10-08T19:40:11.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:11 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:12.123 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:40:12.123 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:11 smithi196 ceph-mon[34258]: osdmap e669: 8 total, 8 up, 8 in 2021-10-08T19:40:12.123 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134"}]: dispatch 2021-10-08T19:40:12.124 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:11 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:13.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:40:13.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:40:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:13.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:13.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134"}]': finished 2021-10-08T19:40:13.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[32847]: osdmap e670: 8 total, 8 up, 8 in 2021-10-08T19:40:13.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[32847]: pgmap v1045: 204 pgs: 204 active+clean; 4.4 MiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2021-10-08T19:40:13.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:40:13.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:40:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:13.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:13.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134"}]': finished 2021-10-08T19:40:13.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[42114]: osdmap e670: 8 total, 8 up, 8 in 2021-10-08T19:40:13.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:12 smithi157 ceph-mon[42114]: pgmap v1045: 204 pgs: 204 active+clean; 4.4 MiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2021-10-08T19:40:13.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:12 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:40:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:12 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:40:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:12 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-134"}]': finished 2021-10-08T19:40:13.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:12 smithi196 ceph-mon[34258]: osdmap e670: 8 total, 8 up, 8 in 2021-10-08T19:40:13.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:12 smithi196 ceph-mon[34258]: pgmap v1045: 204 pgs: 204 active+clean; 4.4 MiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2021-10-08T19:40:13.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:13 smithi157 ceph-mon[32847]: osdmap e671: 8 total, 8 up, 8 in 2021-10-08T19:40:13.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:13 smithi157 ceph-mon[42114]: osdmap e671: 8 total, 8 up, 8 in 2021-10-08T19:40:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:13.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:13.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:13.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:13.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:13.531Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:40:14.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:13 smithi196 ceph-mon[34258]: osdmap e671: 8 total, 8 up, 8 in 2021-10-08T19:40:14.327 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:14 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:40:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:15.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:14 smithi157 ceph-mon[42114]: osdmap e672: 8 total, 8 up, 8 in 2021-10-08T19:40:15.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:15.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:14 smithi157 ceph-mon[42114]: pgmap v1048: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:40:15.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:14 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:14 smithi157 ceph-mon[32847]: osdmap e672: 8 total, 8 up, 8 in 2021-10-08T19:40:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:15.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:14 smithi157 ceph-mon[32847]: pgmap v1048: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:40:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:14 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:15.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:14 smithi196 ceph-mon[34258]: osdmap e672: 8 total, 8 up, 8 in 2021-10-08T19:40:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:14 smithi196 ceph-mon[34258]: pgmap v1048: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:40:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:14 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:16.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:40:16.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:40:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:16.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-136","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:16.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[32847]: osdmap e673: 8 total, 8 up, 8 in 2021-10-08T19:40:16.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:16.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:40:16.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:40:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-136","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[42114]: osdmap e673: 8 total, 8 up, 8 in 2021-10-08T19:40:16.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:15 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:16.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:15 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:40:16.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:15 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:40:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-136","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:15 smithi196 ceph-mon[34258]: osdmap e673: 8 total, 8 up, 8 in 2021-10-08T19:40:16.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:15 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:17.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:17.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[32847]: osdmap e674: 8 total, 8 up, 8 in 2021-10-08T19:40:17.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:40:17.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[32847]: pgmap v1051: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 501 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:40:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[32847]: osdmap e675: 8 total, 8 up, 8 in 2021-10-08T19:40:17.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:40:17.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:17.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[42114]: osdmap e674: 8 total, 8 up, 8 in 2021-10-08T19:40:17.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:40:17.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[42114]: pgmap v1051: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 501 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:40:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[42114]: osdmap e675: 8 total, 8 up, 8 in 2021-10-08T19:40:17.083 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:40:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:16 smithi196 ceph-mon[34258]: osdmap e674: 8 total, 8 up, 8 in 2021-10-08T19:40:17.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:40:17.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:16 smithi196 ceph-mon[34258]: pgmap v1051: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 501 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:17.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:40:17.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:16 smithi196 ceph-mon[34258]: osdmap e675: 8 total, 8 up, 8 in 2021-10-08T19:40:17.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:40:17.831 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:17] "GET /metrics HTTP/1.1" 200 157669 "" "Prometheus/2.18.1" 2021-10-08T19:40:17.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:40:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:40:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:40:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[32847]: osdmap e676: 8 total, 8 up, 8 in 2021-10-08T19:40:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:40:19.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[32847]: pgmap v1054: 204 pgs: 204 active+clean; 4.4 MiB data, 506 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:19.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:19.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:40:19.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[42114]: osdmap e676: 8 total, 8 up, 8 in 2021-10-08T19:40:19.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:40:19.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:18 smithi157 ceph-mon[42114]: pgmap v1054: 204 pgs: 204 active+clean; 4.4 MiB data, 506 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:19.119 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:40:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:19.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:19.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:40:19.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:18 smithi196 ceph-mon[34258]: osdmap e676: 8 total, 8 up, 8 in 2021-10-08T19:40:19.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:40:19.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:18 smithi196 ceph-mon[34258]: pgmap v1054: 204 pgs: 204 active+clean; 4.4 MiB data, 506 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:20.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:40:20.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:19 smithi157 ceph-mon[32847]: osdmap e677: 8 total, 8 up, 8 in 2021-10-08T19:40:20.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:40:20.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:19 smithi157 ceph-mon[42114]: osdmap e677: 8 total, 8 up, 8 in 2021-10-08T19:40:20.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-136","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:40:20.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:19 smithi196 ceph-mon[34258]: osdmap e677: 8 total, 8 up, 8 in 2021-10-08T19:40:21.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:21.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136"}]: dispatch 2021-10-08T19:40:21.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:20 smithi157 ceph-mon[32847]: pgmap v1056: 204 pgs: 204 active+clean; 4.4 MiB data, 506 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:21.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:21.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136"}]: dispatch 2021-10-08T19:40:21.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:20 smithi157 ceph-mon[42114]: pgmap v1056: 204 pgs: 204 active+clean; 4.4 MiB data, 506 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:21.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:21.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136"}]: dispatch 2021-10-08T19:40:21.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:20 smithi196 ceph-mon[34258]: pgmap v1056: 204 pgs: 204 active+clean; 4.4 MiB data, 506 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:22.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136"}]': finished 2021-10-08T19:40:22.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:21 smithi157 ceph-mon[32847]: osdmap e678: 8 total, 8 up, 8 in 2021-10-08T19:40:22.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136"}]': finished 2021-10-08T19:40:22.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:21 smithi157 ceph-mon[42114]: osdmap e678: 8 total, 8 up, 8 in 2021-10-08T19:40:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-136"}]': finished 2021-10-08T19:40:22.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:21 smithi196 ceph-mon[34258]: osdmap e678: 8 total, 8 up, 8 in 2021-10-08T19:40:23.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:22 smithi157 ceph-mon[32847]: osdmap e679: 8 total, 8 up, 8 in 2021-10-08T19:40:23.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:22 smithi157 ceph-mon[32847]: pgmap v1059: 172 pgs: 172 active+clean; 4.4 MiB data, 507 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:23.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:22 smithi157 ceph-mon[42114]: osdmap e679: 8 total, 8 up, 8 in 2021-10-08T19:40:23.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:22 smithi157 ceph-mon[42114]: pgmap v1059: 172 pgs: 172 active+clean; 4.4 MiB data, 507 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:23.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:22 smithi196 ceph-mon[34258]: osdmap e679: 8 total, 8 up, 8 in 2021-10-08T19:40:23.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:22 smithi196 ceph-mon[34258]: pgmap v1059: 172 pgs: 172 active+clean; 4.4 MiB data, 507 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:23.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:23 smithi157 ceph-mon[32847]: osdmap e680: 8 total, 8 up, 8 in 2021-10-08T19:40:23.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:23.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:23 smithi157 ceph-mon[42114]: osdmap e680: 8 total, 8 up, 8 in 2021-10-08T19:40:23.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:23.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:23.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:23.532Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:40:24.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:23 smithi196 ceph-mon[34258]: osdmap e680: 8 total, 8 up, 8 in 2021-10-08T19:40:24.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:25.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-138","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:25.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:24 smithi157 ceph-mon[32847]: osdmap e681: 8 total, 8 up, 8 in 2021-10-08T19:40:25.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:25.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:24 smithi157 ceph-mon[32847]: pgmap v1062: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 507 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:25.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-138","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:25.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:24 smithi157 ceph-mon[42114]: osdmap e681: 8 total, 8 up, 8 in 2021-10-08T19:40:25.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:25.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:24 smithi157 ceph-mon[42114]: pgmap v1062: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 507 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:25.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-138","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:24 smithi196 ceph-mon[34258]: osdmap e681: 8 total, 8 up, 8 in 2021-10-08T19:40:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:25.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:24 smithi196 ceph-mon[34258]: pgmap v1062: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 507 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:26.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:26.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:25 smithi157 ceph-mon[32847]: osdmap e682: 8 total, 8 up, 8 in 2021-10-08T19:40:26.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:40:26.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:26.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:25 smithi157 ceph-mon[42114]: osdmap e682: 8 total, 8 up, 8 in 2021-10-08T19:40:26.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:40:26.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:26.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:25 smithi196 ceph-mon[34258]: osdmap e682: 8 total, 8 up, 8 in 2021-10-08T19:40:26.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:40:27.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:40:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[32847]: osdmap e683: 8 total, 8 up, 8 in 2021-10-08T19:40:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:40:27.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[32847]: pgmap v1065: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 507 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:40:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[32847]: osdmap e684: 8 total, 8 up, 8 in 2021-10-08T19:40:27.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:40:27.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[42114]: osdmap e683: 8 total, 8 up, 8 in 2021-10-08T19:40:27.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:40:27.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[42114]: pgmap v1065: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 507 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:27.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:40:27.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:26 smithi157 ceph-mon[42114]: osdmap e684: 8 total, 8 up, 8 in 2021-10-08T19:40:27.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:40:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:26 smithi196 ceph-mon[34258]: osdmap e683: 8 total, 8 up, 8 in 2021-10-08T19:40:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:40:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:26 smithi196 ceph-mon[34258]: pgmap v1065: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 507 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:27.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:26 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:40:27.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:26 smithi196 ceph-mon[34258]: osdmap e684: 8 total, 8 up, 8 in 2021-10-08T19:40:27.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:40:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:40:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:27] "GET /metrics HTTP/1.1" 200 157720 "" "Prometheus/2.18.1" 2021-10-08T19:40:27.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:40:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:40:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:27 smithi157 ceph-mon[32847]: osdmap e685: 8 total, 8 up, 8 in 2021-10-08T19:40:27.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:27 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:40:27.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:40:27.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:40:27.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:27 smithi157 ceph-mon[42114]: osdmap e685: 8 total, 8 up, 8 in 2021-10-08T19:40:27.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:27 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:40:28.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:40:28.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:40:28.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:27 smithi196 ceph-mon[34258]: osdmap e685: 8 total, 8 up, 8 in 2021-10-08T19:40:28.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:27 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:40:29.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:29.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:28 smithi157 ceph-mon[42114]: pgmap v1068: 204 pgs: 204 active+clean; 4.4 MiB data, 513 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:29.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:28 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:40:29.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:28 smithi157 ceph-mon[42114]: osdmap e686: 8 total, 8 up, 8 in 2021-10-08T19:40:29.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:29.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:28 smithi157 ceph-mon[32847]: pgmap v1068: 204 pgs: 204 active+clean; 4.4 MiB data, 513 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:29.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:28 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:40:29.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:28 smithi157 ceph-mon[32847]: osdmap e686: 8 total, 8 up, 8 in 2021-10-08T19:40:29.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:40:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:29.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:28 smithi196 ceph-mon[34258]: pgmap v1068: 204 pgs: 204 active+clean; 4.4 MiB data, 513 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:28 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-138","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:40:29.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:28 smithi196 ceph-mon[34258]: osdmap e686: 8 total, 8 up, 8 in 2021-10-08T19:40:30.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:30 smithi196 ceph-mon[34258]: pgmap v1070: 204 pgs: 204 active+clean; 4.4 MiB data, 513 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:30 smithi157 ceph-mon[32847]: pgmap v1070: 204 pgs: 204 active+clean; 4.4 MiB data, 513 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:31.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:30 smithi157 ceph-mon[42114]: pgmap v1070: 204 pgs: 204 active+clean; 4.4 MiB data, 513 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:31.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:40:31.868 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:40:31.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:31 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:40:31.869 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:31 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:32.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:40:32.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:40:32.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:31 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:40:32.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:31 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:40:32.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:40:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:31 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:40:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:31 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:33.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:32 smithi157 ceph-mon[32847]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-10-08T19:40:33.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:32 smithi157 ceph-mon[42114]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-10-08T19:40:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:32 smithi196 ceph-mon[34258]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-10-08T19:40:33.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:33.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:33.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:33.532Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:40:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:34 smithi157 ceph-mon[32847]: pgmap v1072: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.3 KiB/s wr, 1 op/s 2021-10-08T19:40:35.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:34 smithi157 ceph-mon[42114]: pgmap v1072: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.3 KiB/s wr, 1 op/s 2021-10-08T19:40:35.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:34 smithi196 ceph-mon[34258]: pgmap v1072: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.3 KiB/s wr, 1 op/s 2021-10-08T19:40:37.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[42114]: pgmap v1073: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 2.9 KiB/s wr, 0 op/s 2021-10-08T19:40:37.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:37.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:37.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:37.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[32847]: pgmap v1073: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 2.9 KiB/s wr, 0 op/s 2021-10-08T19:40:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:37.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:37.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:36 smithi196 ceph-mon[34258]: pgmap v1073: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 2.9 KiB/s wr, 0 op/s 2021-10-08T19:40:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:37.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:37.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:37] "GET /metrics HTTP/1.1" 200 157757 "" "Prometheus/2.18.1" 2021-10-08T19:40:37.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:40:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:40:38.961 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:38 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:40:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:38.962 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:40:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:39.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:39.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:38 smithi157 ceph-mon[42114]: pgmap v1074: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 6.6 KiB/s wr, 1 op/s 2021-10-08T19:40:39.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:38 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:38 smithi157 ceph-mon[32847]: pgmap v1074: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 6.6 KiB/s wr, 1 op/s 2021-10-08T19:40:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:38 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:39.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:38 smithi196 ceph-mon[34258]: pgmap v1074: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 6.6 KiB/s wr, 1 op/s 2021-10-08T19:40:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:38 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:39.963 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:39 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:40:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:40.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:39 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:40:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:39 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:40:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:39 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:39 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:40:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:39 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:40:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:39 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:40.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:39 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:40:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:39 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:40:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:40.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:39 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:40:41.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:40:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:40:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[32847]: pgmap v1075: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 915 B/s rd, 5.9 KiB/s wr, 1 op/s 2021-10-08T19:40:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:41.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138"}]: dispatch 2021-10-08T19:40:41.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:40:41.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:40:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:41.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[42114]: pgmap v1075: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 915 B/s rd, 5.9 KiB/s wr, 1 op/s 2021-10-08T19:40:41.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:41.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138"}]: dispatch 2021-10-08T19:40:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:40 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:40:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:40 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:40:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:40 smithi196 ceph-mon[34258]: pgmap v1075: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 915 B/s rd, 5.9 KiB/s wr, 1 op/s 2021-10-08T19:40:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:41.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138"}]: dispatch 2021-10-08T19:40:43.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138"}]': finished 2021-10-08T19:40:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:42 smithi157 ceph-mon[32847]: osdmap e687: 8 total, 8 up, 8 in 2021-10-08T19:40:43.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:42 smithi157 ceph-mon[32847]: pgmap v1077: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 2 op/s 2021-10-08T19:40:43.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138"}]': finished 2021-10-08T19:40:43.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:42 smithi157 ceph-mon[42114]: osdmap e687: 8 total, 8 up, 8 in 2021-10-08T19:40:43.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:42 smithi157 ceph-mon[42114]: pgmap v1077: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 2 op/s 2021-10-08T19:40:43.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-138"}]': finished 2021-10-08T19:40:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:42 smithi196 ceph-mon[34258]: osdmap e687: 8 total, 8 up, 8 in 2021-10-08T19:40:43.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:42 smithi196 ceph-mon[34258]: pgmap v1077: 204 pgs: 204 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 2 op/s 2021-10-08T19:40:43.834 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:43 smithi157 ceph-mon[32847]: osdmap e688: 8 total, 8 up, 8 in 2021-10-08T19:40:43.834 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:43 smithi157 ceph-mon[42114]: osdmap e688: 8 total, 8 up, 8 in 2021-10-08T19:40:43.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:43.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:43.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:43.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:43.835 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:43.532Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:40:44.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:43 smithi196 ceph-mon[34258]: osdmap e688: 8 total, 8 up, 8 in 2021-10-08T19:40:45.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[32847]: osdmap e689: 8 total, 8 up, 8 in 2021-10-08T19:40:45.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:45.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[32847]: pgmap v1080: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:40:45.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-140","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:45.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[32847]: osdmap e690: 8 total, 8 up, 8 in 2021-10-08T19:40:45.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[42114]: osdmap e689: 8 total, 8 up, 8 in 2021-10-08T19:40:45.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:45.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[42114]: pgmap v1080: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:40:45.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-140","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:45.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:44 smithi157 ceph-mon[42114]: osdmap e690: 8 total, 8 up, 8 in 2021-10-08T19:40:45.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:44 smithi196 ceph-mon[34258]: osdmap e689: 8 total, 8 up, 8 in 2021-10-08T19:40:45.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:45.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:44 smithi196 ceph-mon[34258]: pgmap v1080: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:40:45.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-140","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:45.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:44 smithi196 ceph-mon[34258]: osdmap e690: 8 total, 8 up, 8 in 2021-10-08T19:40:46.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:46.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:46.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:45 smithi157 ceph-mon[42114]: osdmap e691: 8 total, 8 up, 8 in 2021-10-08T19:40:46.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-140"}]: dispatch 2021-10-08T19:40:46.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:46.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:46.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:45 smithi157 ceph-mon[32847]: osdmap e691: 8 total, 8 up, 8 in 2021-10-08T19:40:46.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-140"}]: dispatch 2021-10-08T19:40:46.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:46.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:46.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:45 smithi196 ceph-mon[34258]: osdmap e691: 8 total, 8 up, 8 in 2021-10-08T19:40:46.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-140"}]: dispatch 2021-10-08T19:40:47.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:46 smithi157 ceph-mon[32847]: pgmap v1083: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-140"}]': finished 2021-10-08T19:40:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:46 smithi157 ceph-mon[32847]: osdmap e692: 8 total, 8 up, 8 in 2021-10-08T19:40:47.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:46 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-140", "mode": "writeback"}]: dispatch 2021-10-08T19:40:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:46 smithi157 ceph-mon[42114]: pgmap v1083: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-140"}]': finished 2021-10-08T19:40:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:46 smithi157 ceph-mon[42114]: osdmap e692: 8 total, 8 up, 8 in 2021-10-08T19:40:47.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:46 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-140", "mode": "writeback"}]: dispatch 2021-10-08T19:40:47.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:46 smithi196 ceph-mon[34258]: pgmap v1083: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 514 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:47.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-140"}]': finished 2021-10-08T19:40:47.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:46 smithi196 ceph-mon[34258]: osdmap e692: 8 total, 8 up, 8 in 2021-10-08T19:40:47.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:46 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-140", "mode": "writeback"}]: dispatch 2021-10-08T19:40:47.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:40:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:40:47.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:47] "GET /metrics HTTP/1.1" 200 157757 "" "Prometheus/2.18.1" 2021-10-08T19:40:47.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:47 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-140", "mode": "writeback"}]': finished 2021-10-08T19:40:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:47 smithi157 ceph-mon[32847]: osdmap e693: 8 total, 8 up, 8 in 2021-10-08T19:40:47.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:47 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:40:47.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:47 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:47.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-140", "mode": "writeback"}]': finished 2021-10-08T19:40:47.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:47 smithi157 ceph-mon[42114]: osdmap e693: 8 total, 8 up, 8 in 2021-10-08T19:40:47.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:47 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:40:48.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:47 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-140", "mode": "writeback"}]': finished 2021-10-08T19:40:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:47 smithi196 ceph-mon[34258]: osdmap e693: 8 total, 8 up, 8 in 2021-10-08T19:40:48.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:47 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:40:49.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[32847]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:40:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:40:49.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[32847]: osdmap e694: 8 total, 8 up, 8 in 2021-10-08T19:40:49.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:40:49.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:49.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[42114]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:40:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:40:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[42114]: osdmap e694: 8 total, 8 up, 8 in 2021-10-08T19:40:49.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:40:49.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:40:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:48 smithi196 ceph-mon[34258]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:40:49.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:40:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:48 smithi196 ceph-mon[34258]: osdmap e694: 8 total, 8 up, 8 in 2021-10-08T19:40:49.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:40:51.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:40:51.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:50 smithi157 ceph-mon[32847]: osdmap e695: 8 total, 8 up, 8 in 2021-10-08T19:40:51.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:40:51.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:50 smithi157 ceph-mon[32847]: pgmap v1089: 204 pgs: 204 active+clean; 4.4 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:40:51.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:40:51.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:50 smithi157 ceph-mon[42114]: osdmap e695: 8 total, 8 up, 8 in 2021-10-08T19:40:51.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:40:51.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:50 smithi157 ceph-mon[42114]: pgmap v1089: 204 pgs: 204 active+clean; 4.4 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:40:51.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:40:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:50 smithi196 ceph-mon[34258]: osdmap e695: 8 total, 8 up, 8 in 2021-10-08T19:40:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:40:51.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:50 smithi196 ceph-mon[34258]: pgmap v1089: 204 pgs: 204 active+clean; 4.4 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:40:52.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:51 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:52.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:40:52.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:51 smithi157 ceph-mon[32847]: osdmap e696: 8 total, 8 up, 8 in 2021-10-08T19:40:52.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:40:52.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:51 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:52.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:40:52.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:51 smithi157 ceph-mon[42114]: osdmap e696: 8 total, 8 up, 8 in 2021-10-08T19:40:52.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:40:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:51 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:40:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:51 smithi196 ceph-mon[34258]: osdmap e696: 8 total, 8 up, 8 in 2021-10-08T19:40:52.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:40:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:40:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:52 smithi157 ceph-mon[32847]: osdmap e697: 8 total, 8 up, 8 in 2021-10-08T19:40:53.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:40:53.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:52 smithi157 ceph-mon[32847]: pgmap v1092: 204 pgs: 204 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:53.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:40:53.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:52 smithi157 ceph-mon[42114]: osdmap e697: 8 total, 8 up, 8 in 2021-10-08T19:40:53.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:40:53.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:52 smithi157 ceph-mon[42114]: pgmap v1092: 204 pgs: 204 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:53.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:40:53.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:52 smithi196 ceph-mon[34258]: osdmap e697: 8 total, 8 up, 8 in 2021-10-08T19:40:53.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:40:53.121 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:52 smithi196 ceph-mon[34258]: pgmap v1092: 204 pgs: 204 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:53.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:40:53.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:53 smithi157 ceph-mon[32847]: osdmap e698: 8 total, 8 up, 8 in 2021-10-08T19:40:53.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:53 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:40:53.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:40:53.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:53 smithi157 ceph-mon[42114]: osdmap e698: 8 total, 8 up, 8 in 2021-10-08T19:40:53.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:53 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:40:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:53.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:53.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:53.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:53.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:40:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:40:53.532Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:40:54.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:40:54.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:53 smithi196 ceph-mon[34258]: osdmap e698: 8 total, 8 up, 8 in 2021-10-08T19:40:54.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:53 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:40:55.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:40:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:54 smithi157 ceph-mon[32847]: osdmap e699: 8 total, 8 up, 8 in 2021-10-08T19:40:55.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:54 smithi157 ceph-mon[32847]: pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:55.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:40:55.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:54 smithi157 ceph-mon[42114]: osdmap e699: 8 total, 8 up, 8 in 2021-10-08T19:40:55.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:54 smithi157 ceph-mon[42114]: pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:55.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-140","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:40:55.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:54 smithi196 ceph-mon[34258]: osdmap e699: 8 total, 8 up, 8 in 2021-10-08T19:40:55.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:54 smithi196 ceph-mon[34258]: pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:56.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:56.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:56.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:57.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:40:57.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:56 smithi157 ceph-mon[32847]: osdmap e700: 8 total, 8 up, 8 in 2021-10-08T19:40:57.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140"}]: dispatch 2021-10-08T19:40:57.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:56 smithi157 ceph-mon[32847]: pgmap v1097: 204 pgs: 204 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:57.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:40:57.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:56 smithi157 ceph-mon[42114]: osdmap e700: 8 total, 8 up, 8 in 2021-10-08T19:40:57.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140"}]: dispatch 2021-10-08T19:40:57.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:56 smithi157 ceph-mon[42114]: pgmap v1097: 204 pgs: 204 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:57.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:40:57.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:56 smithi196 ceph-mon[34258]: osdmap e700: 8 total, 8 up, 8 in 2021-10-08T19:40:57.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140"}]: dispatch 2021-10-08T19:40:57.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:56 smithi196 ceph-mon[34258]: pgmap v1097: 204 pgs: 204 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:57.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:40:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:40:57.831 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:40:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:57] "GET /metrics HTTP/1.1" 200 157727 "" "Prometheus/2.18.1" 2021-10-08T19:40:57.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140"}]': finished 2021-10-08T19:40:57.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:57 smithi157 ceph-mon[42114]: osdmap e701: 8 total, 8 up, 8 in 2021-10-08T19:40:57.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:57.832 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140"}]: dispatch 2021-10-08T19:40:57.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140"}]': finished 2021-10-08T19:40:57.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:57 smithi157 ceph-mon[32847]: osdmap e701: 8 total, 8 up, 8 in 2021-10-08T19:40:57.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:57.833 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140"}]: dispatch 2021-10-08T19:40:58.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140"}]': finished 2021-10-08T19:40:58.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:57 smithi196 ceph-mon[34258]: osdmap e701: 8 total, 8 up, 8 in 2021-10-08T19:40:58.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:40:58.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-140"}]: dispatch 2021-10-08T19:40:58.947 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:58.947 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:58 smithi196 ceph-mon[34258]: osdmap e702: 8 total, 8 up, 8 in 2021-10-08T19:40:58.947 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:58 smithi196 ceph-mon[34258]: pgmap v1100: 172 pgs: 172 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:40:58.948 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:40:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:40:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:59.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:59.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:58 smithi157 ceph-mon[32847]: osdmap e702: 8 total, 8 up, 8 in 2021-10-08T19:40:59.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:58 smithi157 ceph-mon[32847]: pgmap v1100: 172 pgs: 172 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:40:59.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:59.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:58 smithi157 ceph-mon[42114]: osdmap e702: 8 total, 8 up, 8 in 2021-10-08T19:40:59.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:58 smithi157 ceph-mon[42114]: pgmap v1100: 172 pgs: 172 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:00.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:59 smithi157 ceph-mon[32847]: osdmap e703: 8 total, 8 up, 8 in 2021-10-08T19:41:00.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:40:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:00.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:59 smithi157 ceph-mon[42114]: osdmap e703: 8 total, 8 up, 8 in 2021-10-08T19:41:00.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:40:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:00.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:59 smithi196 ceph-mon[34258]: osdmap e703: 8 total, 8 up, 8 in 2021-10-08T19:41:00.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:40:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:01.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-142","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:01.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:00 smithi157 ceph-mon[32847]: osdmap e704: 8 total, 8 up, 8 in 2021-10-08T19:41:01.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:01.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:00 smithi157 ceph-mon[32847]: pgmap v1103: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:01.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-142","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:01.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:00 smithi157 ceph-mon[42114]: osdmap e704: 8 total, 8 up, 8 in 2021-10-08T19:41:01.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:01.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:00 smithi157 ceph-mon[42114]: pgmap v1103: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:01.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-142","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:00 smithi196 ceph-mon[34258]: osdmap e704: 8 total, 8 up, 8 in 2021-10-08T19:41:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:01.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:00 smithi196 ceph-mon[34258]: pgmap v1103: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 521 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:01.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:01.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:01 smithi157 ceph-mon[32847]: osdmap e705: 8 total, 8 up, 8 in 2021-10-08T19:41:01.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-142"}]: dispatch 2021-10-08T19:41:01.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:01.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:01 smithi157 ceph-mon[42114]: osdmap e705: 8 total, 8 up, 8 in 2021-10-08T19:41:01.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-142"}]: dispatch 2021-10-08T19:41:02.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:02.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:01 smithi196 ceph-mon[34258]: osdmap e705: 8 total, 8 up, 8 in 2021-10-08T19:41:02.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-142"}]: dispatch 2021-10-08T19:41:03.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-142"}]': finished 2021-10-08T19:41:03.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[32847]: osdmap e706: 8 total, 8 up, 8 in 2021-10-08T19:41:03.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-142", "mode": "readproxy"}]: dispatch 2021-10-08T19:41:03.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[32847]: pgmap v1106: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:41:03.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:03.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-142"}]': finished 2021-10-08T19:41:03.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[42114]: osdmap e706: 8 total, 8 up, 8 in 2021-10-08T19:41:03.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-142", "mode": "readproxy"}]: dispatch 2021-10-08T19:41:03.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[42114]: pgmap v1106: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:41:03.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:02 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:03.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-142"}]': finished 2021-10-08T19:41:03.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:02 smithi196 ceph-mon[34258]: osdmap e706: 8 total, 8 up, 8 in 2021-10-08T19:41:03.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:02 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-142", "mode": "readproxy"}]: dispatch 2021-10-08T19:41:03.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:02 smithi196 ceph-mon[34258]: pgmap v1106: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:41:03.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:02 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:03.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:03 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-142", "mode": "readproxy"}]': finished 2021-10-08T19:41:03.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:03 smithi157 ceph-mon[32847]: osdmap e707: 8 total, 8 up, 8 in 2021-10-08T19:41:03.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:03 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-142", "mode": "readproxy"}]': finished 2021-10-08T19:41:03.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:03 smithi157 ceph-mon[42114]: osdmap e707: 8 total, 8 up, 8 in 2021-10-08T19:41:03.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:03.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:03.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:03.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:03.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:03.533Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:41:04.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:03 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-142", "mode": "readproxy"}]': finished 2021-10-08T19:41:04.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:03 smithi196 ceph-mon[34258]: osdmap e707: 8 total, 8 up, 8 in 2021-10-08T19:41:05.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:04 smithi157 ceph-mon[32847]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 246 B/s wr, 1 op/s 2021-10-08T19:41:05.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:04 smithi157 ceph-mon[42114]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 246 B/s wr, 1 op/s 2021-10-08T19:41:05.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:04 smithi196 ceph-mon[34258]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 246 B/s wr, 1 op/s 2021-10-08T19:41:05.440 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:05 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:41:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:05.441 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:05 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:41:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:06.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:06 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:06.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:06 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:41:06.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:06 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:41:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:06.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:06 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:06.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:06 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:41:06.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:06 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:41:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:06.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:06 smithi196 ceph-mon[34258]: pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 170 B/s wr, 0 op/s 2021-10-08T19:41:06.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:06.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:41:06.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:41:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:06.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:06.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:41:06.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:41:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:06.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[32847]: pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 170 B/s wr, 0 op/s 2021-10-08T19:41:06.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:06.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:41:06.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:41:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:06.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:06.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:41:06.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:41:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:06.583 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:06 smithi157 ceph-mon[42114]: pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 170 B/s wr, 0 op/s 2021-10-08T19:41:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:07] "GET /metrics HTTP/1.1" 200 157716 "" "Prometheus/2.18.1" 2021-10-08T19:41:07.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:41:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:41:08.971 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:41:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:09.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:08 smithi157 ceph-mon[32847]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 143 B/s wr, 1 op/s 2021-10-08T19:41:09.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:09.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:08 smithi157 ceph-mon[42114]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 143 B/s wr, 1 op/s 2021-10-08T19:41:09.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:09.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:08 smithi196 ceph-mon[34258]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 143 B/s wr, 1 op/s 2021-10-08T19:41:11.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:10 smithi157 ceph-mon[32847]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 754 B/s rd, 0 op/s 2021-10-08T19:41:11.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:10 smithi157 ceph-mon[42114]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 754 B/s rd, 0 op/s 2021-10-08T19:41:11.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:10 smithi196 ceph-mon[34258]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 754 B/s rd, 0 op/s 2021-10-08T19:41:13.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:12 smithi157 ceph-mon[42114]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:13.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:13.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:12 smithi157 ceph-mon[32847]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:13.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:13.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:12 smithi196 ceph-mon[34258]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:13.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:13.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:13.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:13.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:13.533Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:41:14.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:14.412 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:13 smithi157 ceph-mon[42114]: osdmap e708: 8 total, 8 up, 8 in 2021-10-08T19:41:14.413 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142"}]: dispatch 2021-10-08T19:41:14.413 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:13 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:14.414 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:14.414 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:13 smithi157 ceph-mon[32847]: osdmap e708: 8 total, 8 up, 8 in 2021-10-08T19:41:14.415 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142"}]: dispatch 2021-10-08T19:41:14.415 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:13 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:14.415 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:14.416 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:13 smithi196 ceph-mon[34258]: osdmap e708: 8 total, 8 up, 8 in 2021-10-08T19:41:14.416 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142"}]: dispatch 2021-10-08T19:41:14.416 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:13 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:15.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[32847]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:15.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142"}]': finished 2021-10-08T19:41:15.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[32847]: osdmap e709: 8 total, 8 up, 8 in 2021-10-08T19:41:15.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:15.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142"}]: dispatch 2021-10-08T19:41:15.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[42114]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:15.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142"}]': finished 2021-10-08T19:41:15.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[42114]: osdmap e709: 8 total, 8 up, 8 in 2021-10-08T19:41:15.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:15.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142"}]: dispatch 2021-10-08T19:41:15.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:14 smithi196 ceph-mon[34258]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:15.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142"}]': finished 2021-10-08T19:41:15.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:14 smithi196 ceph-mon[34258]: osdmap e709: 8 total, 8 up, 8 in 2021-10-08T19:41:15.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:15.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-142"}]: dispatch 2021-10-08T19:41:16.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:16 smithi157 ceph-mon[32847]: osdmap e710: 8 total, 8 up, 8 in 2021-10-08T19:41:16.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:16 smithi157 ceph-mon[42114]: osdmap e710: 8 total, 8 up, 8 in 2021-10-08T19:41:16.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:16 smithi196 ceph-mon[34258]: osdmap e710: 8 total, 8 up, 8 in 2021-10-08T19:41:17.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:17 smithi157 ceph-mon[32847]: pgmap v1117: 172 pgs: 172 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:41:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:17 smithi157 ceph-mon[32847]: osdmap e711: 8 total, 8 up, 8 in 2021-10-08T19:41:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:17.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:17 smithi157 ceph-mon[42114]: pgmap v1117: 172 pgs: 172 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:41:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:17 smithi157 ceph-mon[42114]: osdmap e711: 8 total, 8 up, 8 in 2021-10-08T19:41:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:17.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:17 smithi196 ceph-mon[34258]: pgmap v1117: 172 pgs: 172 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:41:17.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:17 smithi196 ceph-mon[34258]: osdmap e711: 8 total, 8 up, 8 in 2021-10-08T19:41:17.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:17.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:17] "GET /metrics HTTP/1.1" 200 157716 "" "Prometheus/2.18.1" 2021-10-08T19:41:17.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:41:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:41:18.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-144","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:18.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:18 smithi157 ceph-mon[42114]: osdmap e712: 8 total, 8 up, 8 in 2021-10-08T19:41:18.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:18.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-144","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:18.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:18 smithi157 ceph-mon[32847]: osdmap e712: 8 total, 8 up, 8 in 2021-10-08T19:41:18.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:18.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-144","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:18 smithi196 ceph-mon[34258]: osdmap e712: 8 total, 8 up, 8 in 2021-10-08T19:41:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:19.026 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:41:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:19.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[32847]: pgmap v1120: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[32847]: osdmap e713: 8 total, 8 up, 8 in 2021-10-08T19:41:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-144"}]: dispatch 2021-10-08T19:41:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[42114]: pgmap v1120: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:19.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[42114]: osdmap e713: 8 total, 8 up, 8 in 2021-10-08T19:41:19.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-144"}]: dispatch 2021-10-08T19:41:19.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:19 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:19 smithi196 ceph-mon[34258]: pgmap v1120: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:19 smithi196 ceph-mon[34258]: osdmap e713: 8 total, 8 up, 8 in 2021-10-08T19:41:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-144"}]: dispatch 2021-10-08T19:41:20.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-144"}]': finished 2021-10-08T19:41:20.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[32847]: osdmap e714: 8 total, 8 up, 8 in 2021-10-08T19:41:20.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-144", "mode": "writeback"}]: dispatch 2021-10-08T19:41:20.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:20.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-144", "mode": "writeback"}]': finished 2021-10-08T19:41:20.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-144"}]': finished 2021-10-08T19:41:20.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[42114]: osdmap e714: 8 total, 8 up, 8 in 2021-10-08T19:41:20.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-144", "mode": "writeback"}]: dispatch 2021-10-08T19:41:20.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:20.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:20 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-144", "mode": "writeback"}]': finished 2021-10-08T19:41:20.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi157-88568-109", "overlaypool": "test-rados-api-smithi157-88568-144"}]': finished 2021-10-08T19:41:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:20 smithi196 ceph-mon[34258]: osdmap e714: 8 total, 8 up, 8 in 2021-10-08T19:41:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-144", "mode": "writeback"}]: dispatch 2021-10-08T19:41:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:20 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:20 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi157-88568-144", "mode": "writeback"}]': finished 2021-10-08T19:41:21.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:21 smithi157 ceph-mon[32847]: pgmap v1123: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:21 smithi157 ceph-mon[32847]: osdmap e715: 8 total, 8 up, 8 in 2021-10-08T19:41:21.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:21 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:21.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:21 smithi157 ceph-mon[42114]: pgmap v1123: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:21.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:21 smithi157 ceph-mon[42114]: osdmap e715: 8 total, 8 up, 8 in 2021-10-08T19:41:21.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:21 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:21.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:21 smithi196 ceph-mon[34258]: pgmap v1123: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:21.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:21 smithi196 ceph-mon[34258]: osdmap e715: 8 total, 8 up, 8 in 2021-10-08T19:41:21.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:21 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:22.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:41:22.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:22 smithi157 ceph-mon[32847]: osdmap e716: 8 total, 8 up, 8 in 2021-10-08T19:41:22.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:22 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:22.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:22 smithi157 ceph-mon[32847]: pgmap v1126: 204 pgs: 204 active+clean; 4.4 MiB data, 494 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2021-10-08T19:41:22.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:41:22.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:22 smithi157 ceph-mon[42114]: osdmap e716: 8 total, 8 up, 8 in 2021-10-08T19:41:22.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:22 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:22.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:22 smithi157 ceph-mon[42114]: pgmap v1126: 204 pgs: 204 active+clean; 4.4 MiB data, 494 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2021-10-08T19:41:22.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:41:22.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:22 smithi196 ceph-mon[34258]: osdmap e716: 8 total, 8 up, 8 in 2021-10-08T19:41:22.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:22 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:22.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:22 smithi196 ceph-mon[34258]: pgmap v1126: 204 pgs: 204 active+clean; 4.4 MiB data, 494 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2021-10-08T19:41:23.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:41:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:23 smithi157 ceph-mon[32847]: osdmap e717: 8 total, 8 up, 8 in 2021-10-08T19:41:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:23 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:23.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:41:23.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:23 smithi157 ceph-mon[42114]: osdmap e717: 8 total, 8 up, 8 in 2021-10-08T19:41:23.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:23 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:23.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:41:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:23 smithi196 ceph-mon[34258]: osdmap e717: 8 total, 8 up, 8 in 2021-10-08T19:41:23.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:23 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:23.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:23.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:23.533Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:41:24.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:24.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:41:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[32847]: osdmap e718: 8 total, 8 up, 8 in 2021-10-08T19:41:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:41:24.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[32847]: pgmap v1129: 204 pgs: 204 active+clean; 4.4 MiB data, 494 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2021-10-08T19:41:24.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:24.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:41:24.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[42114]: osdmap e718: 8 total, 8 up, 8 in 2021-10-08T19:41:24.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:41:24.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:24 smithi157 ceph-mon[42114]: pgmap v1129: 204 pgs: 204 active+clean; 4.4 MiB data, 494 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2021-10-08T19:41:24.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:24 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:41:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:24 smithi196 ceph-mon[34258]: osdmap e718: 8 total, 8 up, 8 in 2021-10-08T19:41:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:24 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:41:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:24 smithi196 ceph-mon[34258]: pgmap v1129: 204 pgs: 204 active+clean; 4.4 MiB data, 494 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2021-10-08T19:41:25.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:41:25.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[32847]: osdmap e719: 8 total, 8 up, 8 in 2021-10-08T19:41:25.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:41:25.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:41:25.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[32847]: osdmap e720: 8 total, 8 up, 8 in 2021-10-08T19:41:25.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:41:25.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[42114]: osdmap e719: 8 total, 8 up, 8 in 2021-10-08T19:41:25.336 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:41:25.337 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:41:25.338 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:25 smithi157 ceph-mon[42114]: osdmap e720: 8 total, 8 up, 8 in 2021-10-08T19:41:25.346 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:41:25.347 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:25 smithi196 ceph-mon[34258]: osdmap e719: 8 total, 8 up, 8 in 2021-10-08T19:41:25.347 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:41:25.348 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:25 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-144","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:41:25.348 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:25 smithi196 ceph-mon[34258]: osdmap e720: 8 total, 8 up, 8 in 2021-10-08T19:41:26.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:26 smithi157 ceph-mon[32847]: pgmap v1132: 204 pgs: 204 active+clean; 4.4 MiB data, 494 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:26.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:26 smithi157 ceph-mon[42114]: pgmap v1132: 204 pgs: 204 active+clean; 4.4 MiB data, 494 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:26.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:26 smithi196 ceph-mon[34258]: pgmap v1132: 204 pgs: 204 active+clean; 4.4 MiB data, 494 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:27.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:27 smithi157 ceph-mon[32847]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:41:27.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:27 smithi157 ceph-mon[42114]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:41:27.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:27 smithi196 ceph-mon[34258]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:41:27.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:27] "GET /metrics HTTP/1.1" 200 157714 "" "Prometheus/2.18.1" 2021-10-08T19:41:27.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:41:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:41:28.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:28 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:28.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:28 smithi157 ceph-mon[32847]: pgmap v1133: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 870 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:28.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:28 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:28.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:28 smithi157 ceph-mon[42114]: pgmap v1133: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 870 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:28.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:28 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:28.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:28 smithi196 ceph-mon[34258]: pgmap v1133: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 870 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:29.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:41:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:31.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:30 smithi157 ceph-mon[32847]: pgmap v1134: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 743 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:31.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:30 smithi157 ceph-mon[42114]: pgmap v1134: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 743 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:31.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:30 smithi196 ceph-mon[34258]: pgmap v1134: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 743 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:31.529 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:31 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:41:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:31.530 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:31 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:41:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:32.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:41:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:41:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:41:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:41:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:41:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:41:32.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:41:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: poll took 540153.003 ms: 1 events 2021-10-08T19:41:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:32 smithi196 ceph-mon[34258]: pgmap v1135: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:32.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:41:32.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:41:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:32.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:41:32.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:41:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:32.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:41:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:41:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:41:32.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: poll took 540153.003 ms: 1 events 2021-10-08T19:41:32.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[42114]: pgmap v1135: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:32.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:41:32.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:41:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:32.584 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.585 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:41:32.585 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:41:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:32.586 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:41:32.586 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:41:32.586 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:41:32.586 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: poll took 540153.003 ms: 1 events 2021-10-08T19:41:32.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:32.587 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:32 smithi157 ceph-mon[32847]: pgmap v1135: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:33.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:33.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:33.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:33.533Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:41:35.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:34 smithi157 ceph-mon[42114]: pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:34 smithi157 ceph-mon[32847]: pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:35.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:34 smithi196 ceph-mon[34258]: pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:36.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:36.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:37.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[32847]: pgmap v1137: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 941 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:37.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[32847]: osdmap e721: 8 total, 8 up, 8 in 2021-10-08T19:41:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144"}]: dispatch 2021-10-08T19:41:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:37.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[42114]: pgmap v1137: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 941 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[42114]: osdmap e721: 8 total, 8 up, 8 in 2021-10-08T19:41:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144"}]: dispatch 2021-10-08T19:41:37.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:37.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:37.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:37.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:36 smithi196 ceph-mon[34258]: pgmap v1137: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 941 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:41:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:37.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:36 smithi196 ceph-mon[34258]: osdmap e721: 8 total, 8 up, 8 in 2021-10-08T19:41:37.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144"}]: dispatch 2021-10-08T19:41:37.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:37.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:37.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:37.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:37.830 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:37] "GET /metrics HTTP/1.1" 200 157737 "" "Prometheus/2.18.1" 2021-10-08T19:41:37.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:41:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:41:38.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144"}]': finished 2021-10-08T19:41:38.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:37 smithi157 ceph-mon[32847]: osdmap e722: 8 total, 8 up, 8 in 2021-10-08T19:41:38.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:38.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:37 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144"}]: dispatch 2021-10-08T19:41:38.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144"}]': finished 2021-10-08T19:41:38.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:37 smithi157 ceph-mon[42114]: osdmap e722: 8 total, 8 up, 8 in 2021-10-08T19:41:38.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:38.335 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:37 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144"}]: dispatch 2021-10-08T19:41:38.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144"}]': finished 2021-10-08T19:41:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:37 smithi196 ceph-mon[34258]: osdmap e722: 8 total, 8 up, 8 in 2021-10-08T19:41:38.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:38.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:37 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-144"}]: dispatch 2021-10-08T19:41:38.997 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:41:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[32847]: pgmap v1140: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:41:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[32847]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:41:39.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[32847]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:41:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[32847]: osdmap e723: 8 total, 8 up, 8 in 2021-10-08T19:41:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:39.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[42114]: pgmap v1140: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:41:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[42114]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:41:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[42114]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:41:39.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:38 smithi157 ceph-mon[42114]: osdmap e723: 8 total, 8 up, 8 in 2021-10-08T19:41:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:38 smithi196 ceph-mon[34258]: pgmap v1140: 204 pgs: 204 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:41:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:38 smithi196 ceph-mon[34258]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:41:39.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:38 smithi196 ceph-mon[34258]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:41:39.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:38 smithi196 ceph-mon[34258]: osdmap e723: 8 total, 8 up, 8 in 2021-10-08T19:41:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:40 smithi157 ceph-mon[32847]: osdmap e724: 8 total, 8 up, 8 in 2021-10-08T19:41:40.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:40 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:40 smithi157 ceph-mon[42114]: osdmap e724: 8 total, 8 up, 8 in 2021-10-08T19:41:40.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:40 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:40.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:40 smithi196 ceph-mon[34258]: osdmap e724: 8 total, 8 up, 8 in 2021-10-08T19:41:40.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:40 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:41 smithi157 ceph-mon[32847]: pgmap v1143: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:41:41.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-146","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:41.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:41 smithi157 ceph-mon[32847]: osdmap e725: 8 total, 8 up, 8 in 2021-10-08T19:41:41.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:41 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:41.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:41 smithi157 ceph-mon[42114]: pgmap v1143: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:41:41.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-146","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:41.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:41 smithi157 ceph-mon[42114]: osdmap e725: 8 total, 8 up, 8 in 2021-10-08T19:41:41.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:41 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:41.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:41 smithi196 ceph-mon[34258]: pgmap v1143: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:41:41.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-146","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:41 smithi196 ceph-mon[34258]: osdmap e725: 8 total, 8 up, 8 in 2021-10-08T19:41:41.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:41 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:42.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:42 smithi157 ceph-mon[32847]: osdmap e726: 8 total, 8 up, 8 in 2021-10-08T19:41:42.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:42 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146"}]: dispatch 2021-10-08T19:41:42.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:42.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:42 smithi157 ceph-mon[42114]: osdmap e726: 8 total, 8 up, 8 in 2021-10-08T19:41:42.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:42 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146"}]: dispatch 2021-10-08T19:41:42.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:42 smithi196 ceph-mon[34258]: osdmap e726: 8 total, 8 up, 8 in 2021-10-08T19:41:42.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:42 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146"}]: dispatch 2021-10-08T19:41:43.533 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[32847]: pgmap v1146: 204 pgs: 204 active+clean; 4.4 MiB data, 485 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:41:43.533 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146"}]': finished 2021-10-08T19:41:43.534 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[32847]: osdmap e727: 8 total, 8 up, 8 in 2021-10-08T19:41:43.534 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:43.534 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146"}]: dispatch 2021-10-08T19:41:43.534 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[42114]: pgmap v1146: 204 pgs: 204 active+clean; 4.4 MiB data, 485 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:41:43.535 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146"}]': finished 2021-10-08T19:41:43.535 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[42114]: osdmap e727: 8 total, 8 up, 8 in 2021-10-08T19:41:43.535 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:43.535 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:43 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146"}]: dispatch 2021-10-08T19:41:43.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:43 smithi196 ceph-mon[34258]: pgmap v1146: 204 pgs: 204 active+clean; 4.4 MiB data, 485 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:41:43.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146"}]': finished 2021-10-08T19:41:43.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:43 smithi196 ceph-mon[34258]: osdmap e727: 8 total, 8 up, 8 in 2021-10-08T19:41:43.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:43.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:43 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-146"}]: dispatch 2021-10-08T19:41:43.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:43.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:43.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:43.534Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:41:44.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:44 smithi157 ceph-mon[32847]: osdmap e728: 8 total, 8 up, 8 in 2021-10-08T19:41:44.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:44 smithi157 ceph-mon[32847]: pgmap v1149: 172 pgs: 172 active+clean; 4.4 MiB data, 485 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:41:44.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:44 smithi157 ceph-mon[32847]: osdmap e729: 8 total, 8 up, 8 in 2021-10-08T19:41:44.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:44 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:44.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:44 smithi157 ceph-mon[42114]: osdmap e728: 8 total, 8 up, 8 in 2021-10-08T19:41:44.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:44 smithi157 ceph-mon[42114]: pgmap v1149: 172 pgs: 172 active+clean; 4.4 MiB data, 485 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:41:44.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:44 smithi157 ceph-mon[42114]: osdmap e729: 8 total, 8 up, 8 in 2021-10-08T19:41:44.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:44 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:44.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:44 smithi196 ceph-mon[34258]: osdmap e728: 8 total, 8 up, 8 in 2021-10-08T19:41:44.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:44 smithi196 ceph-mon[34258]: pgmap v1149: 172 pgs: 172 active+clean; 4.4 MiB data, 485 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:41:44.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:44 smithi196 ceph-mon[34258]: osdmap e729: 8 total, 8 up, 8 in 2021-10-08T19:41:44.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:44 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:45.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[32847]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:41:45.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-148","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:45.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[32847]: osdmap e730: 8 total, 8 up, 8 in 2021-10-08T19:41:45.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:45.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-148"}]: dispatch 2021-10-08T19:41:45.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[42114]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:41:45.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-148","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:45.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[42114]: osdmap e730: 8 total, 8 up, 8 in 2021-10-08T19:41:45.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:45.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:45 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-148"}]: dispatch 2021-10-08T19:41:45.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:45 smithi196 ceph-mon[34258]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:41:45.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-148","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:45.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:45 smithi196 ceph-mon[34258]: osdmap e730: 8 total, 8 up, 8 in 2021-10-08T19:41:45.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:45.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:45 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-148"}]: dispatch 2021-10-08T19:41:46.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:46 smithi157 ceph-mon[32847]: pgmap v1152: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 485 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:46.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:46 smithi157 ceph-mon[32847]: osdmap e731: 8 total, 8 up, 8 in 2021-10-08T19:41:46.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:46 smithi157 ceph-mon[42114]: pgmap v1152: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 485 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:46.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:46 smithi157 ceph-mon[42114]: osdmap e731: 8 total, 8 up, 8 in 2021-10-08T19:41:46.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:46 smithi196 ceph-mon[34258]: pgmap v1152: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 485 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:46.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:46 smithi196 ceph-mon[34258]: osdmap e731: 8 total, 8 up, 8 in 2021-10-08T19:41:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:47] "GET /metrics HTTP/1.1" 200 157737 "" "Prometheus/2.18.1" 2021-10-08T19:41:47.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:41:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:41:48.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:48 smithi157 ceph-mon[42114]: osdmap e732: 8 total, 8 up, 8 in 2021-10-08T19:41:48.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:48 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:48.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:48 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:48.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:48 smithi157 ceph-mon[42114]: pgmap v1155: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:41:48.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:48 smithi157 ceph-mon[32847]: osdmap e732: 8 total, 8 up, 8 in 2021-10-08T19:41:48.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:48 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:48.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:48 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:48.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:48 smithi157 ceph-mon[32847]: pgmap v1155: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:41:48.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:48 smithi196 ceph-mon[34258]: osdmap e732: 8 total, 8 up, 8 in 2021-10-08T19:41:48.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:48 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:48.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:48 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:48.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:48 smithi196 ceph-mon[34258]: pgmap v1155: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:41:49.041 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:41:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:49.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-150","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:49 smithi157 ceph-mon[32847]: osdmap e733: 8 total, 8 up, 8 in 2021-10-08T19:41:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:49 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-150"}]: dispatch 2021-10-08T19:41:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-150","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:49 smithi157 ceph-mon[42114]: osdmap e733: 8 total, 8 up, 8 in 2021-10-08T19:41:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:49 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-150"}]: dispatch 2021-10-08T19:41:49.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-150","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:49 smithi196 ceph-mon[34258]: osdmap e733: 8 total, 8 up, 8 in 2021-10-08T19:41:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:49 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-150"}]: dispatch 2021-10-08T19:41:50.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:50 smithi157 ceph-mon[32847]: osdmap e734: 8 total, 8 up, 8 in 2021-10-08T19:41:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:50 smithi157 ceph-mon[32847]: pgmap v1158: 172 pgs: 172 active+clean; 4.4 MiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:41:50.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:50 smithi157 ceph-mon[42114]: osdmap e734: 8 total, 8 up, 8 in 2021-10-08T19:41:50.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:50 smithi157 ceph-mon[42114]: pgmap v1158: 172 pgs: 172 active+clean; 4.4 MiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:41:50.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:50 smithi196 ceph-mon[34258]: osdmap e734: 8 total, 8 up, 8 in 2021-10-08T19:41:50.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:50 smithi196 ceph-mon[34258]: pgmap v1158: 172 pgs: 172 active+clean; 4.4 MiB data, 487 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:41:51.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:51 smithi157 ceph-mon[32847]: osdmap e735: 8 total, 8 up, 8 in 2021-10-08T19:41:51.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:51.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:51 smithi157 ceph-mon[42114]: osdmap e735: 8 total, 8 up, 8 in 2021-10-08T19:41:51.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:51.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:51 smithi196 ceph-mon[34258]: osdmap e735: 8 total, 8 up, 8 in 2021-10-08T19:41:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:52.070 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-152","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:52.070 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[32847]: osdmap e736: 8 total, 8 up, 8 in 2021-10-08T19:41:52.070 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-109","var": "dedup_tier","val": "test-rados-api-smithi157-88568-152"}]: dispatch 2021-10-08T19:41:52.071 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:52.071 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-152"}]: dispatch 2021-10-08T19:41:52.071 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[32847]: pgmap v1161: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2021-10-08T19:41:52.072 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-152","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:52.072 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[42114]: osdmap e736: 8 total, 8 up, 8 in 2021-10-08T19:41:52.072 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-109","var": "dedup_tier","val": "test-rados-api-smithi157-88568-152"}]: dispatch 2021-10-08T19:41:52.072 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:52.072 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-152"}]: dispatch 2021-10-08T19:41:52.073 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:52 smithi157 ceph-mon[42114]: pgmap v1161: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2021-10-08T19:41:52.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi157-88568-152","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:52.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:52 smithi196 ceph-mon[34258]: osdmap e736: 8 total, 8 up, 8 in 2021-10-08T19:41:52.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi157-88568-109","var": "dedup_tier","val": "test-rados-api-smithi157-88568-152"}]: dispatch 2021-10-08T19:41:52.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:52.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:52 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi157-88568-109", "tierpool": "test-rados-api-smithi157-88568-152"}]: dispatch 2021-10-08T19:41:52.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:52 smithi196 ceph-mon[34258]: pgmap v1161: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2021-10-08T19:41:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:53 smithi157 ceph-mon[32847]: osdmap e737: 8 total, 8 up, 8 in 2021-10-08T19:41:53.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:53 smithi157 ceph-mon[42114]: osdmap e737: 8 total, 8 up, 8 in 2021-10-08T19:41:53.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:53 smithi196 ceph-mon[34258]: osdmap e737: 8 total, 8 up, 8 in 2021-10-08T19:41:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:53.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:53.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:41:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:41:53.534Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:41:54.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[32847]: osdmap e738: 8 total, 8 up, 8 in 2021-10-08T19:41:54.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:54.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[32847]: pgmap v1164: 164 pgs: 164 active+clean; 582 KiB data, 489 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:54.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:54.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[32847]: osdmap e739: 8 total, 8 up, 8 in 2021-10-08T19:41:54.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:54.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[42114]: osdmap e738: 8 total, 8 up, 8 in 2021-10-08T19:41:54.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:54.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[42114]: pgmap v1164: 164 pgs: 164 active+clean; 582 KiB data, 489 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:54.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:54.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[42114]: osdmap e739: 8 total, 8 up, 8 in 2021-10-08T19:41:54.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:54 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:54.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:54 smithi196 ceph-mon[34258]: osdmap e738: 8 total, 8 up, 8 in 2021-10-08T19:41:54.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:54.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:54 smithi196 ceph-mon[34258]: pgmap v1164: 164 pgs: 164 active+clean; 582 KiB data, 489 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:54.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:54.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:54 smithi196 ceph-mon[34258]: osdmap e739: 8 total, 8 up, 8 in 2021-10-08T19:41:54.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:54 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-109"}]: dispatch 2021-10-08T19:41:55.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2021-10-08T19:41:55.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8030 ms) 2021-10-08T19:41:55.083 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2021-10-08T19:41:55.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13078 ms) 2021-10-08T19:41:55.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2021-10-08T19:41:55.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7735 ms) 2021-10-08T19:41:55.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2021-10-08T19:41:55.084 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8050 ms) 2021-10-08T19:41:55.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2021-10-08T19:41:55.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: hmm, no HitSet yet 2021-10-08T19:41:55.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: ok, hit_set contains 247:602f83fe:::foo:head 2021-10-08T19:41:55.085 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9032 ms) 2021-10-08T19:41:55.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2021-10-08T19:41:55.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,0 2021-10-08T19:41:55.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: first is 1633722029 2021-10-08T19:41:55.086 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,0 2021-10-08T19:41:55.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,0 2021-10-08T19:41:55.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,1633722031,1633722032,0 2021-10-08T19:41:55.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,1633722031,1633722032,0 2021-10-08T19:41:55.087 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,1633722031,1633722032,0 2021-10-08T19:41:55.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,1633722031,1633722032,1633722034,1633722035,0 2021-10-08T19:41:55.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,1633722031,1633722032,1633722034,1633722035,0 2021-10-08T19:41:55.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,1633722031,1633722032,1633722034,1633722035,0 2021-10-08T19:41:55.088 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,1633722031,1633722032,1633722034,1633722035,1633722037,1633722038,0 2021-10-08T19:41:55.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,1633722031,1633722032,1633722034,1633722035,1633722037,1633722038,0 2021-10-08T19:41:55.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722029,1633722031,1633722032,1633722034,1633722035,1633722037,1633722038,0 2021-10-08T19:41:55.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: got ls 1633722032,1633722034,1633722035,1633722037,1633722038,1633722040,1633722041,0 2021-10-08T19:41:55.089 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: first now 1633722032, trimmed 2021-10-08T19:41:55.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20995 ms) 2021-10-08T19:41:55.090 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2021-10-08T19:41:55.091 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: foo0 2021-10-08T19:41:55.091 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: verifying foo0 is eventually promoted 2021-10-08T19:41:55.091 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (15057 ms) 2021-10-08T19:41:55.092 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2021-10-08T19:41:55.092 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (17252 ms) 2021-10-08T19:41:55.092 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2021-10-08T19:41:55.092 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (23005 ms) 2021-10-08T19:41:55.093 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2021-10-08T19:41:55.093 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5028 ms) 2021-10-08T19:41:55.093 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2021-10-08T19:41:55.093 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3004 ms) 2021-10-08T19:41:55.093 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2021-10-08T19:41:55.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3014 ms) 2021-10-08T19:41:55.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2021-10-08T19:41:55.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3021 ms) 2021-10-08T19:41:55.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (232135 ms total) 2021-10-08T19:41:55.094 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: 2021-10-08T19:41:55.095 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [----------] Global test environment tear-down 2021-10-08T19:41:55.095 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [==========] 76 tests from 4 test suites ran. (847198 ms total) 2021-10-08T19:41:55.095 INFO:tasks.workunit.client.0.smithi157.stdout: api_tier_pp: [ PASSED ] 76 tests. 2021-10-08T19:41:55.096 INFO:tasks.workunit.client.0.smithi157.stderr:+ exit 0 2021-10-08T19:41:55.096 INFO:tasks.workunit.client.0.smithi157.stderr:+ cleanup 2021-10-08T19:41:55.096 INFO:tasks.workunit.client.0.smithi157.stderr:+ pkill -P 88478 2021-10-08T19:41:55.112 INFO:tasks.workunit.client.0.smithi157.stderr:+ true 2021-10-08T19:41:55.114 INFO:teuthology.orchestra.run:Running command with timeout 3600 2021-10-08T19:41:55.117 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2021-10-08T19:41:55.149 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2021-10-08T19:41:55.150 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2021-10-08T19:41:55.151 DEBUG:teuthology.orchestra.run.smithi157:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2021-10-08T19:41:55.210 INFO:tasks.workunit.client.0.smithi157.stderr:++ uuidgen 2021-10-08T19:41:55.225 INFO:tasks.workunit.client.0.smithi157.stderr:+ p=96ef6666-8683-4159-9a16-d5ae4e1d0495 2021-10-08T19:41:55.226 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool create 96ef6666-8683-4159-9a16-d5ae4e1d0495 12 2021-10-08T19:41:55.338 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 -- 172.21.15.157:0/1311846734 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe600fe620 msgr2=0x7efe600fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:55.338 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 --2- 172.21.15.157:0/1311846734 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe600fe620 0x7efe600fe9f0 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7efe500046e0 tx=0x7efe50009b30 comp rx=0 tx=0).stop 2021-10-08T19:41:55.339 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 -- 172.21.15.157:0/1311846734 shutdown_connections 2021-10-08T19:41:55.339 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 --2- 172.21.15.157:0/1311846734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe600f8d90 0x7efe601053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:55.339 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 --2- 172.21.15.157:0/1311846734 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe600fe620 0x7efe600fe9f0 unknown :-1 s=CLOSED pgs=2686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:55.339 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 --2- 172.21.15.157:0/1311846734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe600fef30 0x7efe600f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:55.340 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 -- 172.21.15.157:0/1311846734 >> 172.21.15.157:0/1311846734 conn(0x7efe6006f3b0 msgr2=0x7efe600f6720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:41:55.340 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 -- 172.21.15.157:0/1311846734 shutdown_connections 2021-10-08T19:41:55.340 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 -- 172.21.15.157:0/1311846734 wait complete. 2021-10-08T19:41:55.340 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 Processor -- start 2021-10-08T19:41:55.340 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 -- start start 2021-10-08T19:41:55.341 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe600f8d90 0x7efe6010e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:55.341 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe600fe620 0x7efe6010eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:55.341 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe600fef30 0x7efe60108a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:55.341 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe60109050 con 0x7efe600f8d90 2021-10-08T19:41:55.342 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe601091c0 con 0x7efe600fe620 2021-10-08T19:41:55.342 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.334+0000 7efe686f1700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe60109380 con 0x7efe600fef30 2021-10-08T19:41:55.342 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe6648d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe600f8d90 0x7efe6010e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:55.342 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe6648d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe600f8d90 0x7efe6010e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50682/0 (socket says 172.21.15.157:50682) 2021-10-08T19:41:55.343 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe6648d700 1 -- 172.21.15.157:0/1247559415 learned_addr learned my addr 172.21.15.157:0/1247559415 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:41:55.343 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe66c8e700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe600fef30 0x7efe60108a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:55.343 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe6648d700 1 -- 172.21.15.157:0/1247559415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe600fef30 msgr2=0x7efe60108a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:55.343 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe6648d700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe600fef30 0x7efe60108a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:55.344 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe65c8c700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe600fe620 0x7efe6010eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:55.344 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe6648d700 1 -- 172.21.15.157:0/1247559415 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe600fe620 msgr2=0x7efe6010eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:55.344 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe6648d700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe600fe620 0x7efe6010eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:55.344 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe6648d700 1 -- 172.21.15.157:0/1247559415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c005040 con 0x7efe600f8d90 2021-10-08T19:41:55.345 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe66c8e700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe600fef30 0x7efe60108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:41:55.345 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe65c8c700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe600fe620 0x7efe6010eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:41:55.345 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe6648d700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe600f8d90 0x7efe6010e9b0 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7efe500148e0 tx=0x7efe50009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:41:55.345 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe56ffd700 1 -- 172.21.15.157:0/1247559415 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5001a070 con 0x7efe600f8d90 2021-10-08T19:41:55.345 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe56ffd700 1 -- 172.21.15.157:0/1247559415 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7efe50007920 con 0x7efe600f8d90 2021-10-08T19:41:55.346 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe50005040 con 0x7efe600f8d90 2021-10-08T19:41:55.346 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe56ffd700 1 -- 172.21.15.157:0/1247559415 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5001f630 con 0x7efe600f8d90 2021-10-08T19:41:55.346 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.335+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe601157b0 con 0x7efe600f8d90 2021-10-08T19:41:55.346 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.336+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6005fc40 con 0x7efe600f8d90 2021-10-08T19:41:55.347 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.337+0000 7efe56ffd700 1 -- 172.21.15.157:0/1247559415 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7efe50009320 con 0x7efe600f8d90 2021-10-08T19:41:55.347 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.337+0000 7efe56ffd700 1 --2- 172.21.15.157:0/1247559415 >> v2:172.21.15.157:6800/1475557172 conn(0x7efe4c0634f0 0x7efe4c0659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:55.347 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.337+0000 7efe56ffd700 1 -- 172.21.15.157:0/1247559415 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(740..740 src has 1..740) v4 ==== 7241+0+0 (secure 0 0 0) 0x7efe50080f90 con 0x7efe600f8d90 2021-10-08T19:41:55.347 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.337+0000 7efe65c8c700 1 --2- 172.21.15.157:0/1247559415 >> v2:172.21.15.157:6800/1475557172 conn(0x7efe4c0634f0 0x7efe4c0659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:55.348 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.337+0000 7efe65c8c700 1 --2- 172.21.15.157:0/1247559415 >> v2:172.21.15.157:6800/1475557172 conn(0x7efe4c0634f0 0x7efe4c0659a0 secure :-1 s=READY pgs=3286 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009da0 tx=0x7efe5c009b30 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:41:55.348 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.341+0000 7efe56ffd700 1 -- 172.21.15.157:0/1247559415 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7efe50053780 con 0x7efe600f8d90 2021-10-08T19:41:55.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:55 smithi196 ceph-mon[34258]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:41:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:55 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:55.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:55 smithi196 ceph-mon[34258]: osdmap e740: 8 total, 8 up, 8 in 2021-10-08T19:41:55.530 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:55.529+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12} v 0) v1 -- 0x7efe60109f90 con 0x7efe600f8d90 2021-10-08T19:41:55.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:55 smithi157 ceph-mon[32847]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:41:55.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:55 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:55.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:55 smithi157 ceph-mon[32847]: osdmap e740: 8 total, 8 up, 8 in 2021-10-08T19:41:55.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:55 smithi157 ceph-mon[42114]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:41:55.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:55 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2919613935' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi157-88568-109"}]': finished 2021-10-08T19:41:55.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:55 smithi157 ceph-mon[42114]: osdmap e740: 8 total, 8 up, 8 in 2021-10-08T19:41:56.090 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.089+0000 7efe56ffd700 1 -- 172.21.15.157:0/1247559415 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]=0 pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' created v741) v1 ==== 176+0+0 (secure 0 0 0) 0x7efe50053370 con 0x7efe600f8d90 2021-10-08T19:41:56.207 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.205+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12} v 0) v1 -- 0x7efe60115940 con 0x7efe600f8d90 2021-10-08T19:41:56.207 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.206+0000 7efe56ffd700 1 -- 172.21.15.157:0/1247559415 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]=0 pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' already exists v741) v1 ==== 183+0+0 (secure 0 0 0) 0x7efe50053550 con 0x7efe600f8d90 2021-10-08T19:41:56.209 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 >> v2:172.21.15.157:6800/1475557172 conn(0x7efe4c0634f0 msgr2=0x7efe4c0659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:56.210 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 --2- 172.21.15.157:0/1247559415 >> v2:172.21.15.157:6800/1475557172 conn(0x7efe4c0634f0 0x7efe4c0659a0 secure :-1 s=READY pgs=3286 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009da0 tx=0x7efe5c009b30 comp rx=0 tx=0).stop 2021-10-08T19:41:56.210 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe600f8d90 msgr2=0x7efe6010e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:56.210 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe600f8d90 0x7efe6010e9b0 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7efe500148e0 tx=0x7efe50009b30 comp rx=0 tx=0).stop 2021-10-08T19:41:56.211 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 shutdown_connections 2021-10-08T19:41:56.211 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 --2- 172.21.15.157:0/1247559415 >> v2:172.21.15.157:6800/1475557172 conn(0x7efe4c0634f0 0x7efe4c0659a0 unknown :-1 s=CLOSED pgs=3286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:56.211 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe600fef30 0x7efe60108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:56.211 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe600f8d90 0x7efe6010e9b0 unknown :-1 s=CLOSED pgs=2639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:56.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 --2- 172.21.15.157:0/1247559415 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe600fe620 0x7efe6010eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:56.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 >> 172.21.15.157:0/1247559415 conn(0x7efe6006f3b0 msgr2=0x7efe600703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:41:56.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 shutdown_connections 2021-10-08T19:41:56.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.208+0000 7efe686f1700 1 -- 172.21.15.157:0/1247559415 wait complete. 2021-10-08T19:41:56.212 INFO:tasks.workunit.client.0.smithi157.stderr:pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' already exists 2021-10-08T19:41:56.220 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool set-quota 96ef6666-8683-4159-9a16-d5ae4e1d0495 max_objects 10 2021-10-08T19:41:56.325 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.320+0000 7f688517a700 1 -- 172.21.15.157:0/4166156771 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68800f7d00 msgr2=0x7f68800f8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:56.325 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.320+0000 7f688517a700 1 --2- 172.21.15.157:0/4166156771 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68800f7d00 0x7f68800f8170 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 crypto rx=0x7f6874004650 tx=0x7f6874009b30 comp rx=0 tx=0).stop 2021-10-08T19:41:56.325 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.320+0000 7f688517a700 1 -- 172.21.15.157:0/4166156771 shutdown_connections 2021-10-08T19:41:56.325 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.320+0000 7f688517a700 1 --2- 172.21.15.157:0/4166156771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68800f86b0 0x7f68801042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:56.326 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.320+0000 7f688517a700 1 --2- 172.21.15.157:0/4166156771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68800fd510 0x7f68800fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:56.326 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.320+0000 7f688517a700 1 --2- 172.21.15.157:0/4166156771 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68800f7d00 0x7f68800f8170 unknown :-1 s=CLOSED pgs=2687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:56.326 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.320+0000 7f688517a700 1 -- 172.21.15.157:0/4166156771 >> 172.21.15.157:0/4166156771 conn(0x7f688006d870 msgr2=0x7f68800f4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:41:56.327 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.320+0000 7f688517a700 1 -- 172.21.15.157:0/4166156771 shutdown_connections 2021-10-08T19:41:56.327 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.320+0000 7f688517a700 1 -- 172.21.15.157:0/4166156771 wait complete. 2021-10-08T19:41:56.327 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f688517a700 1 Processor -- start 2021-10-08T19:41:56.328 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f688517a700 1 -- start start 2021-10-08T19:41:56.329 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f688517a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68800f7d00 0x7f6880109b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:56.329 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f688517a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68800f86b0 0x7f688010a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:56.329 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f688517a700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68800fd510 0x7f6880114ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:56.329 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f688517a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688010a8c0 con 0x7f68800f7d00 2021-10-08T19:41:56.330 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f688517a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801150e0 con 0x7f68800f86b0 2021-10-08T19:41:56.330 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f688517a700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6880115220 con 0x7f68800fd510 2021-10-08T19:41:56.330 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f687ed9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68800f7d00 0x7f6880109b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:56.330 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f687ed9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68800f7d00 0x7f6880109b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50696/0 (socket says 172.21.15.157:50696) 2021-10-08T19:41:56.330 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f687f59e700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68800fd510 0x7f6880114ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:56.331 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f687ed9d700 1 -- 172.21.15.157:0/1117045318 learned_addr learned my addr 172.21.15.157:0/1117045318 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:41:56.331 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f687e59c700 1 --2- 172.21.15.157:0/1117045318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68800f86b0 0x7f688010a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:56.331 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f687f59e700 1 -- 172.21.15.157:0/1117045318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68800f86b0 msgr2=0x7f688010a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:56.331 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.321+0000 7f687f59e700 1 --2- 172.21.15.157:0/1117045318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68800f86b0 0x7f688010a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:56.332 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f687f59e700 1 -- 172.21.15.157:0/1117045318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68800f7d00 msgr2=0x7f6880109b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:56.332 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f687f59e700 1 --2- 172.21.15.157:0/1117045318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68800f7d00 0x7f6880109b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:56.332 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f687f59e700 1 -- 172.21.15.157:0/1117045318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878009640 con 0x7f68800fd510 2021-10-08T19:41:56.332 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f687ed9d700 1 --2- 172.21.15.157:0/1117045318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68800f7d00 0x7f6880109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:41:56.333 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f687f59e700 1 --2- 172.21.15.157:0/1117045318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68800fd510 0x7f6880114ba0 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7f6878001c80 tx=0x7f6878004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:41:56.333 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f68677fe700 1 -- 172.21.15.157:0/1117045318 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780092e0 con 0x7f68800fd510 2021-10-08T19:41:56.333 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f68677fe700 1 -- 172.21.15.157:0/1117045318 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f6878009440 con 0x7f68800fd510 2021-10-08T19:41:56.333 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6874005040 con 0x7f68800fd510 2021-10-08T19:41:56.333 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f68677fe700 1 -- 172.21.15.157:0/1117045318 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878007b80 con 0x7f68800fd510 2021-10-08T19:41:56.334 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.322+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6880115760 con 0x7f68800fd510 2021-10-08T19:41:56.335 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.323+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6880060900 con 0x7f68800fd510 2021-10-08T19:41:56.336 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.323+0000 7f68677fe700 1 -- 172.21.15.157:0/1117045318 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f687801c030 con 0x7f68800fd510 2021-10-08T19:41:56.336 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.324+0000 7f68677fe700 1 --2- 172.21.15.157:0/1117045318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f68680634f0 0x7f68680659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:56.336 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.324+0000 7f687ed9d700 1 --2- 172.21.15.157:0/1117045318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f68680634f0 0x7f68680659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:56.337 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.324+0000 7f68677fe700 1 -- 172.21.15.157:0/1117045318 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(741..741 src has 1..741) v4 ==== 7616+0+0 (secure 0 0 0) 0x7f6878080230 con 0x7f68800fd510 2021-10-08T19:41:56.337 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.324+0000 7f687ed9d700 1 --2- 172.21.15.157:0/1117045318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f68680634f0 0x7f68680659a0 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7f68700041d0 tx=0x7f687000b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:41:56.338 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.329+0000 7f68677fe700 1 -- 172.21.15.157:0/1117045318 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f68780527c0 con 0x7f68800fd510 2021-10-08T19:41:56.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:56 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1247559415' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]: dispatch 2021-10-08T19:41:56.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:56 smithi196 ceph-mon[34258]: pgmap v1167: 164 pgs: 164 active+clean; 582 KiB data, 489 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:56.522 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:56.521+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f68800289c0 con 0x7f68800fd510 2021-10-08T19:41:56.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:56 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1247559415' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]: dispatch 2021-10-08T19:41:56.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:56 smithi157 ceph-mon[32847]: pgmap v1167: 164 pgs: 164 active+clean; 582 KiB data, 489 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:56.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:56 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1247559415' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]: dispatch 2021-10-08T19:41:56.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:56 smithi157 ceph-mon[42114]: pgmap v1167: 164 pgs: 164 active+clean; 582 KiB data, 489 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:57.096 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:57.095+0000 7f68677fe700 1 -- 172.21.15.157:0/1117045318 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v742) v1 ==== 223+0+0 (secure 0 0 0) 0x7f687801a0d0 con 0x7f68800fd510 2021-10-08T19:41:57.206 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:57.206+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f68801069f0 con 0x7f68800fd510 2021-10-08T19:41:57.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:57 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:41:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1247559415' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]': finished 2021-10-08T19:41:57.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[32847]: osdmap e741: 8 total, 8 up, 8 in 2021-10-08T19:41:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1247559415' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]: dispatch 2021-10-08T19:41:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1117045318' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:57.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:41:57.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:41:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:57.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1247559415' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]': finished 2021-10-08T19:41:57.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[42114]: osdmap e741: 8 total, 8 up, 8 in 2021-10-08T19:41:57.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1247559415' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]: dispatch 2021-10-08T19:41:57.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1117045318' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:57.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:57.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:57.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:41:57.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:57 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:41:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:57.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1247559415' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]': finished 2021-10-08T19:41:57.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:57 smithi196 ceph-mon[34258]: osdmap e741: 8 total, 8 up, 8 in 2021-10-08T19:41:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1247559415' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pg_num": 12}]: dispatch 2021-10-08T19:41:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:57 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1117045318' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:57 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:57 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:57.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:57 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:41:57.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:57 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:41:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:57.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:57] "GET /metrics HTTP/1.1" 200 157688 "" "Prometheus/2.18.1" 2021-10-08T19:41:57.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:41:57 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:41:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:57.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:41:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:41:58.098 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.098+0000 7f68677fe700 1 -- 172.21.15.157:0/1117045318 <== mon.1 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v743) v1 ==== 223+0+0 (secure 0 0 0) 0x7f68780523b0 con 0x7f68800fd510 2021-10-08T19:41:58.102 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f68680634f0 msgr2=0x7f68680659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:58.102 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 --2- 172.21.15.157:0/1117045318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f68680634f0 0x7f68680659a0 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7f68700041d0 tx=0x7f687000b040 comp rx=0 tx=0).stop 2021-10-08T19:41:58.102 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68800fd510 msgr2=0x7f6880114ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:58.102 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 --2- 172.21.15.157:0/1117045318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68800fd510 0x7f6880114ba0 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7f6878001c80 tx=0x7f6878004d10 comp rx=0 tx=0).stop 2021-10-08T19:41:58.103 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 shutdown_connections 2021-10-08T19:41:58.103 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 --2- 172.21.15.157:0/1117045318 >> v2:172.21.15.157:6800/1475557172 conn(0x7f68680634f0 0x7f68680659a0 unknown :-1 s=CLOSED pgs=3287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:58.103 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 --2- 172.21.15.157:0/1117045318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68800fd510 0x7f6880114ba0 unknown :-1 s=CLOSED pgs=2688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:58.103 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 --2- 172.21.15.157:0/1117045318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68800f7d00 0x7f6880109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:58.104 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 --2- 172.21.15.157:0/1117045318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68800f86b0 0x7f688010a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:58.104 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.101+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 >> 172.21.15.157:0/1117045318 conn(0x7f688006d870 msgr2=0x7f688006eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:41:58.105 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.103+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 shutdown_connections 2021-10-08T19:41:58.105 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.103+0000 7f688517a700 1 -- 172.21.15.157:0/1117045318 wait complete. 2021-10-08T19:41:58.105 INFO:tasks.workunit.client.0.smithi157.stderr:set-quota max_objects = 10 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 2021-10-08T19:41:58.117 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool application enable 96ef6666-8683-4159-9a16-d5ae4e1d0495 rados 2021-10-08T19:41:58.221 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.218+0000 7f1abd116700 1 -- 172.21.15.157:0/3612654288 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f78a0 msgr2=0x7f1ab80f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:58.222 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.218+0000 7f1abd116700 1 --2- 172.21.15.157:0/3612654288 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f78a0 0x7f1ab80f7c70 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009a60 tx=0x7f1ab0004d10 comp rx=0 tx=0).stop 2021-10-08T19:41:58.222 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.218+0000 7f1abd116700 1 -- 172.21.15.157:0/3612654288 shutdown_connections 2021-10-08T19:41:58.222 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.218+0000 7f1abd116700 1 --2- 172.21.15.157:0/3612654288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80f9790 0x7f1ab81043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:58.222 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.218+0000 7f1abd116700 1 --2- 172.21.15.157:0/3612654288 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f78a0 0x7f1ab80f7c70 unknown :-1 s=CLOSED pgs=2689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:58.223 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.218+0000 7f1abd116700 1 --2- 172.21.15.157:0/3612654288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab80f81b0 0x7f1ab80f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:58.223 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.218+0000 7f1abd116700 1 -- 172.21.15.157:0/3612654288 >> 172.21.15.157:0/3612654288 conn(0x7f1ab806d110 msgr2=0x7f1ab80f5610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:41:58.223 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.218+0000 7f1abd116700 1 -- 172.21.15.157:0/3612654288 shutdown_connections 2021-10-08T19:41:58.223 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.218+0000 7f1abd116700 1 -- 172.21.15.157:0/3612654288 wait complete. 2021-10-08T19:41:58.224 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1abd116700 1 Processor -- start 2021-10-08T19:41:58.224 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1abd116700 1 -- start start 2021-10-08T19:41:58.224 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1abd116700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab80f78a0 0x7f1ab810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:58.225 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1abd116700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f9790 0x7f1ab810ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:58.225 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1abd116700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab8107a60 0x7f1ab8107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:58.225 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1abd116700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8108410 con 0x7f1ab80f78a0 2021-10-08T19:41:58.225 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1abd116700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8108550 con 0x7f1ab8107a60 2021-10-08T19:41:58.225 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1abd116700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8108710 con 0x7f1ab80f9790 2021-10-08T19:41:58.226 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1ab6d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab80f78a0 0x7f1ab810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:58.226 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1ab659c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f9790 0x7f1ab810ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:58.226 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1ab6d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab80f78a0 0x7f1ab810d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50718/0 (socket says 172.21.15.157:50718) 2021-10-08T19:41:58.226 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1ab659c700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f9790 0x7f1ab810ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:59968/0 (socket says 172.21.15.157:59968) 2021-10-08T19:41:58.227 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1ab6d9d700 1 -- 172.21.15.157:0/373282497 learned_addr learned my addr 172.21.15.157:0/373282497 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:41:58.227 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.219+0000 7f1ab759e700 1 --2- 172.21.15.157:0/373282497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab8107a60 0x7f1ab8107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:58.227 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1ab6d9d700 1 -- 172.21.15.157:0/373282497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f9790 msgr2=0x7f1ab810ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:58.228 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1ab6d9d700 1 --2- 172.21.15.157:0/373282497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f9790 0x7f1ab810ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:58.228 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1ab6d9d700 1 -- 172.21.15.157:0/373282497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab8107a60 msgr2=0x7f1ab8107ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:41:58.228 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1ab6d9d700 1 --2- 172.21.15.157:0/373282497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab8107a60 0x7f1ab8107ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:41:58.229 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1ab6d9d700 1 -- 172.21.15.157:0/373282497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0009640 con 0x7f1ab80f78a0 2021-10-08T19:41:58.229 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1ab659c700 1 --2- 172.21.15.157:0/373282497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f9790 0x7f1ab810ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:41:58.229 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1ab6d9d700 1 --2- 172.21.15.157:0/373282497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab80f78a0 0x7f1ab810d990 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0004b70 tx=0x7f1ab0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:41:58.229 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1a9f7fe700 1 -- 172.21.15.157:0/373282497 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000e030 con 0x7f1ab80f78a0 2021-10-08T19:41:58.230 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab8114790 con 0x7f1ab80f78a0 2021-10-08T19:41:58.230 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1a9f7fe700 1 -- 172.21.15.157:0/373282497 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f1ab0004580 con 0x7f1ab80f78a0 2021-10-08T19:41:58.230 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1a9f7fe700 1 -- 172.21.15.157:0/373282497 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab001cb60 con 0x7f1ab80f78a0 2021-10-08T19:41:58.230 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.220+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab8114b90 con 0x7f1ab80f78a0 2021-10-08T19:41:58.230 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.221+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab8060900 con 0x7f1ab80f78a0 2021-10-08T19:41:58.231 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.221+0000 7f1a9f7fe700 1 -- 172.21.15.157:0/373282497 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f1ab002c070 con 0x7f1ab80f78a0 2021-10-08T19:41:58.231 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.222+0000 7f1a9f7fe700 1 --2- 172.21.15.157:0/373282497 >> v2:172.21.15.157:6800/1475557172 conn(0x7f1aa00634f0 0x7f1aa00659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:41:58.231 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.222+0000 7f1a9f7fe700 1 -- 172.21.15.157:0/373282497 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(743..743 src has 1..743) v4 ==== 7616+0+0 (secure 0 0 0) 0x7f1ab0081fe0 con 0x7f1ab80f78a0 2021-10-08T19:41:58.231 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.222+0000 7f1ab659c700 1 --2- 172.21.15.157:0/373282497 >> v2:172.21.15.157:6800/1475557172 conn(0x7f1aa00634f0 0x7f1aa00659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:41:58.232 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.222+0000 7f1ab659c700 1 --2- 172.21.15.157:0/373282497 >> v2:172.21.15.157:6800/1475557172 conn(0x7f1aa00634f0 0x7f1aa00659a0 secure :-1 s=READY pgs=3288 cs=0 l=1 rev1=1 crypto rx=0x7f1ab81091c0 tx=0x7f1aac00b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:41:58.232 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.226+0000 7f1a9f7fe700 1 -- 172.21.15.157:0/373282497 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1ab0054570 con 0x7f1ab80f78a0 2021-10-08T19:41:58.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:41:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:58 smithi196 ceph-mon[34258]: osdmap e742: 8 total, 8 up, 8 in 2021-10-08T19:41:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:58 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1117045318' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:58 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:58.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:58 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:58 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:58 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:41:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:58 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:41:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:58.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:58 smithi196 ceph-mon[34258]: pgmap v1170: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:58.392 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:58.392+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"} v 0) v1 -- 0x7f1ab81069e0 con 0x7f1ab80f78a0 2021-10-08T19:41:58.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:41:58.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[32847]: osdmap e742: 8 total, 8 up, 8 in 2021-10-08T19:41:58.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1117045318' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:58.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:58.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:58.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:58.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:41:58.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:41:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:58.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[32847]: pgmap v1170: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:58.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:41:58.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[42114]: osdmap e742: 8 total, 8 up, 8 in 2021-10-08T19:41:58.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1117045318' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:58.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:41:58.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:58.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:41:58.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:41:58.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:41:57] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:58.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:58 smithi157 ceph-mon[42114]: pgmap v1170: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:59.104 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:59.105+0000 7f1a9f7fe700 1 -- 172.21.15.157:0/373282497 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]=0 enabled application 'rados' on pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' v744) v1 ==== 213+0+0 (secure 0 0 0) 0x7f1ab00200d0 con 0x7f1ab80f78a0 2021-10-08T19:41:59.110 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:41:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:41:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:59.215 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:41:59.216+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"} v 0) v1 -- 0x7f1ab8108fa0 con 0x7f1ab80f78a0 2021-10-08T19:41:59.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:59 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:41:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:59 smithi196 ceph-mon[34258]: osdmap e743: 8 total, 8 up, 8 in 2021-10-08T19:41:59.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:41:59 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]: dispatch 2021-10-08T19:41:59.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:59 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:41:59.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:59 smithi157 ceph-mon[32847]: osdmap e743: 8 total, 8 up, 8 in 2021-10-08T19:41:59.583 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:41:59 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]: dispatch 2021-10-08T19:41:59.584 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:59 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:41:59.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:59 smithi157 ceph-mon[42114]: osdmap e743: 8 total, 8 up, 8 in 2021-10-08T19:41:59.585 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:41:59 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]: dispatch 2021-10-08T19:42:00.114 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.114+0000 7f1a9f7fe700 1 -- 172.21.15.157:0/373282497 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]=0 enabled application 'rados' on pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' v745) v1 ==== 213+0+0 (secure 0 0 0) 0x7f1ab0017020 con 0x7f1ab80f78a0 2021-10-08T19:42:00.117 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 >> v2:172.21.15.157:6800/1475557172 conn(0x7f1aa00634f0 msgr2=0x7f1aa00659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:00.117 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 --2- 172.21.15.157:0/373282497 >> v2:172.21.15.157:6800/1475557172 conn(0x7f1aa00634f0 0x7f1aa00659a0 secure :-1 s=READY pgs=3288 cs=0 l=1 rev1=1 crypto rx=0x7f1ab81091c0 tx=0x7f1aac00b040 comp rx=0 tx=0).stop 2021-10-08T19:42:00.117 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab80f78a0 msgr2=0x7f1ab810d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:00.117 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 --2- 172.21.15.157:0/373282497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab80f78a0 0x7f1ab810d990 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0004b70 tx=0x7f1ab0004d10 comp rx=0 tx=0).stop 2021-10-08T19:42:00.118 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 shutdown_connections 2021-10-08T19:42:00.118 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 --2- 172.21.15.157:0/373282497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab8107a60 0x7f1ab8107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:00.118 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 --2- 172.21.15.157:0/373282497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab80f78a0 0x7f1ab810d990 secure :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0004b70 tx=0x7f1ab0004d10 comp rx=0 tx=0).stop 2021-10-08T19:42:00.118 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 --2- 172.21.15.157:0/373282497 >> v2:172.21.15.157:6800/1475557172 conn(0x7f1aa00634f0 0x7f1aa00659a0 unknown :-1 s=CLOSED pgs=3288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:00.119 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 --2- 172.21.15.157:0/373282497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ab80f9790 0x7f1ab810ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:00.119 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.117+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 >> 172.21.15.157:0/373282497 conn(0x7f1ab806d110 msgr2=0x7f1ab806e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:00.120 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.118+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 shutdown_connections 2021-10-08T19:42:00.120 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:00.118+0000 7f1abd116700 1 -- 172.21.15.157:0/373282497 wait complete. 2021-10-08T19:42:00.120 INFO:tasks.workunit.client.0.smithi157.stderr:enabled application 'rados' on pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' 2021-10-08T19:42:00.132 INFO:tasks.workunit.client.0.smithi157.stderr:++ seq 1 10 2021-10-08T19:42:00.151 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.151 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj1 /etc/passwd 2021-10-08T19:42:00.179 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.179 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj2 /etc/passwd 2021-10-08T19:42:00.212 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.213 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj3 /etc/passwd 2021-10-08T19:42:00.242 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.243 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj4 /etc/passwd 2021-10-08T19:42:00.272 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.273 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj5 /etc/passwd 2021-10-08T19:42:00.301 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.302 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj6 /etc/passwd 2021-10-08T19:42:00.331 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.332 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj7 /etc/passwd 2021-10-08T19:42:00.361 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.362 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj8 /etc/passwd 2021-10-08T19:42:00.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]': finished 2021-10-08T19:42:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:00 smithi196 ceph-mon[34258]: osdmap e744: 8 total, 8 up, 8 in 2021-10-08T19:42:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:00 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]: dispatch 2021-10-08T19:42:00.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:00 smithi196 ceph-mon[34258]: pgmap v1173: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:00.390 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.390 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj9 /etc/passwd 2021-10-08T19:42:00.420 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:00.420 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put obj10 /etc/passwd 2021-10-08T19:42:00.448 INFO:tasks.workunit.client.0.smithi157.stderr:+ sleep 30 2021-10-08T19:42:00.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]': finished 2021-10-08T19:42:00.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:00 smithi157 ceph-mon[32847]: osdmap e744: 8 total, 8 up, 8 in 2021-10-08T19:42:00.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:00 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]: dispatch 2021-10-08T19:42:00.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:00 smithi157 ceph-mon[32847]: pgmap v1173: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:00.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]': finished 2021-10-08T19:42:00.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:00 smithi157 ceph-mon[42114]: osdmap e744: 8 total, 8 up, 8 in 2021-10-08T19:42:00.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:00 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]: dispatch 2021-10-08T19:42:00.581 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:00 smithi157 ceph-mon[42114]: pgmap v1173: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:01.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:01 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]': finished 2021-10-08T19:42:01.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:01 smithi157 ceph-mon[32847]: osdmap e745: 8 total, 8 up, 8 in 2021-10-08T19:42:01.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:01 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]': finished 2021-10-08T19:42:01.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:01 smithi157 ceph-mon[42114]: osdmap e745: 8 total, 8 up, 8 in 2021-10-08T19:42:01.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:01 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/373282497' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "app": "rados"}]': finished 2021-10-08T19:42:01.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:01 smithi196 ceph-mon[34258]: osdmap e745: 8 total, 8 up, 8 in 2021-10-08T19:42:02.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:02 smithi157 ceph-mon[32847]: pgmap v1175: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 19 KiB/s wr, 3 op/s 2021-10-08T19:42:02.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:02 smithi157 ceph-mon[42114]: pgmap v1175: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 19 KiB/s wr, 3 op/s 2021-10-08T19:42:02.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:02 smithi196 ceph-mon[34258]: pgmap v1175: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 19 KiB/s wr, 3 op/s 2021-10-08T19:42:03.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:03.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:03.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:03.534Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:42:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:04 smithi157 ceph-mon[32847]: pgmap v1176: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 15 KiB/s wr, 2 op/s 2021-10-08T19:42:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:04 smithi157 ceph-mon[32847]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' is full (reached quota's max_objects: 10) 2021-10-08T19:42:05.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:04 smithi157 ceph-mon[32847]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:42:05.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:04 smithi157 ceph-mon[32847]: osdmap e746: 8 total, 8 up, 8 in 2021-10-08T19:42:05.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:04 smithi157 ceph-mon[42114]: pgmap v1176: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 15 KiB/s wr, 2 op/s 2021-10-08T19:42:05.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:04 smithi157 ceph-mon[42114]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' is full (reached quota's max_objects: 10) 2021-10-08T19:42:05.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:04 smithi157 ceph-mon[42114]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:42:05.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:04 smithi157 ceph-mon[42114]: osdmap e746: 8 total, 8 up, 8 in 2021-10-08T19:42:05.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:04 smithi196 ceph-mon[34258]: pgmap v1176: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 15 KiB/s wr, 2 op/s 2021-10-08T19:42:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:04 smithi196 ceph-mon[34258]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' is full (reached quota's max_objects: 10) 2021-10-08T19:42:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:04 smithi196 ceph-mon[34258]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:42:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:04 smithi196 ceph-mon[34258]: osdmap e746: 8 total, 8 up, 8 in 2021-10-08T19:42:07.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:06 smithi157 ceph-mon[32847]: pgmap v1178: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 749 B/s rd, 13 KiB/s wr, 2 op/s 2021-10-08T19:42:07.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:06 smithi157 ceph-mon[42114]: pgmap v1178: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 749 B/s rd, 13 KiB/s wr, 2 op/s 2021-10-08T19:42:07.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:06 smithi196 ceph-mon[34258]: pgmap v1178: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 749 B/s rd, 13 KiB/s wr, 2 op/s 2021-10-08T19:42:07.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:07] "GET /metrics HTTP/1.1" 200 156606 "" "Prometheus/2.18.1" 2021-10-08T19:42:07.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:42:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:42:08.992 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:42:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:09.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:08 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:08 smithi157 ceph-mon[32847]: pgmap v1179: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2021-10-08T19:42:09.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:08 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:09.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:08 smithi157 ceph-mon[42114]: pgmap v1179: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2021-10-08T19:42:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:08 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:08 smithi196 ceph-mon[34258]: pgmap v1179: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2021-10-08T19:42:11.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:10 smithi157 ceph-mon[32847]: pgmap v1180: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 9.2 KiB/s wr, 2 op/s 2021-10-08T19:42:11.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:10 smithi157 ceph-mon[42114]: pgmap v1180: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 9.2 KiB/s wr, 2 op/s 2021-10-08T19:42:11.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:10 smithi196 ceph-mon[34258]: pgmap v1180: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 9.2 KiB/s wr, 2 op/s 2021-10-08T19:42:13.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:12 smithi157 ceph-mon[32847]: pgmap v1181: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:13.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:12 smithi157 ceph-mon[42114]: pgmap v1181: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:13.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:12 smithi196 ceph-mon[34258]: pgmap v1181: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:13.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:13.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:13.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:13.535Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:42:15.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:14 smithi157 ceph-mon[32847]: pgmap v1182: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:15.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:14 smithi157 ceph-mon[42114]: pgmap v1182: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:15.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:14 smithi196 ceph-mon[34258]: pgmap v1182: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:17.284 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:16 smithi157 ceph-mon[42114]: pgmap v1183: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 905 B/s rd, 0 op/s 2021-10-08T19:42:17.285 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:16 smithi157 ceph-mon[32847]: pgmap v1183: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 905 B/s rd, 0 op/s 2021-10-08T19:42:17.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:16 smithi196 ceph-mon[34258]: pgmap v1183: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 905 B/s rd, 0 op/s 2021-10-08T19:42:17.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:17] "GET /metrics HTTP/1.1" 200 156606 "" "Prometheus/2.18.1" 2021-10-08T19:42:17.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:42:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:42:18.996 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:42:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:19.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:18 smithi157 ceph-mon[32847]: pgmap v1184: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:19.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:19.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:18 smithi157 ceph-mon[42114]: pgmap v1184: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:19.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:19.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:18 smithi196 ceph-mon[34258]: pgmap v1184: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:21.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:20 smithi157 ceph-mon[32847]: pgmap v1185: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:21.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:20 smithi157 ceph-mon[42114]: pgmap v1185: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:21.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:20 smithi196 ceph-mon[34258]: pgmap v1185: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:22.991 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:22 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:42:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:23.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:22 smithi157 ceph-mon[42114]: pgmap v1186: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:23.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:22 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:23.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:22 smithi157 ceph-mon[32847]: pgmap v1186: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:23.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:22 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:23.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:22 smithi196 ceph-mon[34258]: pgmap v1186: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:23.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:22 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:23.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:23 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:42:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:23.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:23.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:23.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:23.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:23.535Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:42:24.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:23 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:42:24.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:23 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:42:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:24.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:23 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:24.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:23 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:42:24.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:23 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:42:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:24.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:23 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:24.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:23 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:42:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:23 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:42:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:24.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:23 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:25.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:24 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:42:25.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:24 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:42:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:25.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:24 smithi157 ceph-mon[32847]: pgmap v1187: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:25.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:24 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:42:25.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:24 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:42:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:25.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:24 smithi157 ceph-mon[42114]: pgmap v1187: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:25.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:24 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:42:25.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:24 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:42:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:25.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:24 smithi196 ceph-mon[34258]: pgmap v1187: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:27.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:26 smithi157 ceph-mon[32847]: pgmap v1188: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:27.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:26 smithi157 ceph-mon[42114]: pgmap v1188: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:27.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:26 smithi196 ceph-mon[34258]: pgmap v1188: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:27.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:27] "GET /metrics HTTP/1.1" 200 156606 "" "Prometheus/2.18.1" 2021-10-08T19:42:27.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:42:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:42:29.000 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:42:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:29.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:29 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:29.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:29 smithi157 ceph-mon[32847]: pgmap v1189: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:29.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:29 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:29.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:29 smithi157 ceph-mon[42114]: pgmap v1189: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:29.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:29 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:29.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:29 smithi196 ceph-mon[34258]: pgmap v1189: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:30.451 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=194521 2021-10-08T19:42:30.451 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool set-quota 96ef6666-8683-4159-9a16-d5ae4e1d0495 max_objects 100 2021-10-08T19:42:30.452 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put onemore /etc/passwd 2021-10-08T19:42:30.562 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.561+0000 7fe50c1e9700 1 -- 172.21.15.157:0/1725208741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 msgr2=0x7fe5041043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:30.562 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.561+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/1725208741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 0x7fe5041043d0 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009a60 tx=0x7fe4fc004d10 comp rx=0 tx=0).stop 2021-10-08T19:42:30.562 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.562+0000 7fe50c1e9700 1 -- 172.21.15.157:0/1725208741 shutdown_connections 2021-10-08T19:42:30.563 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.562+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/1725208741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 0x7fe5041043d0 unknown :-1 s=CLOSED pgs=2701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:30.563 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.562+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/1725208741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5040f78d0 0x7fe5040f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:30.563 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.562+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/1725208741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5040f81e0 0x7fe5040f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:30.563 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.562+0000 7fe50c1e9700 1 -- 172.21.15.157:0/1725208741 >> 172.21.15.157:0/1725208741 conn(0x7fe50406d1f0 msgr2=0x7fe5040f5650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:30.564 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.562+0000 7fe50c1e9700 1 -- 172.21.15.157:0/1725208741 shutdown_connections 2021-10-08T19:42:30.564 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.562+0000 7fe50c1e9700 1 -- 172.21.15.157:0/1725208741 wait complete. 2021-10-08T19:42:30.565 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.562+0000 7fe50c1e9700 1 Processor -- start 2021-10-08T19:42:30.565 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.562+0000 7fe50c1e9700 1 -- start start 2021-10-08T19:42:30.568 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe50c1e9700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5040f78d0 0x7fe504109900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:30.568 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe50c1e9700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 0x7fe504109e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:30.568 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe50c1e9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50410a3d0 0x7fe504114980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:30.569 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe50c1e9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe504114f90 con 0x7fe50410a3d0 2021-10-08T19:42:30.569 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe50c1e9700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe504115100 con 0x7fe5040f78d0 2021-10-08T19:42:30.569 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe50c1e9700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5041152c0 con 0x7fe5040f97c0 2021-10-08T19:42:30.569 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509784700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 0x7fe504109e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:30.570 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe50a786700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50410a3d0 0x7fe504114980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:30.570 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509784700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 0x7fe504109e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:60306/0 (socket says 172.21.15.157:60306) 2021-10-08T19:42:30.570 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509784700 1 -- 172.21.15.157:0/564600946 learned_addr learned my addr 172.21.15.157:0/564600946 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:42:30.570 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509f85700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5040f78d0 0x7fe504109900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:30.571 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509784700 1 -- 172.21.15.157:0/564600946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5040f78d0 msgr2=0x7fe504109900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:30.571 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509784700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5040f78d0 0x7fe504109900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:30.571 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509784700 1 -- 172.21.15.157:0/564600946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50410a3d0 msgr2=0x7fe504114980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:30.571 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509784700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50410a3d0 0x7fe504114980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:30.571 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509784700 1 -- 172.21.15.157:0/564600946 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc009640 con 0x7fe5040f97c0 2021-10-08T19:42:30.572 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe50a786700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50410a3d0 0x7fe504114980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:42:30.572 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509f85700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5040f78d0 0x7fe504109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:42:30.572 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe509784700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 0x7fe504109e40 secure :-1 s=READY pgs=2702 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4002750 tx=0x7fe4f4009e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:30.572 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f40092e0 con 0x7fe5040f97c0 2021-10-08T19:42:30.572 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fe4f400f040 con 0x7fe5040f97c0 2021-10-08T19:42:30.573 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5041155a0 con 0x7fe5040f97c0 2021-10-08T19:42:30.573 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.563+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4013760 con 0x7fe5040f97c0 2021-10-08T19:42:30.573 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.564+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe504115a90 con 0x7fe5040f97c0 2021-10-08T19:42:30.573 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.564+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe504060900 con 0x7fe5040f97c0 2021-10-08T19:42:30.574 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.565+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fe4f40077b0 con 0x7fe5040f97c0 2021-10-08T19:42:30.574 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.565+0000 7fe4fa7fc700 1 --2- 172.21.15.157:0/564600946 >> v2:172.21.15.157:6800/1475557172 conn(0x7fe4f00634f0 0x7fe4f00659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:30.574 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.565+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(746..746 src has 1..746) v4 ==== 7629+0+0 (secure 0 0 0) 0x7fe4f4080010 con 0x7fe5040f97c0 2021-10-08T19:42:30.575 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.565+0000 7fe509f85700 1 --2- 172.21.15.157:0/564600946 >> v2:172.21.15.157:6800/1475557172 conn(0x7fe4f00634f0 0x7fe4f00659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:30.575 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.565+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=747}) v3 -- 0x7fe4f006e760 con 0x7fe5040f97c0 2021-10-08T19:42:30.575 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.566+0000 7fe509f85700 1 --2- 172.21.15.157:0/564600946 >> v2:172.21.15.157:6800/1475557172 conn(0x7fe4f00634f0 0x7fe4f00659a0 secure :-1 s=READY pgs=3300 cs=0 l=1 rev1=1 crypto rx=0x7fe500009da0 tx=0x7fe50000b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:30.576 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.569+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fe4f4052590 con 0x7fe5040f97c0 2021-10-08T19:42:30.741 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:30.741+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fe504062190 con 0x7fe5040f97c0 2021-10-08T19:42:31.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:30 smithi157 ceph-mon[32847]: pgmap v1190: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:31.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:30 smithi157 ceph-mon[42114]: pgmap v1190: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:31.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:30 smithi196 ceph-mon[34258]: pgmap v1190: 176 pgs: 176 active+clean; 670 KiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:31.644 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:31.643+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 7 ==== osd_map(747..747 src has 1..747) v4 ==== 620+0+0 (secure 0 0 0) 0x7fe4f4052c60 con 0x7fe5040f97c0 2021-10-08T19:42:31.645 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:31.643+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=748}) v3 -- 0x7fe4f006f360 con 0x7fe5040f97c0 2021-10-08T19:42:31.649 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:31.649+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v747) v1 ==== 225+0+0 (secure 0 0 0) 0x7fe4f4052180 con 0x7fe5040f97c0 2021-10-08T19:42:31.760 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:31.760+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fe5040620f0 con 0x7fe5040f97c0 2021-10-08T19:42:32.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:31 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/564600946' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:32.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:31 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:32.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:31 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/564600946' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:32.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:31 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:31 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/564600946' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:32.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:31 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:32.651 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.651+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 9 ==== osd_map(748..748 src has 1..748) v4 ==== 620+0+0 (secure 0 0 0) 0x7fe4f4052180 con 0x7fe5040f97c0 2021-10-08T19:42:32.651 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.651+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=749}) v3 -- 0x7fe4f006f830 con 0x7fe5040f97c0 2021-10-08T19:42:32.656 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.654+0000 7fe4fa7fc700 1 -- 172.21.15.157:0/564600946 <== mon.1 v2:172.21.15.157:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v748) v1 ==== 225+0+0 (secure 0 0 0) 0x7fe4f406a070 con 0x7fe5040f97c0 2021-10-08T19:42:32.658 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 >> v2:172.21.15.157:6800/1475557172 conn(0x7fe4f00634f0 msgr2=0x7fe4f00659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:32.658 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/564600946 >> v2:172.21.15.157:6800/1475557172 conn(0x7fe4f00634f0 0x7fe4f00659a0 secure :-1 s=READY pgs=3300 cs=0 l=1 rev1=1 crypto rx=0x7fe500009da0 tx=0x7fe50000b040 comp rx=0 tx=0).stop 2021-10-08T19:42:32.658 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 msgr2=0x7fe504109e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:32.659 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 0x7fe504109e40 secure :-1 s=READY pgs=2702 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4002750 tx=0x7fe4f4009e00 comp rx=0 tx=0).stop 2021-10-08T19:42:32.659 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 shutdown_connections 2021-10-08T19:42:32.659 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50410a3d0 0x7fe504114980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:32.659 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5040f78d0 0x7fe504109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:32.660 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/564600946 >> v2:172.21.15.157:6800/1475557172 conn(0x7fe4f00634f0 0x7fe4f00659a0 unknown :-1 s=CLOSED pgs=3300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:32.660 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 --2- 172.21.15.157:0/564600946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5040f97c0 0x7fe504109e40 unknown :-1 s=CLOSED pgs=2702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:32.660 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 >> 172.21.15.157:0/564600946 conn(0x7fe50406d1f0 msgr2=0x7fe50406de30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:32.660 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 shutdown_connections 2021-10-08T19:42:32.660 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:32.658+0000 7fe50c1e9700 1 -- 172.21.15.157:0/564600946 wait complete. 2021-10-08T19:42:32.661 INFO:tasks.workunit.client.0.smithi157.stderr:set-quota max_objects = 100 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 2021-10-08T19:42:32.670 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 194521 2021-10-08T19:42:33.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:42:33.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: osdmap e747: 8 total, 8 up, 8 in 2021-10-08T19:42:33.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/564600946' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:33.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:42:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:42:33.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:42:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: poll took 60018.665 ms: 1 events 2021-10-08T19:42:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: pgmap v1192: 176 pgs: 176 active+clean; 670 KiB data, 493 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:33.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:33.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:42:33.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: osdmap e747: 8 total, 8 up, 8 in 2021-10-08T19:42:33.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/564600946' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:33.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:33.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:42:33.083 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:42:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:42:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: poll took 60018.665 ms: 1 events 2021-10-08T19:42:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: pgmap v1192: 176 pgs: 176 active+clean; 670 KiB data, 493 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:33.084 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:33.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:42:33.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: osdmap e747: 8 total, 8 up, 8 in 2021-10-08T19:42:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/564600946' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:42:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:42:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:42:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:42:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: poll took 60018.665 ms: 1 events 2021-10-08T19:42:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: pgmap v1192: 176 pgs: 176 active+clean; 670 KiB data, 493 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:33.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:33.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:33 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:42:33.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:33 smithi157 ceph-mon[32847]: osdmap e748: 8 total, 8 up, 8 in 2021-10-08T19:42:33.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:33 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:42:33.829 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:33 smithi157 ceph-mon[42114]: osdmap e748: 8 total, 8 up, 8 in 2021-10-08T19:42:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:33.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:33.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:33.535Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:42:34.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:33 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:42:34.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:33 smithi196 ceph-mon[34258]: osdmap e748: 8 total, 8 up, 8 in 2021-10-08T19:42:34.643 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 0 -ne 0 ']' 2021-10-08T19:42:34.643 INFO:tasks.workunit.client.0.smithi157.stderr:+ true 2021-10-08T19:42:34.644 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put twomore /etc/passwd 2021-10-08T19:42:34.677 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool set-quota 96ef6666-8683-4159-9a16-d5ae4e1d0495 max_bytes 100 2021-10-08T19:42:34.780 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.776+0000 7f38dcf8d700 1 -- 172.21.15.157:0/726332465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 msgr2=0x7f38d80f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:34.781 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.776+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/726332465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 0x7f38d80f7ec0 secure :-1 s=READY pgs=2706 cs=0 l=1 rev1=1 crypto rx=0x7f38c00046e0 tx=0x7f38c0009b30 comp rx=0 tx=0).stop 2021-10-08T19:42:34.782 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 -- 172.21.15.157:0/726332465 shutdown_connections 2021-10-08T19:42:34.782 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/726332465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38d80f85a0 0x7f38d81043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:34.782 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/726332465 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d80fd5b0 0x7f38d80fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:34.782 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/726332465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 0x7f38d80f7ec0 unknown :-1 s=CLOSED pgs=2706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:34.783 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 -- 172.21.15.157:0/726332465 >> 172.21.15.157:0/726332465 conn(0x7f38d806cda0 msgr2=0x7f38d806d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:34.783 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 -- 172.21.15.157:0/726332465 shutdown_connections 2021-10-08T19:42:34.783 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 -- 172.21.15.157:0/726332465 wait complete. 2021-10-08T19:42:34.783 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 Processor -- start 2021-10-08T19:42:34.783 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 -- start start 2021-10-08T19:42:34.784 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38d80f85a0 0x7f38d8107a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:34.784 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d80fd5b0 0x7f38d8107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:34.784 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 0x7f38d81084a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:34.785 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8117110 con 0x7f38d80f85a0 2021-10-08T19:42:34.785 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8117280 con 0x7f38d80fd5b0 2021-10-08T19:42:34.785 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.777+0000 7f38dcf8d700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8117440 con 0x7f38d80fdf50 2021-10-08T19:42:34.785 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38d80f85a0 0x7f38d8107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:34.785 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d6d9d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 0x7f38d81084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:34.786 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38d80f85a0 0x7f38d8107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:51108/0 (socket says 172.21.15.157:51108) 2021-10-08T19:42:34.786 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d659c700 1 -- 172.21.15.157:0/3133202446 learned_addr learned my addr 172.21.15.157:0/3133202446 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:42:34.786 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d6d9d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 0x7f38d81084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:60360/0 (socket says 172.21.15.157:60360) 2021-10-08T19:42:34.787 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38cdd9b700 1 --2- 172.21.15.157:0/3133202446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d80fd5b0 0x7f38d8107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:34.787 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d6d9d700 1 -- 172.21.15.157:0/3133202446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d80fd5b0 msgr2=0x7f38d8107f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:34.787 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d6d9d700 1 --2- 172.21.15.157:0/3133202446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d80fd5b0 0x7f38d8107f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:34.787 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d6d9d700 1 -- 172.21.15.157:0/3133202446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38d80f85a0 msgr2=0x7f38d8107a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:34.788 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d6d9d700 1 --2- 172.21.15.157:0/3133202446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38d80f85a0 0x7f38d8107a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:34.788 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d6d9d700 1 -- 172.21.15.157:0/3133202446 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d0009640 con 0x7f38d80fdf50 2021-10-08T19:42:34.788 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d659c700 1 --2- 172.21.15.157:0/3133202446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38d80f85a0 0x7f38d8107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:42:34.788 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38d6d9d700 1 --2- 172.21.15.157:0/3133202446 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 0x7f38d81084a0 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7f38d0001c80 tx=0x7f38d0004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:34.789 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38cf7fe700 1 -- 172.21.15.157:0/3133202446 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00092e0 con 0x7f38d80fdf50 2021-10-08T19:42:34.789 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c0005040 con 0x7f38d80fdf50 2021-10-08T19:42:34.789 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38cf7fe700 1 -- 172.21.15.157:0/3133202446 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f38d0009440 con 0x7f38d80fdf50 2021-10-08T19:42:34.789 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38cf7fe700 1 -- 172.21.15.157:0/3133202446 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0007bf0 con 0x7f38d80fdf50 2021-10-08T19:42:34.789 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.778+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d8117a80 con 0x7f38d80fdf50 2021-10-08T19:42:34.790 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.779+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d8060900 con 0x7f38d80fdf50 2021-10-08T19:42:34.790 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.780+0000 7f38cf7fe700 1 -- 172.21.15.157:0/3133202446 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f38d001c030 con 0x7f38d80fdf50 2021-10-08T19:42:34.790 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.780+0000 7f38cf7fe700 1 --2- 172.21.15.157:0/3133202446 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38c40634f0 0x7f38c40659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:34.791 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.780+0000 7f38cf7fe700 1 -- 172.21.15.157:0/3133202446 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(749..749 src has 1..749) v4 ==== 7629+0+0 (secure 0 0 0) 0x7f38d0080150 con 0x7f38d80fdf50 2021-10-08T19:42:34.791 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.780+0000 7f38d659c700 1 --2- 172.21.15.157:0/3133202446 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38c40634f0 0x7f38c40659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:34.791 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.780+0000 7f38d659c700 1 --2- 172.21.15.157:0/3133202446 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38c40634f0 0x7f38c40659a0 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7f38c8007fd0 tx=0x7f38c8009040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:34.792 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.784+0000 7f38cf7fe700 1 -- 172.21.15.157:0/3133202446 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f38d00527c0 con 0x7f38d80fdf50 2021-10-08T19:42:34.957 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:34.957+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f38d80f73d0 con 0x7f38d80fdf50 2021-10-08T19:42:35.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:34 smithi157 ceph-mon[32847]: pgmap v1194: 176 pgs: 176 active+clean; 670 KiB data, 493 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:34 smithi157 ceph-mon[32847]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:42:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:34 smithi157 ceph-mon[32847]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:42:35.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:34 smithi157 ceph-mon[32847]: osdmap e749: 8 total, 8 up, 8 in 2021-10-08T19:42:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:34 smithi157 ceph-mon[42114]: pgmap v1194: 176 pgs: 176 active+clean; 670 KiB data, 493 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:34 smithi157 ceph-mon[42114]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:42:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:34 smithi157 ceph-mon[42114]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:42:35.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:34 smithi157 ceph-mon[42114]: osdmap e749: 8 total, 8 up, 8 in 2021-10-08T19:42:35.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:34 smithi196 ceph-mon[34258]: pgmap v1194: 176 pgs: 176 active+clean; 670 KiB data, 493 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:35.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:34 smithi196 ceph-mon[34258]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:42:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:34 smithi196 ceph-mon[34258]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:42:35.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:34 smithi196 ceph-mon[34258]: osdmap e749: 8 total, 8 up, 8 in 2021-10-08T19:42:35.666 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:35.666+0000 7f38cf7fe700 1 -- 172.21.15.157:0/3133202446 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v750) v1 ==== 221+0+0 (secure 0 0 0) 0x7f38d00523b0 con 0x7f38d80fdf50 2021-10-08T19:42:35.779 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:35.779+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f38d8117d00 con 0x7f38d80fdf50 2021-10-08T19:42:36.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:35 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3133202446' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:36.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:35 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:36.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:35 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3133202446' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:36.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:35 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:36.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:35 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3133202446' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:36.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:35 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:36.674 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.674+0000 7f38cf7fe700 1 -- 172.21.15.157:0/3133202446 <== mon.1 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v751) v1 ==== 221+0+0 (secure 0 0 0) 0x7f38d0052590 con 0x7f38d80fdf50 2021-10-08T19:42:36.676 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38c40634f0 msgr2=0x7f38c40659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:36.676 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/3133202446 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38c40634f0 0x7f38c40659a0 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7f38c8007fd0 tx=0x7f38c8009040 comp rx=0 tx=0).stop 2021-10-08T19:42:36.677 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 msgr2=0x7f38d81084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:36.677 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/3133202446 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 0x7f38d81084a0 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7f38d0001c80 tx=0x7f38d0004c50 comp rx=0 tx=0).stop 2021-10-08T19:42:36.677 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 shutdown_connections 2021-10-08T19:42:36.677 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/3133202446 >> v2:172.21.15.157:6800/1475557172 conn(0x7f38c40634f0 0x7f38c40659a0 unknown :-1 s=CLOSED pgs=3302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:36.678 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/3133202446 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38d80fdf50 0x7f38d81084a0 unknown :-1 s=CLOSED pgs=2707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:36.678 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/3133202446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38d80f85a0 0x7f38d8107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:36.678 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 --2- 172.21.15.157:0/3133202446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d80fd5b0 0x7f38d8107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:36.678 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 >> 172.21.15.157:0/3133202446 conn(0x7f38d806cda0 msgr2=0x7f38d80f5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:36.679 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 shutdown_connections 2021-10-08T19:42:36.679 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:42:36.676+0000 7f38dcf8d700 1 -- 172.21.15.157:0/3133202446 wait complete. 2021-10-08T19:42:36.679 INFO:tasks.workunit.client.0.smithi157.stderr:set-quota max_bytes = 100 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 2021-10-08T19:42:36.688 INFO:tasks.workunit.client.0.smithi157.stderr:+ sleep 30 2021-10-08T19:42:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:42:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[32847]: osdmap e750: 8 total, 8 up, 8 in 2021-10-08T19:42:37.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3133202446' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[32847]: pgmap v1197: 176 pgs: 176 active+clean; 670 KiB data, 493 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:37.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:37.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:37.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:42:37.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[42114]: osdmap e750: 8 total, 8 up, 8 in 2021-10-08T19:42:37.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3133202446' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:37.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:37.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[42114]: pgmap v1197: 176 pgs: 176 active+clean; 670 KiB data, 493 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:37.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:37.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:37.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:37.082 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:37.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:42:37.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:36 smithi196 ceph-mon[34258]: osdmap e750: 8 total, 8 up, 8 in 2021-10-08T19:42:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:36 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3133202446' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:36 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:42:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:36 smithi196 ceph-mon[34258]: pgmap v1197: 176 pgs: 176 active+clean; 670 KiB data, 493 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:37.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:37.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:37.829 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:37] "GET /metrics HTTP/1.1" 200 156614 "" "Prometheus/2.18.1" 2021-10-08T19:42:37.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:37 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:42:37.830 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:37 smithi157 ceph-mon[32847]: osdmap e751: 8 total, 8 up, 8 in 2021-10-08T19:42:37.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:37 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:42:37.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:37 smithi157 ceph-mon[42114]: osdmap e751: 8 total, 8 up, 8 in 2021-10-08T19:42:37.866 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:37 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:42:37.867 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:37 smithi196 ceph-mon[34258]: osdmap e751: 8 total, 8 up, 8 in 2021-10-08T19:42:37.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:42:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:42:39.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:38 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:39.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:38 smithi157 ceph-mon[32847]: pgmap v1199: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 968 B/s rd, 3.4 KiB/s wr, 1 op/s 2021-10-08T19:42:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:38 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:39.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:38 smithi157 ceph-mon[42114]: pgmap v1199: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 968 B/s rd, 3.4 KiB/s wr, 1 op/s 2021-10-08T19:42:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:38 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:39.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:38 smithi196 ceph-mon[34258]: pgmap v1199: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 968 B/s rd, 3.4 KiB/s wr, 1 op/s 2021-10-08T19:42:39.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:42:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:40.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:39 smithi157 ceph-mon[32847]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' is full (reached quota's max_bytes: 100 B) 2021-10-08T19:42:40.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:39 smithi157 ceph-mon[32847]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:42:40.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:39 smithi157 ceph-mon[32847]: osdmap e752: 8 total, 8 up, 8 in 2021-10-08T19:42:40.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:39 smithi157 ceph-mon[42114]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' is full (reached quota's max_bytes: 100 B) 2021-10-08T19:42:40.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:39 smithi157 ceph-mon[42114]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:42:40.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:39 smithi157 ceph-mon[42114]: osdmap e752: 8 total, 8 up, 8 in 2021-10-08T19:42:40.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:39 smithi196 ceph-mon[34258]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' is full (reached quota's max_bytes: 100 B) 2021-10-08T19:42:40.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:39 smithi196 ceph-mon[34258]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:42:40.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:39 smithi196 ceph-mon[34258]: osdmap e752: 8 total, 8 up, 8 in 2021-10-08T19:42:41.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:40 smithi157 ceph-mon[32847]: pgmap v1201: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 3.4 KiB/s wr, 1 op/s 2021-10-08T19:42:41.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:40 smithi157 ceph-mon[42114]: pgmap v1201: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 3.4 KiB/s wr, 1 op/s 2021-10-08T19:42:41.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:40 smithi196 ceph-mon[34258]: pgmap v1201: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 3.4 KiB/s wr, 1 op/s 2021-10-08T19:42:43.283 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:43 smithi157 ceph-mon[32847]: pgmap v1202: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2021-10-08T19:42:43.284 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:43 smithi157 ceph-mon[42114]: pgmap v1202: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2021-10-08T19:42:43.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:43 smithi196 ceph-mon[34258]: pgmap v1202: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2021-10-08T19:42:43.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:43.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:43.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:43.535Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:42:45.277 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:45 smithi196 ceph-mon[34258]: pgmap v1203: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2021-10-08T19:42:45.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:45 smithi157 ceph-mon[42114]: pgmap v1203: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2021-10-08T19:42:45.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:45 smithi157 ceph-mon[32847]: pgmap v1203: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2021-10-08T19:42:47.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:47 smithi157 ceph-mon[32847]: pgmap v1204: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.9 KiB/s wr, 1 op/s 2021-10-08T19:42:47.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:47 smithi157 ceph-mon[42114]: pgmap v1204: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.9 KiB/s wr, 1 op/s 2021-10-08T19:42:47.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:47 smithi196 ceph-mon[34258]: pgmap v1204: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.9 KiB/s wr, 1 op/s 2021-10-08T19:42:47.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:47] "GET /metrics HTTP/1.1" 200 156614 "" "Prometheus/2.18.1" 2021-10-08T19:42:47.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:42:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:42:48.577 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:48 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:42:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:49.006 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:42:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:49.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:49 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:49 smithi157 ceph-mon[32847]: pgmap v1205: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:49 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:49.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:49 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:49 smithi157 ceph-mon[42114]: pgmap v1205: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:49.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:49 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:49.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:49 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:49.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:49 smithi196 ceph-mon[34258]: pgmap v1205: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:49 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:50.327 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:49 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:42:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:50 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:42:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:50 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:42:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:50 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:50.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:50 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:42:50.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:50 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:42:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:50.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:50 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:50.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:50 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:42:50.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:50 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:42:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:50.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:50 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:42:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:51 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:42:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:51 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:42:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:51.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:51 smithi157 ceph-mon[32847]: pgmap v1206: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2021-10-08T19:42:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:51 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:42:51.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:51 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:42:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:51.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:51 smithi157 ceph-mon[42114]: pgmap v1206: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2021-10-08T19:42:51.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:51 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:42:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:51 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:42:49] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:51 smithi196 ceph-mon[34258]: pgmap v1206: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2021-10-08T19:42:53.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:53 smithi157 ceph-mon[32847]: pgmap v1207: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:53.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:53 smithi157 ceph-mon[42114]: pgmap v1207: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:53.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:53 smithi196 ceph-mon[34258]: pgmap v1207: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:53.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:53.536Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:53.536Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:42:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:42:53.536Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:42:55.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:55 smithi157 ceph-mon[32847]: pgmap v1208: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:55.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:55 smithi157 ceph-mon[42114]: pgmap v1208: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:55.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:55 smithi196 ceph-mon[34258]: pgmap v1208: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:57.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:57 smithi157 ceph-mon[32847]: pgmap v1209: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:57.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:57 smithi157 ceph-mon[42114]: pgmap v1209: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:57.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:57 smithi196 ceph-mon[34258]: pgmap v1209: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:57.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:42:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:57] "GET /metrics HTTP/1.1" 200 156610 "" "Prometheus/2.18.1" 2021-10-08T19:42:57.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:42:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:42:59.020 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:42:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:42:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:59 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:42:59 smithi157 ceph-mon[32847]: pgmap v1210: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:59.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:59 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:59.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:42:59 smithi157 ceph-mon[42114]: pgmap v1210: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:59.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:59 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:59.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:42:59 smithi196 ceph-mon[34258]: pgmap v1210: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:01.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:00 smithi157 ceph-mon[32847]: pgmap v1211: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:43:01.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:00 smithi157 ceph-mon[42114]: pgmap v1211: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:43:01.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:00 smithi196 ceph-mon[34258]: pgmap v1211: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:43:03.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:03 smithi157 ceph-mon[32847]: pgmap v1212: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:03.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:03 smithi157 ceph-mon[42114]: pgmap v1212: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:03.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:03 smithi196 ceph-mon[34258]: pgmap v1212: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:03.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:03.536Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:03.536Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:03.536Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:43:05.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:05 smithi157 ceph-mon[32847]: pgmap v1213: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:05.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:05 smithi157 ceph-mon[42114]: pgmap v1213: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:05.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:05 smithi196 ceph-mon[34258]: pgmap v1213: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:06.691 INFO:tasks.workunit.client.0.smithi157.stderr:+ pid=195786 2021-10-08T19:43:06.692 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool set-quota 96ef6666-8683-4159-9a16-d5ae4e1d0495 max_bytes 0 2021-10-08T19:43:06.692 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put two /etc/passwd 2021-10-08T19:43:06.806 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.803+0000 7fdb35faa700 1 -- 172.21.15.157:0/273317494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb300f81b0 msgr2=0x7fdb300f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:06.806 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.803+0000 7fdb35faa700 1 --2- 172.21.15.157:0/273317494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb300f81b0 0x7fdb300f9060 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7fdb240046e0 tx=0x7fdb24009b30 comp rx=0 tx=0).stop 2021-10-08T19:43:06.806 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.803+0000 7fdb35faa700 1 -- 172.21.15.157:0/273317494 shutdown_connections 2021-10-08T19:43:06.807 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.803+0000 7fdb35faa700 1 --2- 172.21.15.157:0/273317494 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb300f9790 0x7fdb301043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:06.807 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.803+0000 7fdb35faa700 1 --2- 172.21.15.157:0/273317494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300f78a0 0x7fdb300f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:06.807 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.803+0000 7fdb35faa700 1 --2- 172.21.15.157:0/273317494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb300f81b0 0x7fdb300f9060 unknown :-1 s=CLOSED pgs=2664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:06.807 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.803+0000 7fdb35faa700 1 -- 172.21.15.157:0/273317494 >> 172.21.15.157:0/273317494 conn(0x7fdb3006d110 msgr2=0x7fdb300f5610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:06.808 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.803+0000 7fdb35faa700 1 -- 172.21.15.157:0/273317494 shutdown_connections 2021-10-08T19:43:06.808 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.803+0000 7fdb35faa700 1 -- 172.21.15.157:0/273317494 wait complete. 2021-10-08T19:43:06.808 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb35faa700 1 Processor -- start 2021-10-08T19:43:06.808 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb35faa700 1 -- start start 2021-10-08T19:43:06.809 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb35faa700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb300f78a0 0x7fdb30109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:06.809 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb35faa700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300f9790 0x7fdb3010a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:06.809 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb35faa700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb3010a670 0x7fdb30114c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:06.809 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb35faa700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30115240 con 0x7fdb300f78a0 2021-10-08T19:43:06.810 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb35faa700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb301153b0 con 0x7fdb300f9790 2021-10-08T19:43:06.810 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb35faa700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30115570 con 0x7fdb3010a670 2021-10-08T19:43:06.810 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb2f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb300f78a0 0x7fdb30109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:06.810 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb2ffff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb3010a670 0x7fdb30114c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:06.810 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb2ffff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb3010a670 0x7fdb30114c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:60478/0 (socket says 172.21.15.157:60478) 2021-10-08T19:43:06.811 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.804+0000 7fdb2ffff700 1 -- 172.21.15.157:0/2823857605 learned_addr learned my addr 172.21.15.157:0/2823857605 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:43:06.811 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb2effd700 1 --2- 172.21.15.157:0/2823857605 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300f9790 0x7fdb3010a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:06.811 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb2ffff700 1 -- 172.21.15.157:0/2823857605 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300f9790 msgr2=0x7fdb3010a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:06.811 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb2ffff700 1 --2- 172.21.15.157:0/2823857605 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300f9790 0x7fdb3010a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:06.812 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb2ffff700 1 -- 172.21.15.157:0/2823857605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb300f78a0 msgr2=0x7fdb30109ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:06.812 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb2ffff700 1 --2- 172.21.15.157:0/2823857605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb300f78a0 0x7fdb30109ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:06.812 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb2ffff700 1 -- 172.21.15.157:0/2823857605 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28009640 con 0x7fdb3010a670 2021-10-08T19:43:06.812 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb2f7fe700 1 --2- 172.21.15.157:0/2823857605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb300f78a0 0x7fdb30109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:43:06.813 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb2ffff700 1 --2- 172.21.15.157:0/2823857605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb3010a670 0x7fdb30114c20 secure :-1 s=READY pgs=2710 cs=0 l=1 rev1=1 crypto rx=0x7fdb28001c30 tx=0x7fdb28004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:06.813 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb280092e0 con 0x7fdb3010a670 2021-10-08T19:43:06.814 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb24005040 con 0x7fdb3010a670 2021-10-08T19:43:06.814 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fdb28009440 con 0x7fdb3010a670 2021-10-08T19:43:06.814 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb30115c30 con 0x7fdb3010a670 2021-10-08T19:43:06.814 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.805+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb28007b80 con 0x7fdb3010a670 2021-10-08T19:43:06.815 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.806+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb30060900 con 0x7fdb3010a670 2021-10-08T19:43:06.815 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.806+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fdb2800f6e0 con 0x7fdb3010a670 2021-10-08T19:43:06.816 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.807+0000 7fdb13fff700 1 --2- 172.21.15.157:0/2823857605 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdb180634f0 0x7fdb180659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:06.816 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.807+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(752..752 src has 1..752) v4 ==== 7629+0+0 (secure 0 0 0) 0x7fdb2807ffb0 con 0x7fdb3010a670 2021-10-08T19:43:06.816 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.807+0000 7fdb2f7fe700 1 --2- 172.21.15.157:0/2823857605 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdb180634f0 0x7fdb180659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:06.817 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.807+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=753}) v3 -- 0x7fdb1806e760 con 0x7fdb3010a670 2021-10-08T19:43:06.817 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.807+0000 7fdb2f7fe700 1 --2- 172.21.15.157:0/2823857605 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdb180634f0 0x7fdb180659a0 secure :-1 s=READY pgs=3304 cs=0 l=1 rev1=1 crypto rx=0x7fdb200102e0 tx=0x7fdb2000b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:06.817 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.811+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fdb280525c0 con 0x7fdb3010a670 2021-10-08T19:43:06.975 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:06.976+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fdb30062090 con 0x7fdb3010a670 2021-10-08T19:43:07.018 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:07.015+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 7 ==== osd_map(753..753 src has 1..753) v4 ==== 620+0+0 (secure 0 0 0) 0x7fdb28052c90 con 0x7fdb3010a670 2021-10-08T19:43:07.019 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:07.016+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=754}) v3 -- 0x7fdb1806f360 con 0x7fdb3010a670 2021-10-08T19:43:07.020 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:07.021+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v753) v1 ==== 217+0+0 (secure 0 0 0) 0x7fdb2801a070 con 0x7fdb3010a670 2021-10-08T19:43:07.126 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:07.126+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fdb300f81b0 con 0x7fdb3010a670 2021-10-08T19:43:07.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:07 smithi157 ceph-mon[32847]: pgmap v1214: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:07 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2823857605' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:07 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:07.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:07 smithi157 ceph-mon[42114]: pgmap v1214: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:07 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2823857605' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:07.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:07 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:07.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:07 smithi196 ceph-mon[34258]: pgmap v1214: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:07.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:07 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2823857605' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:07.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:07 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:07.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:07] "GET /metrics HTTP/1.1" 200 156612 "" "Prometheus/2.18.1" 2021-10-08T19:43:07.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:43:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:43:08.022 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.022+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 9 ==== osd_map(754..754 src has 1..754) v4 ==== 620+0+0 (secure 0 0 0) 0x7fdb28050990 con 0x7fdb3010a670 2021-10-08T19:43:08.022 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.022+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=755}) v3 -- 0x7fdb1806f9c0 con 0x7fdb3010a670 2021-10-08T19:43:08.028 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.029+0000 7fdb13fff700 1 -- 172.21.15.157:0/2823857605 <== mon.1 v2:172.21.15.157:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v754) v1 ==== 217+0+0 (secure 0 0 0) 0x7fdb2807d060 con 0x7fdb3010a670 2021-10-08T19:43:08.031 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdb180634f0 msgr2=0x7fdb180659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:08.032 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 --2- 172.21.15.157:0/2823857605 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdb180634f0 0x7fdb180659a0 secure :-1 s=READY pgs=3304 cs=0 l=1 rev1=1 crypto rx=0x7fdb200102e0 tx=0x7fdb2000b040 comp rx=0 tx=0).stop 2021-10-08T19:43:08.032 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb3010a670 msgr2=0x7fdb30114c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:08.032 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 --2- 172.21.15.157:0/2823857605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb3010a670 0x7fdb30114c20 secure :-1 s=READY pgs=2710 cs=0 l=1 rev1=1 crypto rx=0x7fdb28001c30 tx=0x7fdb28004c50 comp rx=0 tx=0).stop 2021-10-08T19:43:08.032 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 shutdown_connections 2021-10-08T19:43:08.032 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 --2- 172.21.15.157:0/2823857605 >> v2:172.21.15.157:6800/1475557172 conn(0x7fdb180634f0 0x7fdb180659a0 unknown :-1 s=CLOSED pgs=3304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:08.033 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 --2- 172.21.15.157:0/2823857605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb3010a670 0x7fdb30114c20 unknown :-1 s=CLOSED pgs=2710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:08.033 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 --2- 172.21.15.157:0/2823857605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb300f78a0 0x7fdb30109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:08.034 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 --2- 172.21.15.157:0/2823857605 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300f9790 0x7fdb3010a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:08.034 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.031+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 >> 172.21.15.157:0/2823857605 conn(0x7fdb3006d110 msgr2=0x7fdb3006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:08.035 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.032+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 shutdown_connections 2021-10-08T19:43:08.035 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.032+0000 7fdb35faa700 1 -- 172.21.15.157:0/2823857605 wait complete. 2021-10-08T19:43:08.035 INFO:tasks.workunit.client.0.smithi157.stderr:set-quota max_bytes = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 2021-10-08T19:43:08.044 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool set-quota 96ef6666-8683-4159-9a16-d5ae4e1d0495 max_objects 0 2021-10-08T19:43:08.149 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.146+0000 7f724d896700 1 -- 172.21.15.157:0/3848214801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480fd320 msgr2=0x7f72480fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:08.149 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.146+0000 7f724d896700 1 --2- 172.21.15.157:0/3848214801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480fd320 0x7f72480fd6f0 secure :-1 s=READY pgs=2711 cs=0 l=1 rev1=1 crypto rx=0x7f723c0046e0 tx=0x7f723c009b30 comp rx=0 tx=0).stop 2021-10-08T19:43:08.149 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.146+0000 7f724d896700 1 -- 172.21.15.157:0/3848214801 shutdown_connections 2021-10-08T19:43:08.150 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.146+0000 7f724d896700 1 --2- 172.21.15.157:0/3848214801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72480f7aa0 0x7f7248104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:08.150 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.146+0000 7f724d896700 1 --2- 172.21.15.157:0/3848214801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480fd320 0x7f72480fd6f0 unknown :-1 s=CLOSED pgs=2711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:08.150 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.146+0000 7f724d896700 1 --2- 172.21.15.157:0/3848214801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72480fdcc0 0x7f72480f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:08.150 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.146+0000 7f724d896700 1 -- 172.21.15.157:0/3848214801 >> 172.21.15.157:0/3848214801 conn(0x7f72480f2f20 msgr2=0x7f72480f5330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:08.151 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.146+0000 7f724d896700 1 -- 172.21.15.157:0/3848214801 shutdown_connections 2021-10-08T19:43:08.151 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.146+0000 7f724d896700 1 -- 172.21.15.157:0/3848214801 wait complete. 2021-10-08T19:43:08.151 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724d896700 1 Processor -- start 2021-10-08T19:43:08.151 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724d896700 1 -- start start 2021-10-08T19:43:08.152 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724d896700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480f7aa0 0x7f724810e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:08.152 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724d896700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72480fd320 0x7f724810ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:08.152 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724d896700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72480fdcc0 0x7f7248108970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:08.152 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724d896700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7248108f40 con 0x7f72480fd320 2021-10-08T19:43:08.153 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724d896700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72481090b0 con 0x7f72480fdcc0 2021-10-08T19:43:08.153 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724d896700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7248109270 con 0x7f72480f7aa0 2021-10-08T19:43:08.153 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724c894700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480f7aa0 0x7f724810e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:08.153 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724c894700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480f7aa0 0x7f724810e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:60492/0 (socket says 172.21.15.157:60492) 2021-10-08T19:43:08.154 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724c894700 1 -- 172.21.15.157:0/1208774280 learned_addr learned my addr 172.21.15.157:0/1208774280 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:43:08.154 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f7247fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72480fd320 0x7f724810ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:08.154 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.147+0000 7f724d095700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72480fdcc0 0x7f7248108970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:08.154 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f724c894700 1 -- 172.21.15.157:0/1208774280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72480fdcc0 msgr2=0x7f7248108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:08.155 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f724c894700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72480fdcc0 0x7f7248108970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:08.155 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f724c894700 1 -- 172.21.15.157:0/1208774280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72480fd320 msgr2=0x7f724810ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:08.155 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f724c894700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72480fd320 0x7f724810ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:08.155 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f724c894700 1 -- 172.21.15.157:0/1208774280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7234005040 con 0x7f72480f7aa0 2021-10-08T19:43:08.156 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f724d095700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72480fdcc0 0x7f7248108970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:43:08.156 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f7247fff700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72480fd320 0x7f724810ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:43:08.156 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f724c894700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480f7aa0 0x7f724810e8a0 secure :-1 s=READY pgs=2712 cs=0 l=1 rev1=1 crypto rx=0x7f723c004dd0 tx=0x7f723c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:08.156 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c019070 con 0x7f72480f7aa0 2021-10-08T19:43:08.157 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723c005040 con 0x7f72480f7aa0 2021-10-08T19:43:08.157 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f723c009720 con 0x7f72480f7aa0 2021-10-08T19:43:08.157 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c01ee20 con 0x7f72480f7aa0 2021-10-08T19:43:08.157 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.148+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7248109710 con 0x7f72480f7aa0 2021-10-08T19:43:08.158 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.149+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7248047b50 con 0x7f72480f7aa0 2021-10-08T19:43:08.158 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.149+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f723c007b30 con 0x7f72480f7aa0 2021-10-08T19:43:08.159 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.150+0000 7f72457fa700 1 --2- 172.21.15.157:0/1208774280 >> v2:172.21.15.157:6800/1475557172 conn(0x7f72380634f0 0x7f72380659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:08.159 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.150+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(754..754 src has 1..754) v4 ==== 7629+0+0 (secure 0 0 0) 0x7f723c081540 con 0x7f72480f7aa0 2021-10-08T19:43:08.160 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.150+0000 7f7247fff700 1 --2- 172.21.15.157:0/1208774280 >> v2:172.21.15.157:6800/1475557172 conn(0x7f72380634f0 0x7f72380659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:08.160 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.150+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=755}) v3 -- 0x7f723806e760 con 0x7f72480f7aa0 2021-10-08T19:43:08.160 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.150+0000 7f7247fff700 1 --2- 172.21.15.157:0/1208774280 >> v2:172.21.15.157:6800/1475557172 conn(0x7f72380634f0 0x7f72380659a0 secure :-1 s=READY pgs=3305 cs=0 l=1 rev1=1 crypto rx=0x7f7234007fd0 tx=0x7f723400b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:08.160 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.154+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f723c053bb0 con 0x7f72480f7aa0 2021-10-08T19:43:08.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:43:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:08 smithi157 ceph-mon[32847]: osdmap e753: 8 total, 8 up, 8 in 2021-10-08T19:43:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:08 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2823857605' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:08.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:08 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:08.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:43:08.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:08 smithi157 ceph-mon[42114]: osdmap e753: 8 total, 8 up, 8 in 2021-10-08T19:43:08.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:08 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2823857605' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:08.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:08 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:08.336 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:08.336+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f7248106820 con 0x7f72480f7aa0 2021-10-08T19:43:08.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:43:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:08 smithi196 ceph-mon[34258]: osdmap e753: 8 total, 8 up, 8 in 2021-10-08T19:43:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:08 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2823857605' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:08.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:08 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:43:09.021 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:43:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:09.027 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.026+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 7 ==== osd_map(755..755 src has 1..755) v4 ==== 620+0+0 (secure 0 0 0) 0x7f723c01e520 con 0x7f72480f7aa0 2021-10-08T19:43:09.027 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.026+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=756}) v3 -- 0x7f723806f360 con 0x7f72480f7aa0 2021-10-08T19:43:09.032 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.033+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v755) v1 ==== 221+0+0 (secure 0 0 0) 0x7f723c069060 con 0x7f72480f7aa0 2021-10-08T19:43:09.143 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.143+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f7248106820 con 0x7f72480f7aa0 2021-10-08T19:43:09.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[32847]: pgmap v1216: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:43:09.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[32847]: osdmap e754: 8 total, 8 up, 8 in 2021-10-08T19:43:09.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1208774280' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:09.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:09.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:09.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[42114]: pgmap v1216: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:09.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:43:09.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[42114]: osdmap e754: 8 total, 8 up, 8 in 2021-10-08T19:43:09.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1208774280' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:09.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:09 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:09.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:09 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:09 smithi196 ceph-mon[34258]: pgmap v1216: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:43:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:09 smithi196 ceph-mon[34258]: osdmap e754: 8 total, 8 up, 8 in 2021-10-08T19:43:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:09 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1208774280' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:09 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:09.643 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.641+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 9 ==== osd_map(756..756 src has 1..756) v4 ==== 620+0+0 (secure 0 0 0) 0x7f723c009c00 con 0x7f72480f7aa0 2021-10-08T19:43:09.644 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.641+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=757}) v3 -- 0x7f723806f830 con 0x7f72480f7aa0 2021-10-08T19:43:09.645 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.644+0000 7f72457fa700 1 -- 172.21.15.157:0/1208774280 <== mon.1 v2:172.21.15.157:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v756) v1 ==== 221+0+0 (secure 0 0 0) 0x7f723c0537a0 con 0x7f72480f7aa0 2021-10-08T19:43:09.648 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 >> v2:172.21.15.157:6800/1475557172 conn(0x7f72380634f0 msgr2=0x7f72380659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:09.648 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 --2- 172.21.15.157:0/1208774280 >> v2:172.21.15.157:6800/1475557172 conn(0x7f72380634f0 0x7f72380659a0 secure :-1 s=READY pgs=3305 cs=0 l=1 rev1=1 crypto rx=0x7f7234007fd0 tx=0x7f723400b040 comp rx=0 tx=0).stop 2021-10-08T19:43:09.648 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480f7aa0 msgr2=0x7f724810e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:09.649 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480f7aa0 0x7f724810e8a0 secure :-1 s=READY pgs=2712 cs=0 l=1 rev1=1 crypto rx=0x7f723c004dd0 tx=0x7f723c009b30 comp rx=0 tx=0).stop 2021-10-08T19:43:09.649 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 shutdown_connections 2021-10-08T19:43:09.649 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72480fdcc0 0x7f7248108970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.649 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 --2- 172.21.15.157:0/1208774280 >> v2:172.21.15.157:6800/1475557172 conn(0x7f72380634f0 0x7f72380659a0 unknown :-1 s=CLOSED pgs=3305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.650 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72480f7aa0 0x7f724810e8a0 unknown :-1 s=CLOSED pgs=2712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.650 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 --2- 172.21.15.157:0/1208774280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72480fd320 0x7f724810ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.650 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 >> 172.21.15.157:0/1208774280 conn(0x7f72480f2f20 msgr2=0x7f72480f4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:09.650 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 shutdown_connections 2021-10-08T19:43:09.651 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.648+0000 7f724d896700 1 -- 172.21.15.157:0/1208774280 wait complete. 2021-10-08T19:43:09.651 INFO:tasks.workunit.client.0.smithi157.stderr:set-quota max_objects = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 2021-10-08T19:43:09.659 INFO:tasks.workunit.client.0.smithi157.stderr:+ wait 195786 2021-10-08T19:43:09.660 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' 0 -ne 0 ']' 2021-10-08T19:43:09.660 INFO:tasks.workunit.client.0.smithi157.stderr:+ true 2021-10-08T19:43:09.660 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put three /etc/passwd 2021-10-08T19:43:09.690 INFO:tasks.workunit.client.0.smithi157.stderr:++ uuidgen 2021-10-08T19:43:09.691 INFO:tasks.workunit.client.0.smithi157.stderr:+ pp=807b6f86-3833-41c4-ab00-99daf67b7e38 2021-10-08T19:43:09.691 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool create 807b6f86-3833-41c4-ab00-99daf67b7e38 12 2021-10-08T19:43:09.797 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 -- 172.21.15.157:0/46182768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe140fe620 msgr2=0x7fbe140fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:09.798 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 --2- 172.21.15.157:0/46182768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe140fe620 0x7fbe140fe9f0 secure :-1 s=READY pgs=2715 cs=0 l=1 rev1=1 crypto rx=0x7fbe10004860 tx=0x7fbe10009ad0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.798 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 -- 172.21.15.157:0/46182768 shutdown_connections 2021-10-08T19:43:09.798 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 --2- 172.21.15.157:0/46182768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe140f8d90 0x7fbe141053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.798 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 --2- 172.21.15.157:0/46182768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe140fe620 0x7fbe140fe9f0 unknown :-1 s=CLOSED pgs=2715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.799 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 --2- 172.21.15.157:0/46182768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe140fef30 0x7fbe140f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.799 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 -- 172.21.15.157:0/46182768 >> 172.21.15.157:0/46182768 conn(0x7fbe1406f350 msgr2=0x7fbe140f6700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:09.799 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 -- 172.21.15.157:0/46182768 shutdown_connections 2021-10-08T19:43:09.799 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 -- 172.21.15.157:0/46182768 wait complete. 2021-10-08T19:43:09.800 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 Processor -- start 2021-10-08T19:43:09.800 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.795+0000 7fbe1b676700 1 -- start start 2021-10-08T19:43:09.800 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe1b676700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe140f8d90 0x7fbe1410e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:09.800 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe1b676700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe140fe620 0x7fbe1410eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe1b676700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe140fef30 0x7fbe14108a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe1b676700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14109050 con 0x7fbe140f8d90 2021-10-08T19:43:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe1b676700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe141091c0 con 0x7fbe140fef30 2021-10-08T19:43:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe1b676700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14109380 con 0x7fbe140fe620 2021-10-08T19:43:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19412700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe140f8d90 0x7fbe1410e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19412700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe140f8d90 0x7fbe1410e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:51280/0 (socket says 172.21.15.157:51280) 2021-10-08T19:43:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19412700 1 -- 172.21.15.157:0/3256598522 learned_addr learned my addr 172.21.15.157:0/3256598522 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:43:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe18c11700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe140fe620 0x7fbe1410eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19c13700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe140fef30 0x7fbe14108a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19412700 1 -- 172.21.15.157:0/3256598522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe140fe620 msgr2=0x7fbe1410eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19412700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe140fe620 0x7fbe1410eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19412700 1 -- 172.21.15.157:0/3256598522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe140fef30 msgr2=0x7fbe14108a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19412700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe140fef30 0x7fbe14108a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19412700 1 -- 172.21.15.157:0/3256598522 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04005040 con 0x7fbe140f8d90 2021-10-08T19:43:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe18c11700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe140fe620 0x7fbe1410eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:43:09.805 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe19412700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe140f8d90 0x7fbe1410e9b0 secure :-1 s=READY pgs=2666 cs=0 l=1 rev1=1 crypto rx=0x7fbe10014470 tx=0x7fbe10009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:09.805 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe09ffb700 1 -- 172.21.15.157:0/3256598522 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10019070 con 0x7fbe140f8d90 2021-10-08T19:43:09.805 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe09ffb700 1 -- 172.21.15.157:0/3256598522 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fbe10007960 con 0x7fbe140f8d90 2021-10-08T19:43:09.805 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe10009d70 con 0x7fbe140f8d90 2021-10-08T19:43:09.806 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe09ffb700 1 -- 172.21.15.157:0/3256598522 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000e040 con 0x7fbe140f8d90 2021-10-08T19:43:09.806 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.796+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe141098f0 con 0x7fbe140f8d90 2021-10-08T19:43:09.806 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.797+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe14060900 con 0x7fbe140f8d90 2021-10-08T19:43:09.807 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.798+0000 7fbe09ffb700 1 -- 172.21.15.157:0/3256598522 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fbe100145e0 con 0x7fbe140f8d90 2021-10-08T19:43:09.808 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.798+0000 7fbe09ffb700 1 --2- 172.21.15.157:0/3256598522 >> v2:172.21.15.157:6800/1475557172 conn(0x7fbe000634f0 0x7fbe000659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:09.808 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.798+0000 7fbe09ffb700 1 -- 172.21.15.157:0/3256598522 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(756..756 src has 1..756) v4 ==== 7629+0+0 (secure 0 0 0) 0x7fbe10081540 con 0x7fbe140f8d90 2021-10-08T19:43:09.809 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.798+0000 7fbe18c11700 1 --2- 172.21.15.157:0/3256598522 >> v2:172.21.15.157:6800/1475557172 conn(0x7fbe000634f0 0x7fbe000659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:09.809 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.799+0000 7fbe18c11700 1 --2- 172.21.15.157:0/3256598522 >> v2:172.21.15.157:6800/1475557172 conn(0x7fbe000634f0 0x7fbe000659a0 secure :-1 s=READY pgs=3307 cs=0 l=1 rev1=1 crypto rx=0x7fbe04007fd0 tx=0x7fbe0400b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:09.809 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.803+0000 7fbe09ffb700 1 -- 172.21.15.157:0/3256598522 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fbe10053c30 con 0x7fbe140f8d90 2021-10-08T19:43:09.974 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:09.974+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12} v 0) v1 -- 0x7fbe141098f0 con 0x7fbe140f8d90 2021-10-08T19:43:10.364 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:43:10.364 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:10 smithi196 ceph-mon[34258]: osdmap e755: 8 total, 8 up, 8 in 2021-10-08T19:43:10.364 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:10 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/1208774280' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:10.365 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:10.365 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:10 smithi196 ceph-mon[34258]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:43:10.365 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:10 smithi196 ceph-mon[34258]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:43:10.365 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:10 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:43:10.365 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:10 smithi196 ceph-mon[34258]: osdmap e756: 8 total, 8 up, 8 in 2021-10-08T19:43:10.575 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:43:10.576 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[32847]: osdmap e755: 8 total, 8 up, 8 in 2021-10-08T19:43:10.576 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/1208774280' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:10.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:10.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[32847]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:43:10.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[32847]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:43:10.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:43:10.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[32847]: osdmap e756: 8 total, 8 up, 8 in 2021-10-08T19:43:10.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:43:10.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[42114]: osdmap e755: 8 total, 8 up, 8 in 2021-10-08T19:43:10.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/1208774280' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:10.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:43:10.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[42114]: pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:43:10.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[42114]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:43:10.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:43:10.580 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:10 smithi157 ceph-mon[42114]: osdmap e756: 8 total, 8 up, 8 in 2021-10-08T19:43:10.656 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.656+0000 7fbe09ffb700 1 -- 172.21.15.157:0/3256598522 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]=0 pool '807b6f86-3833-41c4-ab00-99daf67b7e38' created v757) v1 ==== 176+0+0 (secure 0 0 0) 0x7fbe141098f0 con 0x7fbe140f8d90 2021-10-08T19:43:10.770 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.770+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12} v 0) v1 -- 0x7fbe141098f0 con 0x7fbe140f8d90 2021-10-08T19:43:10.771 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.771+0000 7fbe09ffb700 1 -- 172.21.15.157:0/3256598522 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]=0 pool '807b6f86-3833-41c4-ab00-99daf67b7e38' already exists v757) v1 ==== 183+0+0 (secure 0 0 0) 0x7fbe141098f0 con 0x7fbe140f8d90 2021-10-08T19:43:10.773 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 >> v2:172.21.15.157:6800/1475557172 conn(0x7fbe000634f0 msgr2=0x7fbe000659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:10.774 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 --2- 172.21.15.157:0/3256598522 >> v2:172.21.15.157:6800/1475557172 conn(0x7fbe000634f0 0x7fbe000659a0 secure :-1 s=READY pgs=3307 cs=0 l=1 rev1=1 crypto rx=0x7fbe04007fd0 tx=0x7fbe0400b040 comp rx=0 tx=0).stop 2021-10-08T19:43:10.774 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe140f8d90 msgr2=0x7fbe1410e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:10.774 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe140f8d90 0x7fbe1410e9b0 secure :-1 s=READY pgs=2666 cs=0 l=1 rev1=1 crypto rx=0x7fbe10014470 tx=0x7fbe10009ad0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.774 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 shutdown_connections 2021-10-08T19:43:10.775 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe140fef30 0x7fbe14108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.775 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe140f8d90 0x7fbe1410e9b0 unknown :-1 s=CLOSED pgs=2666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.775 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 --2- 172.21.15.157:0/3256598522 >> v2:172.21.15.157:6800/1475557172 conn(0x7fbe000634f0 0x7fbe000659a0 unknown :-1 s=CLOSED pgs=3307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.775 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 --2- 172.21.15.157:0/3256598522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe140fe620 0x7fbe1410eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.775 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 >> 172.21.15.157:0/3256598522 conn(0x7fbe1406f350 msgr2=0x7fbe14070400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:10.776 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 shutdown_connections 2021-10-08T19:43:10.776 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.773+0000 7fbe1b676700 1 -- 172.21.15.157:0/3256598522 wait complete. 2021-10-08T19:43:10.776 INFO:tasks.workunit.client.0.smithi157.stderr:pool '807b6f86-3833-41c4-ab00-99daf67b7e38' already exists 2021-10-08T19:43:10.783 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool application enable 807b6f86-3833-41c4-ab00-99daf67b7e38 rados 2021-10-08T19:43:10.888 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.884+0000 7f7b1bfff700 1 -- 172.21.15.157:0/1908390688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0fdc40 msgr2=0x7f7b1c0f7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:10.888 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.884+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/1908390688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0fdc40 0x7f7b1c0f7340 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f7b10004650 tx=0x7f7b10009b30 comp rx=0 tx=0).stop 2021-10-08T19:43:10.888 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.884+0000 7f7b1bfff700 1 -- 172.21.15.157:0/1908390688 shutdown_connections 2021-10-08T19:43:10.888 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.884+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/1908390688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b1c0f7a70 0x7f7b1c104110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.889 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.884+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/1908390688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0fd2a0 0x7f7b1c0fd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.889 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.884+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/1908390688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0fdc40 0x7f7b1c0f7340 unknown :-1 s=CLOSED pgs=2667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.889 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.884+0000 7f7b1bfff700 1 -- 172.21.15.157:0/1908390688 >> 172.21.15.157:0/1908390688 conn(0x7f7b1c0f2f00 msgr2=0x7f7b1c0f5310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:10.889 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.884+0000 7f7b1bfff700 1 -- 172.21.15.157:0/1908390688 shutdown_connections 2021-10-08T19:43:10.890 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.884+0000 7f7b1bfff700 1 -- 172.21.15.157:0/1908390688 wait complete. 2021-10-08T19:43:10.890 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1bfff700 1 Processor -- start 2021-10-08T19:43:10.890 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1bfff700 1 -- start start 2021-10-08T19:43:10.890 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0f7a70 0x7f7b1c1098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:10.891 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1bfff700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0fd2a0 0x7f7b1c109de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:10.891 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1bfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b1c0fdc40 0x7f7b1c114920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:10.891 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1bfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c10a5a0 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.891 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1bfff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c10a710 con 0x7f7b1c0fdc40 2021-10-08T19:43:10.891 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1bfff700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c114e90 con 0x7f7b1c0fd2a0 2021-10-08T19:43:10.892 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0f7a70 0x7f7b1c1098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:10.892 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0f7a70 0x7f7b1c1098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:51294/0 (socket says 172.21.15.157:51294) 2021-10-08T19:43:10.892 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1affd700 1 -- 172.21.15.157:0/2987158083 learned_addr learned my addr 172.21.15.157:0/2987158083 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:43:10.892 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1a7fc700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0fd2a0 0x7f7b1c109de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:10.893 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1b7fe700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b1c0fdc40 0x7f7b1c114920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:10.893 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1affd700 1 -- 172.21.15.157:0/2987158083 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0fd2a0 msgr2=0x7f7b1c109de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:10.893 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1affd700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0fd2a0 0x7f7b1c109de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.893 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1affd700 1 -- 172.21.15.157:0/2987158083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b1c0fdc40 msgr2=0x7f7b1c114920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:10.894 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1affd700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b1c0fdc40 0x7f7b1c114920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:10.894 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.885+0000 7f7b1affd700 1 -- 172.21.15.157:0/2987158083 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c005040 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.894 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.886+0000 7f7b1a7fc700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0fd2a0 0x7f7b1c109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:43:10.894 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.886+0000 7f7b1affd700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0f7a70 0x7f7b1c1098a0 secure :-1 s=READY pgs=2668 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0049e0 tx=0x7f7b0c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:10.894 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.886+0000 7f7b037fe700 1 -- 172.21.15.157:0/2987158083 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00e050 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.895 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.886+0000 7f7b037fe700 1 -- 172.21.15.157:0/2987158083 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f7b0c00f040 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.895 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.886+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b10005040 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.895 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.886+0000 7f7b037fe700 1 -- 172.21.15.157:0/2987158083 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c014830 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.895 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.886+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c115520 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.896 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.887+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c047b50 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.896 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.887+0000 7f7b037fe700 1 -- 172.21.15.157:0/2987158083 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f7b0c01b030 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.896 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.888+0000 7f7b037fe700 1 --2- 172.21.15.157:0/2987158083 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7b040634f0 0x7f7b040659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:10.896 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.888+0000 7f7b037fe700 1 -- 172.21.15.157:0/2987158083 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(757..757 src has 1..757) v4 ==== 8004+0+0 (secure 0 0 0) 0x7f7b0c07fb60 con 0x7f7b1c0f7a70 2021-10-08T19:43:10.897 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.888+0000 7f7b1a7fc700 1 --2- 172.21.15.157:0/2987158083 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7b040634f0 0x7f7b040659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:10.897 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.888+0000 7f7b1a7fc700 1 --2- 172.21.15.157:0/2987158083 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7b040634f0 0x7f7b040659a0 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 crypto rx=0x7f7b10004570 tx=0x7f7b10017040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:10.898 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:10.892+0000 7f7b037fe700 1 -- 172.21.15.157:0/2987158083 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7b0c048b00 con 0x7f7b1c0f7a70 2021-10-08T19:43:11.058 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:11.058+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"} v 0) v1 -- 0x7f7b1c061e90 con 0x7f7b1c0f7a70 2021-10-08T19:43:11.577 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[42114]: pgmap v1220: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:11.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3256598522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]: dispatch 2021-10-08T19:43:11.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3256598522' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]': finished 2021-10-08T19:43:11.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[42114]: osdmap e757: 8 total, 8 up, 8 in 2021-10-08T19:43:11.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3256598522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]: dispatch 2021-10-08T19:43:11.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]: dispatch 2021-10-08T19:43:11.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[32847]: pgmap v1220: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:11.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3256598522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]: dispatch 2021-10-08T19:43:11.579 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3256598522' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]': finished 2021-10-08T19:43:11.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[32847]: osdmap e757: 8 total, 8 up, 8 in 2021-10-08T19:43:11.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3256598522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]: dispatch 2021-10-08T19:43:11.580 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:11 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]: dispatch 2021-10-08T19:43:11.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:11 smithi196 ceph-mon[34258]: pgmap v1220: 176 pgs: 176 active+clean; 687 KiB data, 498 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:11.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3256598522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]: dispatch 2021-10-08T19:43:11.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3256598522' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]': finished 2021-10-08T19:43:11.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:11 smithi196 ceph-mon[34258]: osdmap e757: 8 total, 8 up, 8 in 2021-10-08T19:43:11.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3256598522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pg_num": 12}]: dispatch 2021-10-08T19:43:11.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:11 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]: dispatch 2021-10-08T19:43:11.657 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:11.657+0000 7f7b037fe700 1 -- 172.21.15.157:0/2987158083 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]=0 enabled application 'rados' on pool '807b6f86-3833-41c4-ab00-99daf67b7e38' v758) v1 ==== 213+0+0 (secure 0 0 0) 0x7f7b0c019020 con 0x7f7b1c0f7a70 2021-10-08T19:43:11.771 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:11.771+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"} v 0) v1 -- 0x7f7b1c115740 con 0x7f7b1c0f7a70 2021-10-08T19:43:12.661 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.661+0000 7f7b037fe700 1 -- 172.21.15.157:0/2987158083 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]=0 enabled application 'rados' on pool '807b6f86-3833-41c4-ab00-99daf67b7e38' v759) v1 ==== 213+0+0 (secure 0 0 0) 0x7f7b0c052010 con 0x7f7b1c0f7a70 2021-10-08T19:43:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7b040634f0 msgr2=0x7f7b040659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/2987158083 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7b040634f0 0x7f7b040659a0 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 crypto rx=0x7f7b10004570 tx=0x7f7b10017040 comp rx=0 tx=0).stop 2021-10-08T19:43:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0f7a70 msgr2=0x7f7b1c1098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0f7a70 0x7f7b1c1098a0 secure :-1 s=READY pgs=2668 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0049e0 tx=0x7f7b0c009b30 comp rx=0 tx=0).stop 2021-10-08T19:43:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 shutdown_connections 2021-10-08T19:43:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b1c0fdc40 0x7f7b1c114920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:12.667 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0f7a70 0x7f7b1c1098a0 unknown :-1 s=CLOSED pgs=2668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:12.667 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/2987158083 >> v2:172.21.15.157:6800/1475557172 conn(0x7f7b040634f0 0x7f7b040659a0 unknown :-1 s=CLOSED pgs=3308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:12.667 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 --2- 172.21.15.157:0/2987158083 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0fd2a0 0x7f7b1c109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:12.667 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 >> 172.21.15.157:0/2987158083 conn(0x7f7b1c0f2f00 msgr2=0x7f7b1c0f4670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:12.668 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 shutdown_connections 2021-10-08T19:43:12.668 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.665+0000 7f7b1bfff700 1 -- 172.21.15.157:0/2987158083 wait complete. 2021-10-08T19:43:12.668 INFO:tasks.workunit.client.0.smithi157.stderr:enabled application 'rados' on pool '807b6f86-3833-41c4-ab00-99daf67b7e38' 2021-10-08T19:43:12.675 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool set-quota 807b6f86-3833-41c4-ab00-99daf67b7e38 max_objects 10 2021-10-08T19:43:12.783 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/1472136911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9b40fef70 msgr2=0x7fb9b40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:12.784 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/1472136911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9b40fef70 0x7fb9b40f6b40 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40046e0 tx=0x7fb9a4009b30 comp rx=0 tx=0).stop 2021-10-08T19:43:12.784 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/1472136911 shutdown_connections 2021-10-08T19:43:12.785 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/1472136911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b40f7270 0x7fb9b4105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:12.785 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/1472136911 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9b40fe660 0x7fb9b40fea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:12.786 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/1472136911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9b40fef70 0x7fb9b40f6b40 unknown :-1 s=CLOSED pgs=2716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:12.786 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/1472136911 >> 172.21.15.157:0/1472136911 conn(0x7fb9b406d910 msgr2=0x7fb9b40f4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:12.787 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/1472136911 shutdown_connections 2021-10-08T19:43:12.787 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/1472136911 wait complete. 2021-10-08T19:43:12.788 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.777+0000 7fb9bbdc0700 1 Processor -- start 2021-10-08T19:43:12.788 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9bbdc0700 1 -- start start 2021-10-08T19:43:12.788 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9bbdc0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b40f7270 0x7fb9b410eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:12.789 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9bbdc0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9b40fe660 0x7fb9b410f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:12.789 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9bbdc0700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9b40fef70 0x7fb9b4108bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:12.790 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9bbdc0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4109140 con 0x7fb9b40f7270 2021-10-08T19:43:12.790 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9bbdc0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4109280 con 0x7fb9b40fe660 2021-10-08T19:43:12.790 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9bbdc0700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4109440 con 0x7fb9b40fef70 2021-10-08T19:43:12.791 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9b9b5c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b40f7270 0x7fb9b410eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:12.791 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9b9b5c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b40f7270 0x7fb9b410eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:51310/0 (socket says 172.21.15.157:51310) 2021-10-08T19:43:12.792 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9ba35d700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9b40fef70 0x7fb9b4108bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:12.792 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9b9b5c700 1 -- 172.21.15.157:0/2948240452 learned_addr learned my addr 172.21.15.157:0/2948240452 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:43:12.792 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9b935b700 1 --2- 172.21.15.157:0/2948240452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9b40fe660 0x7fb9b410f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:12.793 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9ba35d700 1 -- 172.21.15.157:0/2948240452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9b40fe660 msgr2=0x7fb9b410f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:12.793 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9ba35d700 1 --2- 172.21.15.157:0/2948240452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9b40fe660 0x7fb9b410f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:12.794 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9ba35d700 1 -- 172.21.15.157:0/2948240452 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b40f7270 msgr2=0x7fb9b410eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:12.794 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9ba35d700 1 --2- 172.21.15.157:0/2948240452 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b40f7270 0x7fb9b410eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:12.794 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9ba35d700 1 -- 172.21.15.157:0/2948240452 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac009640 con 0x7fb9b40fef70 2021-10-08T19:43:12.795 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9b9b5c700 1 --2- 172.21.15.157:0/2948240452 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b40f7270 0x7fb9b410eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:43:12.795 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9ba35d700 1 --2- 172.21.15.157:0/2948240452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9b40fef70 0x7fb9b4108bb0 secure :-1 s=READY pgs=2717 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac001c50 tx=0x7fb9ac004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:12.796 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9aa7fc700 1 -- 172.21.15.157:0/2948240452 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0092e0 con 0x7fb9b40fef70 2021-10-08T19:43:12.796 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9aa7fc700 1 -- 172.21.15.157:0/2948240452 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fb9ac009440 con 0x7fb9b40fef70 2021-10-08T19:43:12.796 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a4005040 con 0x7fb9b40fef70 2021-10-08T19:43:12.797 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.778+0000 7fb9aa7fc700 1 -- 172.21.15.157:0/2948240452 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00fb10 con 0x7fb9b40fef70 2021-10-08T19:43:12.797 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.779+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b4115930 con 0x7fb9b40fef70 2021-10-08T19:43:12.798 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.779+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b405fc40 con 0x7fb9b40fef70 2021-10-08T19:43:12.798 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.780+0000 7fb9aa7fc700 1 -- 172.21.15.157:0/2948240452 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fb9ac007620 con 0x7fb9b40fef70 2021-10-08T19:43:12.798 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.780+0000 7fb9aa7fc700 1 --2- 172.21.15.157:0/2948240452 >> v2:172.21.15.157:6800/1475557172 conn(0x7fb9a00634f0 0x7fb9a00659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:12.799 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.780+0000 7fb9aa7fc700 1 -- 172.21.15.157:0/2948240452 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(759..759 src has 1..759) v4 ==== 8017+0+0 (secure 0 0 0) 0x7fb9ac080210 con 0x7fb9b40fef70 2021-10-08T19:43:12.799 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.780+0000 7fb9b9b5c700 1 --2- 172.21.15.157:0/2948240452 >> v2:172.21.15.157:6800/1475557172 conn(0x7fb9a00634f0 0x7fb9a00659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:12.800 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.781+0000 7fb9b9b5c700 1 --2- 172.21.15.157:0/2948240452 >> v2:172.21.15.157:6800/1475557172 conn(0x7fb9a00634f0 0x7fb9a00659a0 secure :-1 s=READY pgs=3309 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00103c0 tx=0x7fb9b000b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:12.801 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.784+0000 7fb9aa7fc700 1 -- 172.21.15.157:0/2948240452 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fb9ac052680 con 0x7fb9b40fef70 2021-10-08T19:43:12.959 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:12.958+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7fb9b410a110 con 0x7fb9b40fef70 2021-10-08T19:43:13.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]': finished 2021-10-08T19:43:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:12 smithi157 ceph-mon[32847]: osdmap e758: 8 total, 8 up, 8 in 2021-10-08T19:43:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:12 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]: dispatch 2021-10-08T19:43:13.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:12 smithi157 ceph-mon[32847]: pgmap v1223: 188 pgs: 188 active+clean; 704 KiB data, 499 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 4.6 KiB/s wr, 1 op/s 2021-10-08T19:43:13.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]': finished 2021-10-08T19:43:13.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:12 smithi157 ceph-mon[42114]: osdmap e758: 8 total, 8 up, 8 in 2021-10-08T19:43:13.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:12 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]: dispatch 2021-10-08T19:43:13.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:12 smithi157 ceph-mon[42114]: pgmap v1223: 188 pgs: 188 active+clean; 704 KiB data, 499 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 4.6 KiB/s wr, 1 op/s 2021-10-08T19:43:13.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]': finished 2021-10-08T19:43:13.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:12 smithi196 ceph-mon[34258]: osdmap e758: 8 total, 8 up, 8 in 2021-10-08T19:43:13.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:12 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]: dispatch 2021-10-08T19:43:13.120 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:12 smithi196 ceph-mon[34258]: pgmap v1223: 188 pgs: 188 active+clean; 704 KiB data, 499 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 4.6 KiB/s wr, 1 op/s 2021-10-08T19:43:13.670 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:13.671+0000 7fb9aa7fc700 1 -- 172.21.15.157:0/2948240452 <== mon.1 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 807b6f86-3833-41c4-ab00-99daf67b7e38 v760) v1 ==== 223+0+0 (secure 0 0 0) 0x7fb9ac01a0d0 con 0x7fb9b40fef70 2021-10-08T19:43:13.781 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:13.781+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7fb9b4107ae0 con 0x7fb9b40fef70 2021-10-08T19:43:13.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:13 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:43:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:13.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]': finished 2021-10-08T19:43:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:13 smithi157 ceph-mon[32847]: osdmap e759: 8 total, 8 up, 8 in 2021-10-08T19:43:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:13 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2948240452' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:13.829 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:13 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:13.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]': finished 2021-10-08T19:43:13.830 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:13 smithi157 ceph-mon[42114]: osdmap e759: 8 total, 8 up, 8 in 2021-10-08T19:43:13.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:13 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2948240452' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:13.831 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:13 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:13.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:13.536Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:13.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:13.536Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:13.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:13.536Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:43:14.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2987158083' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "app": "rados"}]': finished 2021-10-08T19:43:14.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:13 smithi196 ceph-mon[34258]: osdmap e759: 8 total, 8 up, 8 in 2021-10-08T19:43:14.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:13 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2948240452' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:14.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:13 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:14.733 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.733+0000 7fb9aa7fc700 1 -- 172.21.15.157:0/2948240452 <== mon.1 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 807b6f86-3833-41c4-ab00-99daf67b7e38 v761) v1 ==== 223+0+0 (secure 0 0 0) 0x7fb9ac052270 con 0x7fb9b40fef70 2021-10-08T19:43:14.736 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 >> v2:172.21.15.157:6800/1475557172 conn(0x7fb9a00634f0 msgr2=0x7fb9a00659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:14.737 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/2948240452 >> v2:172.21.15.157:6800/1475557172 conn(0x7fb9a00634f0 0x7fb9a00659a0 secure :-1 s=READY pgs=3309 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00103c0 tx=0x7fb9b000b040 comp rx=0 tx=0).stop 2021-10-08T19:43:14.737 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9b40fef70 msgr2=0x7fb9b4108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:14.737 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/2948240452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9b40fef70 0x7fb9b4108bb0 secure :-1 s=READY pgs=2717 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac001c50 tx=0x7fb9ac004c50 comp rx=0 tx=0).stop 2021-10-08T19:43:14.737 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 shutdown_connections 2021-10-08T19:43:14.737 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/2948240452 >> v2:172.21.15.157:6800/1475557172 conn(0x7fb9a00634f0 0x7fb9a00659a0 unknown :-1 s=CLOSED pgs=3309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:14.738 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/2948240452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9b40fef70 0x7fb9b4108bb0 unknown :-1 s=CLOSED pgs=2717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:14.738 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/2948240452 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b40f7270 0x7fb9b410eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:14.738 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 --2- 172.21.15.157:0/2948240452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9b40fe660 0x7fb9b410f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:14.738 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.736+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 >> 172.21.15.157:0/2948240452 conn(0x7fb9b406d910 msgr2=0x7fb9b406e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:14.739 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.737+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 shutdown_connections 2021-10-08T19:43:14.739 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:43:14.737+0000 7fb9bbdc0700 1 -- 172.21.15.157:0/2948240452 wait complete. 2021-10-08T19:43:14.739 INFO:tasks.workunit.client.0.smithi157.stderr:set-quota max_objects = 10 for pool 807b6f86-3833-41c4-ab00-99daf67b7e38 2021-10-08T19:43:14.749 INFO:tasks.workunit.client.0.smithi157.stderr:+ sleep 30 2021-10-08T19:43:15.077 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:43:15.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[42114]: osdmap e760: 8 total, 8 up, 8 in 2021-10-08T19:43:15.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:15.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:43:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:43:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2948240452' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:15.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[42114]: pgmap v1226: 188 pgs: 188 active+clean; 704 KiB data, 499 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2021-10-08T19:43:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:43:15.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[32847]: osdmap e760: 8 total, 8 up, 8 in 2021-10-08T19:43:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:43:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:43:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:15.081 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2948240452' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:15.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:15.082 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:14 smithi157 ceph-mon[32847]: pgmap v1226: 188 pgs: 188 active+clean; 704 KiB data, 499 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2021-10-08T19:43:15.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:43:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:14 smithi196 ceph-mon[34258]: osdmap e760: 8 total, 8 up, 8 in 2021-10-08T19:43:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:14 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:14 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:43:15.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:14 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:43:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:14 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2948240452' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:14 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:43:15.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:14 smithi196 ceph-mon[34258]: pgmap v1226: 188 pgs: 188 active+clean; 704 KiB data, 499 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2021-10-08T19:43:16.077 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:15 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:43:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:16.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:15 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:43:16.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:15 smithi157 ceph-mon[32847]: osdmap e761: 8 total, 8 up, 8 in 2021-10-08T19:43:16.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:15 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:43:16.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:15 smithi157 ceph-mon[42114]: osdmap e761: 8 total, 8 up, 8 in 2021-10-08T19:43:16.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:15 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:43:16.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:15 smithi196 ceph-mon[34258]: osdmap e761: 8 total, 8 up, 8 in 2021-10-08T19:43:17.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:16 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:16 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:43:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:16 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:43:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:16 smithi157 ceph-mon[32847]: pgmap v1228: 188 pgs: 188 active+clean; 704 KiB data, 499 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 1 op/s 2021-10-08T19:43:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:16 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:16 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:43:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:16 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:43:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:16 smithi157 ceph-mon[42114]: pgmap v1228: 188 pgs: 188 active+clean; 704 KiB data, 499 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 1 op/s 2021-10-08T19:43:17.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:16 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:17.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:16 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:43:17.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:16 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:43:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:17.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:16 smithi196 ceph-mon[34258]: pgmap v1228: 188 pgs: 188 active+clean; 704 KiB data, 499 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 1 op/s 2021-10-08T19:43:17.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:17] "GET /metrics HTTP/1.1" 200 156612 "" "Prometheus/2.18.1" 2021-10-08T19:43:17.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:43:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:43:19.012 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:43:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:19.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:19 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:19 smithi157 ceph-mon[32847]: pgmap v1229: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:19.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:19 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:19 smithi157 ceph-mon[42114]: pgmap v1229: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:19.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:19 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:19.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:19 smithi196 ceph-mon[34258]: pgmap v1229: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:21.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:20 smithi157 ceph-mon[32847]: pgmap v1230: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 701 B/s rd, 0 op/s 2021-10-08T19:43:21.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:20 smithi157 ceph-mon[42114]: pgmap v1230: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 701 B/s rd, 0 op/s 2021-10-08T19:43:21.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:20 smithi196 ceph-mon[34258]: pgmap v1230: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 701 B/s rd, 0 op/s 2021-10-08T19:43:23.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:23 smithi157 ceph-mon[32847]: pgmap v1231: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:23.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:23 smithi157 ceph-mon[42114]: pgmap v1231: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:23.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:23 smithi196 ceph-mon[34258]: pgmap v1231: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:23.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:23.537Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:23.537Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:23.537Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:43:25.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:25 smithi157 ceph-mon[32847]: pgmap v1232: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:25.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:25 smithi157 ceph-mon[42114]: pgmap v1232: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:25.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:25 smithi196 ceph-mon[34258]: pgmap v1232: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:27.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:27 smithi157 ceph-mon[32847]: pgmap v1233: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 0 op/s 2021-10-08T19:43:27.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:27 smithi157 ceph-mon[42114]: pgmap v1233: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 0 op/s 2021-10-08T19:43:27.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:27 smithi196 ceph-mon[34258]: pgmap v1233: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 0 op/s 2021-10-08T19:43:27.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:27] "GET /metrics HTTP/1.1" 200 157731 "" "Prometheus/2.18.1" 2021-10-08T19:43:27.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:43:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:43:29.022 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:43:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:29.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:29 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:29.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:29 smithi157 ceph-mon[32847]: pgmap v1234: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:29.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:29 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:29.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:29 smithi157 ceph-mon[42114]: pgmap v1234: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:29.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:29 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:29.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:29 smithi196 ceph-mon[34258]: pgmap v1234: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:30.577 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:30 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:30.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:30.578 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:30 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:30.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:30.578 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:30 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:30.140Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:43:31.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:30 smithi157 ceph-mon[32847]: pgmap v1235: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:31.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:30 smithi157 ceph-mon[42114]: pgmap v1235: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:31.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:30 smithi196 ceph-mon[34258]: pgmap v1235: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:33.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[42114]: pgmap v1236: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:33.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:43:33.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:43:33.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:43:33.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:33.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[32847]: pgmap v1236: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:33.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:43:33.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:43:33.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:43:33.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:33 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:33 smithi196 ceph-mon[34258]: pgmap v1236: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:33.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:33 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:43:33.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:33 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:43:33.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:33 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:43:33.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:33 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:33.537Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:33.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:33.537Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:33.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:33.537Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:43:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:35 smithi157 ceph-mon[32847]: pgmap v1237: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:35.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:35 smithi157 ceph-mon[42114]: pgmap v1237: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:35.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:35 smithi196 ceph-mon[34258]: pgmap v1237: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:37.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[32847]: pgmap v1238: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:37.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:37.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:37.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:37.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[42114]: pgmap v1238: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:37.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:37.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:37 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:37.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:37 smithi196 ceph-mon[34258]: pgmap v1238: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:37 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:37 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:37 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:37.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:37 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:37.830 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:37] "GET /metrics HTTP/1.1" 200 157733 "" "Prometheus/2.18.1" 2021-10-08T19:43:37.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:43:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:43:39.024 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:43:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:39.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:39 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:39.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:39 smithi157 ceph-mon[32847]: pgmap v1239: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:39.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:39 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:39.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:39 smithi157 ceph-mon[42114]: pgmap v1239: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:39.328 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:39 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:43:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:39 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:39 smithi196 ceph-mon[34258]: pgmap v1239: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:40.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:40 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:40.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:40 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:43:40.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:40 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:43:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:40.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:40 smithi157 ceph-mon[32847]: pgmap v1240: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:40.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:40 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:40.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:40 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:43:40.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:40 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:43:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:40.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:40 smithi157 ceph-mon[42114]: pgmap v1240: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:40.580 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:40 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:40.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:40.580 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:40 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:40.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:40.580 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:40 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:40.140Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:43:40.616 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:40 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:40.617 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:40 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:43:40.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:40 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:43:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:40.618 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:40 smithi196 ceph-mon[34258]: pgmap v1240: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:42.327 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:42 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:43:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:43.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:43 smithi157 ceph-mon[32847]: pgmap v1241: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:43.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:43 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:43 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:43:43.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:43 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:43:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:43.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:43 smithi157 ceph-mon[42114]: pgmap v1241: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:43.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:43 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:43.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:43 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:43:43.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:43 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:43:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:43 smithi196 ceph-mon[34258]: pgmap v1241: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:43 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:43:43.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:43 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:43:43.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:43 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:43:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:43.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:43.537Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:43.537Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:43.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:43.538Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:43:44.751 INFO:tasks.workunit.client.0.smithi157.stderr:++ seq 1 10 2021-10-08T19:43:44.753 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:44.753 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj1 /etc/passwd 2021-10-08T19:43:44.790 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:44.790 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj2 /etc/passwd 2021-10-08T19:43:44.822 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:44.822 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj3 /etc/passwd 2021-10-08T19:43:44.854 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:44.854 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj4 /etc/passwd 2021-10-08T19:43:44.887 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:44.889 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj5 /etc/passwd 2021-10-08T19:43:44.915 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:44.915 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj6 /etc/passwd 2021-10-08T19:43:44.944 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:44.945 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj7 /etc/passwd 2021-10-08T19:43:44.973 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:44.975 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj8 /etc/passwd 2021-10-08T19:43:45.002 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:45.002 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj9 /etc/passwd 2021-10-08T19:43:45.033 INFO:tasks.workunit.client.0.smithi157.stderr:+ for f in `seq 1 10` 2021-10-08T19:43:45.033 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 807b6f86-3833-41c4-ab00-99daf67b7e38 put obj10 /etc/passwd 2021-10-08T19:43:45.063 INFO:tasks.workunit.client.0.smithi157.stderr:+ sleep 30 2021-10-08T19:43:45.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:45 smithi157 ceph-mon[32847]: pgmap v1242: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:45.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:45 smithi157 ceph-mon[42114]: pgmap v1242: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:45.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:45 smithi196 ceph-mon[34258]: pgmap v1242: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:47.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:47 smithi157 ceph-mon[32847]: pgmap v1243: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:47.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:47 smithi157 ceph-mon[42114]: pgmap v1243: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:47.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:47 smithi196 ceph-mon[34258]: pgmap v1243: 188 pgs: 188 active+clean; 704 KiB data, 500 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:47.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:47] "GET /metrics HTTP/1.1" 200 157733 "" "Prometheus/2.18.1" 2021-10-08T19:43:47.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:43:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:43:49.017 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:43:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:49.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:49 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:49.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:49 smithi157 ceph-mon[32847]: pgmap v1244: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.5 KiB/s wr, 2 op/s 2021-10-08T19:43:49.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:49 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:49.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:49 smithi157 ceph-mon[42114]: pgmap v1244: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.5 KiB/s wr, 2 op/s 2021-10-08T19:43:49.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:49 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:49.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:49 smithi196 ceph-mon[34258]: pgmap v1244: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.5 KiB/s wr, 2 op/s 2021-10-08T19:43:50.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:50 smithi157 ceph-mon[32847]: pool '807b6f86-3833-41c4-ab00-99daf67b7e38' is full (reached quota's max_objects: 10) 2021-10-08T19:43:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:50 smithi157 ceph-mon[32847]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:43:50.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:50 smithi157 ceph-mon[32847]: osdmap e762: 8 total, 8 up, 8 in 2021-10-08T19:43:50.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:50 smithi157 ceph-mon[42114]: pool '807b6f86-3833-41c4-ab00-99daf67b7e38' is full (reached quota's max_objects: 10) 2021-10-08T19:43:50.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:50 smithi157 ceph-mon[42114]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:43:50.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:50 smithi157 ceph-mon[42114]: osdmap e762: 8 total, 8 up, 8 in 2021-10-08T19:43:50.330 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:50 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:50.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:50.330 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:50 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:50.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:50.330 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:50 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:50.140Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:43:50.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:50 smithi196 ceph-mon[34258]: pool '807b6f86-3833-41c4-ab00-99daf67b7e38' is full (reached quota's max_objects: 10) 2021-10-08T19:43:50.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:50 smithi196 ceph-mon[34258]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:43:50.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:50 smithi196 ceph-mon[34258]: osdmap e762: 8 total, 8 up, 8 in 2021-10-08T19:43:51.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:51 smithi157 ceph-mon[32847]: pgmap v1246: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:51.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:51 smithi157 ceph-mon[42114]: pgmap v1246: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:51.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:51 smithi196 ceph-mon[34258]: pgmap v1246: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:53.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:53 smithi157 ceph-mon[32847]: pgmap v1247: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:53.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:53 smithi157 ceph-mon[42114]: pgmap v1247: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:53.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:53 smithi196 ceph-mon[34258]: pgmap v1247: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:53.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:53.538Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:53.538Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:43:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:43:53.538Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:43:55.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:55 smithi157 ceph-mon[32847]: pgmap v1248: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:55.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:55 smithi157 ceph-mon[42114]: pgmap v1248: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:55.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:55 smithi196 ceph-mon[34258]: pgmap v1248: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:57.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:57 smithi157 ceph-mon[32847]: pgmap v1249: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:57.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:57 smithi157 ceph-mon[42114]: pgmap v1249: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:57.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:57 smithi196 ceph-mon[34258]: pgmap v1249: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:57.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:43:57 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:57] "GET /metrics HTTP/1.1" 200 157766 "" "Prometheus/2.18.1" 2021-10-08T19:43:57.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:43:57 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:43:59.036 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:43:58 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:43:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:59.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:59 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:59.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:43:59 smithi157 ceph-mon[32847]: pgmap v1250: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:59.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:59 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:59.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:43:59 smithi157 ceph-mon[42114]: pgmap v1250: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:59.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:59 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:59.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:43:59 smithi196 ceph-mon[34258]: pgmap v1250: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:00.578 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:00 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:00.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:00.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:00 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:00.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:00.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:00 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:00.141Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:44:01.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:00 smithi157 ceph-mon[32847]: pgmap v1251: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2021-10-08T19:44:01.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:00 smithi157 ceph-mon[42114]: pgmap v1251: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2021-10-08T19:44:01.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:00 smithi196 ceph-mon[34258]: pgmap v1251: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2021-10-08T19:44:03.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:03 smithi157 ceph-mon[32847]: pgmap v1252: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:03.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:03 smithi157 ceph-mon[42114]: pgmap v1252: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:03.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:03 smithi196 ceph-mon[34258]: pgmap v1252: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:03.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:03.538Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:03.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:03.538Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:03.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:03.538Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:44:05.028 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:04 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:44:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:05.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:05 smithi157 ceph-mon[32847]: pgmap v1253: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:05.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:05 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:05.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:05 smithi157 ceph-mon[42114]: pgmap v1253: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:05.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:05 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:05.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:05 smithi196 ceph-mon[34258]: pgmap v1253: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:05.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:05 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:06.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:06 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:44:06.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:06 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:44:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:06.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:06 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:44:06.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:06 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:44:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:06.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:06 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:44:06.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:06 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:44:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:07.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:07 smithi157 ceph-mon[32847]: pgmap v1254: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:07.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:07 smithi157 ceph-mon[42114]: pgmap v1254: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:07.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:07 smithi196 ceph-mon[34258]: pgmap v1254: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:07.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:07 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:07] "GET /metrics HTTP/1.1" 200 157769 "" "Prometheus/2.18.1" 2021-10-08T19:44:07.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:44:07 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:44:08.577 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:08 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:44:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:09.037 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:44:08 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:09 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:09 smithi157 ceph-mon[32847]: pgmap v1255: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:09.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:09 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:09.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:09 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:09.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:09 smithi157 ceph-mon[42114]: pgmap v1255: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:09.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:09 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:09.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:09 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:09.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:09 smithi196 ceph-mon[34258]: pgmap v1255: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:09.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:09 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:10.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:10 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:44:10.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:10 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:44:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:10.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:10 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:44:10.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:10 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:44:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:10.330 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:10 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:10.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:10.330 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:10 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:10.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:10.330 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:10 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:10.141Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:44:10.370 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:10 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:44:10.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:10 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:44:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:11.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:11 smithi157 ceph-mon[32847]: pgmap v1256: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:11.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:11 smithi157 ceph-mon[42114]: pgmap v1256: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:11.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:11 smithi196 ceph-mon[34258]: pgmap v1256: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:13.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:13 smithi157 ceph-mon[32847]: pgmap v1257: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:13.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:13 smithi157 ceph-mon[42114]: pgmap v1257: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:13.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:13 smithi196 ceph-mon[34258]: pgmap v1257: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:13.538Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:13.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:13.538Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:13.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:13 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:13.538Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:44:15.063 INFO:tasks.workunit.client.0.smithi157.stderr:+ rados -p 96ef6666-8683-4159-9a16-d5ae4e1d0495 put threemore /etc/passwd 2021-10-08T19:44:15.100 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool set-quota 96ef6666-8683-4159-9a16-d5ae4e1d0495 max_bytes 0 2021-10-08T19:44:15.207 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.202+0000 7fcf37648700 1 -- 172.21.15.157:0/3873393091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f81e0 msgr2=0x7fcf300f9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:15.207 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.202+0000 7fcf37648700 1 --2- 172.21.15.157:0/3873393091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f81e0 0x7fcf300f9090 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7fcf20004620 tx=0x7fcf20009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:15.207 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.202+0000 7fcf37648700 1 -- 172.21.15.157:0/3873393091 shutdown_connections 2021-10-08T19:44:15.208 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.202+0000 7fcf37648700 1 --2- 172.21.15.157:0/3873393091 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf300f97c0 0x7fcf301043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:15.208 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.202+0000 7fcf37648700 1 --2- 172.21.15.157:0/3873393091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf300f78d0 0x7fcf300f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:15.208 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.202+0000 7fcf37648700 1 --2- 172.21.15.157:0/3873393091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f81e0 0x7fcf300f9090 unknown :-1 s=CLOSED pgs=2686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:15.208 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.202+0000 7fcf37648700 1 -- 172.21.15.157:0/3873393091 >> 172.21.15.157:0/3873393091 conn(0x7fcf3006d1f0 msgr2=0x7fcf300f5650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:15.209 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.202+0000 7fcf37648700 1 -- 172.21.15.157:0/3873393091 shutdown_connections 2021-10-08T19:44:15.209 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.202+0000 7fcf37648700 1 -- 172.21.15.157:0/3873393091 wait complete. 2021-10-08T19:44:15.209 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf37648700 1 Processor -- start 2021-10-08T19:44:15.210 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf37648700 1 -- start start 2021-10-08T19:44:15.210 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf37648700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf300f78d0 0x7fcf30110c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:15.210 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf37648700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f97c0 0x7fcf30111170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:15.210 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf37648700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf3010ace0 0x7fcf3010b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:15.211 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf37648700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3010b690 con 0x7fcf300f97c0 2021-10-08T19:44:15.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf37648700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3010b800 con 0x7fcf3010ace0 2021-10-08T19:44:15.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf37648700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3010b9c0 con 0x7fcf300f78d0 2021-10-08T19:44:15.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf353e4700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf300f78d0 0x7fcf30110c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:15.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf34be3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f97c0 0x7fcf30111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf353e4700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf300f78d0 0x7fcf30110c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:32890/0 (socket says 172.21.15.157:32890) 2021-10-08T19:44:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf34be3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f97c0 0x7fcf30111170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:51876/0 (socket says 172.21.15.157:51876) 2021-10-08T19:44:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.203+0000 7fcf353e4700 1 -- 172.21.15.157:0/2628162230 learned_addr learned my addr 172.21.15.157:0/2628162230 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:44:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf34be3700 1 -- 172.21.15.157:0/2628162230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf300f78d0 msgr2=0x7fcf30110c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf35be5700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf3010ace0 0x7fcf3010b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf34be3700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf300f78d0 0x7fcf30110c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf34be3700 1 -- 172.21.15.157:0/2628162230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf3010ace0 msgr2=0x7fcf3010b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf34be3700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf3010ace0 0x7fcf3010b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf34be3700 1 -- 172.21.15.157:0/2628162230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c005040 con 0x7fcf300f97c0 2021-10-08T19:44:15.215 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf353e4700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf300f78d0 0x7fcf30110c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:44:15.215 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf35be5700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf3010ace0 0x7fcf3010b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:44:15.215 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf34be3700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f97c0 0x7fcf30111170 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009f50 tx=0x7fcf20009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:15.216 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2001a070 con 0x7fcf300f97c0 2021-10-08T19:44:15.216 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7fcf20007920 con 0x7fcf300f97c0 2021-10-08T19:44:15.216 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf20005040 con 0x7fcf300f97c0 2021-10-08T19:44:15.216 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2001e7b0 con 0x7fcf300f97c0 2021-10-08T19:44:15.216 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.204+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf30117c20 con 0x7fcf300f97c0 2021-10-08T19:44:15.217 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.205+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30060900 con 0x7fcf300f97c0 2021-10-08T19:44:15.217 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.205+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7fcf20007d20 con 0x7fcf300f97c0 2021-10-08T19:44:15.217 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.206+0000 7fcf25ffb700 1 --2- 172.21.15.157:0/2628162230 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcf1c0634d0 0x7fcf1c065980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:15.217 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.206+0000 7fcf353e4700 1 --2- 172.21.15.157:0/2628162230 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcf1c0634d0 0x7fcf1c065980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:15.218 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.206+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(762..762 src has 1..762) v4 ==== 8017+0+0 (secure 0 0 0) 0x7fcf20080950 con 0x7fcf300f97c0 2021-10-08T19:44:15.218 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.206+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=763}) v3 -- 0x7fcf1c06ef60 con 0x7fcf300f97c0 2021-10-08T19:44:15.218 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.206+0000 7fcf353e4700 1 --2- 172.21.15.157:0/2628162230 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcf1c0634d0 0x7fcf1c065980 secure :-1 s=READY pgs=3321 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c007fd0 tx=0x7fcf2c00b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:15.219 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.210+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fcf20052ee0 con 0x7fcf300f97c0 2021-10-08T19:44:15.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:15 smithi157 ceph-mon[32847]: pgmap v1258: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:15.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:15 smithi157 ceph-mon[42114]: pgmap v1258: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:15.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:15 smithi196 ceph-mon[34258]: pgmap v1258: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:15.375 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:15.375+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fcf3010c210 con 0x7fcf300f97c0 2021-10-08T19:44:16.052 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:16.051+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 7 ==== osd_map(763..763 src has 1..763) v4 ==== 620+0+0 (secure 0 0 0) 0x7fcf200512b0 con 0x7fcf300f97c0 2021-10-08T19:44:16.052 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:16.052+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=764}) v3 -- 0x7fcf1c06fba0 con 0x7fcf300f97c0 2021-10-08T19:44:16.055 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:16.055+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v763) v1 ==== 217+0+0 (secure 0 0 0) 0x7fcf20023020 con 0x7fcf300f97c0 2021-10-08T19:44:16.166 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:16.167+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fcf30109da0 con 0x7fcf300f97c0 2021-10-08T19:44:16.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:16 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:16.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:16 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:16.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:16 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:17.057 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.057+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 9 ==== osd_map(764..764 src has 1..764) v4 ==== 620+0+0 (secure 0 0 0) 0x7fcf20051510 con 0x7fcf300f97c0 2021-10-08T19:44:17.058 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.057+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=765}) v3 -- 0x7fcf1c06fe70 con 0x7fcf300f97c0 2021-10-08T19:44:17.060 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.060+0000 7fcf25ffb700 1 -- 172.21.15.157:0/2628162230 <== mon.0 v2:172.21.15.157:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v764) v1 ==== 217+0+0 (secure 0 0 0) 0x7fcf20057060 con 0x7fcf300f97c0 2021-10-08T19:44:17.066 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcf1c0634d0 msgr2=0x7fcf1c065980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:17.067 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 --2- 172.21.15.157:0/2628162230 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcf1c0634d0 0x7fcf1c065980 secure :-1 s=READY pgs=3321 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c007fd0 tx=0x7fcf2c00b040 comp rx=0 tx=0).stop 2021-10-08T19:44:17.067 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f97c0 msgr2=0x7fcf30111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:17.067 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f97c0 0x7fcf30111170 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009f50 tx=0x7fcf20009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:17.068 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 shutdown_connections 2021-10-08T19:44:17.069 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf3010ace0 0x7fcf3010b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:17.069 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 --2- 172.21.15.157:0/2628162230 >> v2:172.21.15.157:6800/1475557172 conn(0x7fcf1c0634d0 0x7fcf1c065980 unknown :-1 s=CLOSED pgs=3321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:17.070 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf300f78d0 0x7fcf30110c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:17.070 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 --2- 172.21.15.157:0/2628162230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf300f97c0 0x7fcf30111170 unknown :-1 s=CLOSED pgs=2687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:17.070 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 >> 172.21.15.157:0/2628162230 conn(0x7fcf3006d1f0 msgr2=0x7fcf3006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:17.070 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.066+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 shutdown_connections 2021-10-08T19:44:17.071 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.067+0000 7fcf37648700 1 -- 172.21.15.157:0/2628162230 wait complete. 2021-10-08T19:44:17.071 INFO:tasks.workunit.client.0.smithi157.stderr:set-quota max_bytes = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 2021-10-08T19:44:17.079 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool set-quota 96ef6666-8683-4159-9a16-d5ae4e1d0495 max_objects 0 2021-10-08T19:44:17.184 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 -- 172.21.15.157:0/259276258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 msgr2=0x7f069c1043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:17.184 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 --2- 172.21.15.157:0/259276258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 0x7f069c1043e0 secure :-1 s=READY pgs=2734 cs=0 l=1 rev1=1 crypto rx=0x7f0694004620 tx=0x7f0694009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:17.185 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 -- 172.21.15.157:0/259276258 shutdown_connections 2021-10-08T19:44:17.185 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 --2- 172.21.15.157:0/259276258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 0x7f069c1043e0 unknown :-1 s=CLOSED pgs=2734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:17.185 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 --2- 172.21.15.157:0/259276258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c0f93f0 0x7f069c0f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:17.185 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 --2- 172.21.15.157:0/259276258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f069c0f7620 0x7f069c0f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:17.186 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 -- 172.21.15.157:0/259276258 >> 172.21.15.157:0/259276258 conn(0x7f069c06e340 msgr2=0x7f069c06e740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:17.186 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 -- 172.21.15.157:0/259276258 shutdown_connections 2021-10-08T19:44:17.186 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 -- 172.21.15.157:0/259276258 wait complete. 2021-10-08T19:44:17.186 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 Processor -- start 2021-10-08T19:44:17.186 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 -- start start 2021-10-08T19:44:17.187 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.181+0000 7f06a45a0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f069c0f7620 0x7f069c1098c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:17.187 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a45a0700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 0x7f069c109e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:17.187 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a45a0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c0f93f0 0x7f069c10a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:17.187 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a45a0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c114b40 con 0x7f069c0f7620 2021-10-08T19:44:17.188 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a45a0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c114cb0 con 0x7f069c0f93f0 2021-10-08T19:44:17.188 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a45a0700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c114e70 con 0x7f069c0f7fd0 2021-10-08T19:44:17.188 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a233c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f069c0f7620 0x7f069c1098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:17.188 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a1b3b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 0x7f069c109e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:17.188 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a1b3b700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 0x7f069c109e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:32916/0 (socket says 172.21.15.157:32916) 2021-10-08T19:44:17.189 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a233c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f069c0f7620 0x7f069c1098c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:51898/0 (socket says 172.21.15.157:51898) 2021-10-08T19:44:17.189 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a1b3b700 1 -- 172.21.15.157:0/3571618916 learned_addr learned my addr 172.21.15.157:0/3571618916 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:44:17.189 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a1b3b700 1 -- 172.21.15.157:0/3571618916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c0f93f0 msgr2=0x7f069c10a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:17.189 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a2b3d700 1 --2- 172.21.15.157:0/3571618916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c0f93f0 0x7f069c10a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:17.190 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a1b3b700 1 --2- 172.21.15.157:0/3571618916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c0f93f0 0x7f069c10a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:17.190 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a1b3b700 1 -- 172.21.15.157:0/3571618916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f069c0f7620 msgr2=0x7f069c1098c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:17.190 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a1b3b700 1 --2- 172.21.15.157:0/3571618916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f069c0f7620 0x7f069c1098c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:17.190 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a1b3b700 1 -- 172.21.15.157:0/3571618916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690005040 con 0x7f069c0f7fd0 2021-10-08T19:44:17.191 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a233c700 1 --2- 172.21.15.157:0/3571618916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f069c0f7620 0x7f069c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:44:17.191 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a1b3b700 1 --2- 172.21.15.157:0/3571618916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 0x7f069c109e00 secure :-1 s=READY pgs=2735 cs=0 l=1 rev1=1 crypto rx=0x7f06900049e0 tx=0x7f0690009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:17.191 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690007e50 con 0x7f069c0f7fd0 2021-10-08T19:44:17.191 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f069000f040 con 0x7f069c0f7fd0 2021-10-08T19:44:17.191 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900139d0 con 0x7f069c0f7fd0 2021-10-08T19:44:17.192 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0694005040 con 0x7f069c0f7fd0 2021-10-08T19:44:17.192 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.182+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c115450 con 0x7f069c0f7fd0 2021-10-08T19:44:17.192 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.183+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c060900 con 0x7f069c0f7fd0 2021-10-08T19:44:17.192 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.184+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f069000e600 con 0x7f069c0f7fd0 2021-10-08T19:44:17.193 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.184+0000 7f069affd700 1 --2- 172.21.15.157:0/3571618916 >> v2:172.21.15.157:6800/1475557172 conn(0x7f06840634f0 0x7f06840659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:17.193 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.184+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(764..764 src has 1..764) v4 ==== 8017+0+0 (secure 0 0 0) 0x7f06900801e0 con 0x7f069c0f7fd0 2021-10-08T19:44:17.193 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.184+0000 7f06a233c700 1 --2- 172.21.15.157:0/3571618916 >> v2:172.21.15.157:6800/1475557172 conn(0x7f06840634f0 0x7f06840659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:17.193 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.184+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=765}) v3 -- 0x7f068406f000 con 0x7f069c0f7fd0 2021-10-08T19:44:17.193 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.184+0000 7f06a233c700 1 --2- 172.21.15.157:0/3571618916 >> v2:172.21.15.157:6800/1475557172 conn(0x7f06840634f0 0x7f06840659a0 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7f068c010370 tx=0x7f068c009040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:17.194 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.188+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f0690052650 con 0x7f069c0f7fd0 2021-10-08T19:44:17.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:17 smithi157 ceph-mon[32847]: pgmap v1259: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:17 smithi157 ceph-mon[32847]: osdmap e763: 8 total, 8 up, 8 in 2021-10-08T19:44:17.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:17 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:17 smithi157 ceph-mon[42114]: pgmap v1259: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:17 smithi157 ceph-mon[42114]: osdmap e763: 8 total, 8 up, 8 in 2021-10-08T19:44:17.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:17 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:17.355 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:17.356+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f069c106aa0 con 0x7f069c0f7fd0 2021-10-08T19:44:17.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:17 smithi196 ceph-mon[34258]: pgmap v1259: 188 pgs: 188 active+clean; 792 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:17.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:17.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:17 smithi196 ceph-mon[34258]: osdmap e763: 8 total, 8 up, 8 in 2021-10-08T19:44:17.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:17 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:17.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:17 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:17] "GET /metrics HTTP/1.1" 200 157769 "" "Prometheus/2.18.1" 2021-10-08T19:44:17.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:44:17 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:44:18.059 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:18.060+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 7 ==== osd_map(765..765 src has 1..765) v4 ==== 620+0+0 (secure 0 0 0) 0x7f069000ec80 con 0x7f069c0f7fd0 2021-10-08T19:44:18.060 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:18.060+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=766}) v3 -- 0x7f068406fc40 con 0x7f069c0f7fd0 2021-10-08T19:44:18.066 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:18.065+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v765) v1 ==== 221+0+0 (secure 0 0 0) 0x7f0690052240 con 0x7f069c0f7fd0 2021-10-08T19:44:18.177 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:18.178+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f069c115670 con 0x7f069c0f7fd0 2021-10-08T19:44:18.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[32847]: osdmap e764: 8 total, 8 up, 8 in 2021-10-08T19:44:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3571618916' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:18.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:18.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[32847]: pgmap v1262: 188 pgs: 188 active+clean; 801 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2021-10-08T19:44:18.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:18.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[42114]: osdmap e764: 8 total, 8 up, 8 in 2021-10-08T19:44:18.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3571618916' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:18.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:18.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:18.330 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:18 smithi157 ceph-mon[42114]: pgmap v1262: 188 pgs: 188 active+clean; 801 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2021-10-08T19:44:18.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/2628162230' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:18 smithi196 ceph-mon[34258]: osdmap e764: 8 total, 8 up, 8 in 2021-10-08T19:44:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:18 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3571618916' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:18 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:18.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:18 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:18.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:18 smithi196 ceph-mon[34258]: pgmap v1262: 188 pgs: 188 active+clean; 801 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2021-10-08T19:44:19.071 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:44:18 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:18] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:19.082 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.081+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 9 ==== osd_map(766..766 src has 1..766) v4 ==== 620+0+0 (secure 0 0 0) 0x7f0690052d20 con 0x7f069c0f7fd0 2021-10-08T19:44:19.083 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.082+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=767}) v3 -- 0x7f0684070110 con 0x7f069c0f7fd0 2021-10-08T19:44:19.083 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.082+0000 7f069affd700 1 -- 172.21.15.157:0/3571618916 <== mon.1 v2:172.21.15.157:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 v766) v1 ==== 221+0+0 (secure 0 0 0) 0x7f0690052420 con 0x7f069c0f7fd0 2021-10-08T19:44:19.087 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.085+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 >> v2:172.21.15.157:6800/1475557172 conn(0x7f06840634f0 msgr2=0x7f06840659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:19.087 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 --2- 172.21.15.157:0/3571618916 >> v2:172.21.15.157:6800/1475557172 conn(0x7f06840634f0 0x7f06840659a0 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7f068c010370 tx=0x7f068c009040 comp rx=0 tx=0).stop 2021-10-08T19:44:19.087 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 msgr2=0x7f069c109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:19.088 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 --2- 172.21.15.157:0/3571618916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 0x7f069c109e00 secure :-1 s=READY pgs=2735 cs=0 l=1 rev1=1 crypto rx=0x7f06900049e0 tx=0x7f0690009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:19.088 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 shutdown_connections 2021-10-08T19:44:19.088 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 --2- 172.21.15.157:0/3571618916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c0f93f0 0x7f069c10a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:19.089 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 --2- 172.21.15.157:0/3571618916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f069c0f7620 0x7f069c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:19.089 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 --2- 172.21.15.157:0/3571618916 >> v2:172.21.15.157:6800/1475557172 conn(0x7f06840634f0 0x7f06840659a0 unknown :-1 s=CLOSED pgs=3322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:19.090 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 --2- 172.21.15.157:0/3571618916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069c0f7fd0 0x7f069c109e00 unknown :-1 s=CLOSED pgs=2735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:19.090 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 >> 172.21.15.157:0/3571618916 conn(0x7f069c06e340 msgr2=0x7f069c0f5610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:19.091 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 shutdown_connections 2021-10-08T19:44:19.091 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:19.086+0000 7f06a45a0700 1 -- 172.21.15.157:0/3571618916 wait complete. 2021-10-08T19:44:19.092 INFO:tasks.workunit.client.0.smithi157.stderr:set-quota max_objects = 0 for pool 96ef6666-8683-4159-9a16-d5ae4e1d0495 2021-10-08T19:44:19.098 INFO:tasks.workunit.client.0.smithi157.stderr:+ sleep 30 2021-10-08T19:44:19.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:19 smithi157 ceph-mon[32847]: osdmap e765: 8 total, 8 up, 8 in 2021-10-08T19:44:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:19 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/3571618916' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:19.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:19 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:19 smithi157 ceph-mon[42114]: osdmap e765: 8 total, 8 up, 8 in 2021-10-08T19:44:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:19 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/3571618916' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:19.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:19 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:19.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:19.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:19 smithi196 ceph-mon[34258]: osdmap e765: 8 total, 8 up, 8 in 2021-10-08T19:44:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:19 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/3571618916' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:19.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:19 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:20 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:20 smithi196 ceph-mon[34258]: osdmap e766: 8 total, 8 up, 8 in 2021-10-08T19:44:20.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:20 smithi196 ceph-mon[34258]: pgmap v1265: 188 pgs: 188 active+clean; 801 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2021-10-08T19:44:20.577 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:20 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:20.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:20 smithi157 ceph-mon[32847]: osdmap e766: 8 total, 8 up, 8 in 2021-10-08T19:44:20.578 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:20 smithi157 ceph-mon[32847]: pgmap v1265: 188 pgs: 188 active+clean; 801 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2021-10-08T19:44:20.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:20 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:20.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:20 smithi157 ceph-mon[42114]: osdmap e766: 8 total, 8 up, 8 in 2021-10-08T19:44:20.579 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:20 smithi157 ceph-mon[42114]: pgmap v1265: 188 pgs: 188 active+clean; 801 KiB data, 501 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2021-10-08T19:44:20.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:20 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:20.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:20.579 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:20 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:20.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:20.580 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:20 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:20.141Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:44:23.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:23 smithi157 ceph-mon[32847]: pgmap v1266: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2021-10-08T19:44:23.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:23 smithi157 ceph-mon[42114]: pgmap v1266: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2021-10-08T19:44:23.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:23 smithi196 ceph-mon[34258]: pgmap v1266: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2021-10-08T19:44:23.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:23.539Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:23.539Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:23.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:23 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:23.539Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:44:25.195 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:25 smithi157 ceph-mon[32847]: pgmap v1267: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 740 B/s rd, 0 op/s 2021-10-08T19:44:25.196 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:25 smithi157 ceph-mon[42114]: pgmap v1267: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 740 B/s rd, 0 op/s 2021-10-08T19:44:25.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:25 smithi196 ceph-mon[34258]: pgmap v1267: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 740 B/s rd, 0 op/s 2021-10-08T19:44:27.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:27 smithi157 ceph-mon[32847]: pgmap v1268: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:44:27.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:27 smithi157 ceph-mon[42114]: pgmap v1268: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:44:27.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:27 smithi196 ceph-mon[34258]: pgmap v1268: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:44:27.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:27 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:27] "GET /metrics HTTP/1.1" 200 157770 "" "Prometheus/2.18.1" 2021-10-08T19:44:27.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:44:27 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:44:28.697 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:44:28 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:29.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:29 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:29.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:29 smithi157 ceph-mon[32847]: pgmap v1269: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:44:29.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:29 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:29.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:29 smithi157 ceph-mon[42114]: pgmap v1269: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:44:29.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:29 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:29.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:29 smithi196 ceph-mon[34258]: pgmap v1269: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:44:30.577 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:30 smithi157 conmon[33269]: 172.21.15.157 - - [08/Oct/2021:19:44:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:30.578 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:30 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:30.142Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:30.578 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:30 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:30.142Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:30.581 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:30 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:30.142Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:44:31.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:30 smithi157 ceph-mon[32847]: pgmap v1270: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2021-10-08T19:44:31.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:30 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:31.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:30 smithi157 ceph-mon[42114]: pgmap v1270: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2021-10-08T19:44:31.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:30 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:31.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:30 smithi196 ceph-mon[34258]: pgmap v1270: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2021-10-08T19:44:31.119 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:30 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:32.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:31 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:44:32.079 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:31 smithi157 ceph-mon[42114]: 172.21.15.157 - - [08/Oct/2021:19:44:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:31 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:44:32.080 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:31 smithi157 ceph-mon[32847]: 172.21.15.157 - - [08/Oct/2021:19:44:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:32.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:31 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi157. 2021-10-08T19:44:32.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:31 smithi196 ceph-mon[34258]: 172.21.15.157 - - [08/Oct/2021:19:44:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[32847]: pgmap v1271: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:33.078 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:44:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:44:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:44:33.079 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[42114]: pgmap v1271: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:44:33.080 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:44:33.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:44:33.081 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:32 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:32 smithi196 ceph-mon[34258]: pgmap v1271: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:44:33.117 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:44:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:32 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:44:33.118 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:32 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:33.827 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:33.539Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:33.539Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:33.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:33 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:33.539Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:44:34.578 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:34 smithi157 conmon[33269]: 172.21.15.196 - - [08/Oct/2021:19:44:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:35 smithi157 ceph-mon[32847]: pgmap v1272: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:35.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:35 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:35.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:35 smithi157 ceph-mon[42114]: pgmap v1272: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:35.329 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:35 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:35.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:35 smithi196 ceph-mon[34258]: pgmap v1272: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:35.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:35 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' 2021-10-08T19:44:36.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[32847]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:44:36.328 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[32847]: 172.21.15.196 - - [08/Oct/2021:19:44:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:36.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:36.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[32847]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:36.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:36.331 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[32847]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:36.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[42114]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:44:36.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[42114]: 172.21.15.196 - - [08/Oct/2021:19:44:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:36.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:36.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[42114]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:36.332 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:36.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:36 smithi157 ceph-mon[42114]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:36.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:36 smithi196 ceph-mon[34258]: Received up-to-date metadata from agent on host smithi196. 2021-10-08T19:44:36.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:36 smithi196 ceph-mon[34258]: 172.21.15.196 - - [08/Oct/2021:19:44:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:36.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:36.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:36 smithi196 ceph-mon[34258]: from='mgr.24490 172.21.15.157:0/3601818623' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:36.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:36.369 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:36 smithi196 ceph-mon[34258]: from='mgr.24490 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:37.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:37 smithi157 ceph-mon[42114]: pgmap v1273: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:37.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:37 smithi157 ceph-mon[32847]: pgmap v1273: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:37.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:37 smithi196 ceph-mon[34258]: pgmap v1273: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:37.827 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:37 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:37] "GET /metrics HTTP/1.1" 200 157770 "" "Prometheus/2.18.1" 2021-10-08T19:44:37.866 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:44:37 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:44:39.046 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:44:38 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:39.327 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:39 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:39.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:39 smithi157 ceph-mon[42114]: pgmap v1274: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:39 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:39.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:39 smithi157 ceph-mon[32847]: pgmap v1274: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:39 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:39.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:39 smithi196 ceph-mon[34258]: pgmap v1274: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:40.578 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:40 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:40.142Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:40.578 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:40 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:40.142Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:40.578 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:40 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:40.142Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:44:41.077 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:40 smithi157 ceph-mon[32847]: pgmap v1275: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:41.078 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:40 smithi157 ceph-mon[42114]: pgmap v1275: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:41.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:40 smithi196 ceph-mon[34258]: pgmap v1275: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:43.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:43 smithi157 ceph-mon[32847]: pgmap v1276: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:43.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:43 smithi157 ceph-mon[42114]: pgmap v1276: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:43.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:43 smithi196 ceph-mon[34258]: pgmap v1276: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:43.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:43.539Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:43.830 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:43.539Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:43.831 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:43 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:43.539Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs; Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" 2021-10-08T19:44:45.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:45 smithi157 ceph-mon[32847]: pgmap v1277: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:45.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:45 smithi157 ceph-mon[42114]: pgmap v1277: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:45.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:45 smithi196 ceph-mon[34258]: pgmap v1277: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:47.327 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:47 smithi157 ceph-mon[32847]: pgmap v1278: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:47.328 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:47 smithi157 ceph-mon[42114]: pgmap v1278: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:47.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:47 smithi196 ceph-mon[34258]: pgmap v1278: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:47.828 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:47 smithi157 conmon[33269]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:47] "GET /metrics HTTP/1.1" 200 157770 "" "Prometheus/2.18.1" 2021-10-08T19:44:48.117 INFO:journalctl@ceph.iscsi.iscsi.a.smithi196.stdout:Oct 08 19:44:47 smithi196 conmon[57883]: debug there is no tcmu-runner data available 2021-10-08T19:44:49.050 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:44:48 smithi196 conmon[36265]: ::ffff:172.21.15.196 - - [08/Oct/2021:19:44:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:49.100 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool delete 96ef6666-8683-4159-9a16-d5ae4e1d0495 96ef6666-8683-4159-9a16-d5ae4e1d0495 --yes-i-really-really-mean-it 2021-10-08T19:44:49.211 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.210+0000 7f3364330700 1 -- 172.21.15.157:0/2693145429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 msgr2=0x7f335c102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:49.211 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.210+0000 7f3364330700 1 --2- 172.21.15.157:0/2693145429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 0x7f335c102800 secure :-1 s=READY pgs=2736 cs=0 l=1 rev1=1 crypto rx=0x7f33500046e0 tx=0x7f3350009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:49.211 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.211+0000 7f3364330700 1 -- 172.21.15.157:0/2693145429 shutdown_connections 2021-10-08T19:44:49.211 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.211+0000 7f3364330700 1 --2- 172.21.15.157:0/2693145429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f335c102d40 0x7f335c105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:49.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.211+0000 7f3364330700 1 --2- 172.21.15.157:0/2693145429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f335c0f9790 0x7f335c0f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:49.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.211+0000 7f3364330700 1 --2- 172.21.15.157:0/2693145429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 0x7f335c102800 unknown :-1 s=CLOSED pgs=2736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:49.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.211+0000 7f3364330700 1 -- 172.21.15.157:0/2693145429 >> 172.21.15.157:0/2693145429 conn(0x7f335c06e2d0 msgr2=0x7f335c0f5650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:49.212 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.211+0000 7f3364330700 1 -- 172.21.15.157:0/2693145429 shutdown_connections 2021-10-08T19:44:49.213 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.211+0000 7f3364330700 1 -- 172.21.15.157:0/2693145429 wait complete. 2021-10-08T19:44:49.216 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.211+0000 7f3364330700 1 Processor -- start 2021-10-08T19:44:49.216 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.211+0000 7f3364330700 1 -- start start 2021-10-08T19:44:49.216 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f3364330700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f335c0f9790 0x7f335c10ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:49.216 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f3364330700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 0x7f335c10efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:49.217 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f3364330700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f335c102d40 0x7f335c108b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:49.217 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f3364330700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c109100 con 0x7f335c102d40 2021-10-08T19:44:49.217 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f3364330700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c109270 con 0x7f335c0f9790 2021-10-08T19:44:49.217 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f3364330700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c109430 con 0x7f335c0fa0a0 2021-10-08T19:44:49.218 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33618cb700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 0x7f335c10efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:49.218 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33618cb700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 0x7f335c10efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:33088/0 (socket says 172.21.15.157:33088) 2021-10-08T19:44:49.218 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33628cd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f335c102d40 0x7f335c108b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:49.219 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33618cb700 1 -- 172.21.15.157:0/56848999 learned_addr learned my addr 172.21.15.157:0/56848999 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:44:49.219 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33618cb700 1 -- 172.21.15.157:0/56848999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f335c0f9790 msgr2=0x7f335c10ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:49.219 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33618cb700 1 --2- 172.21.15.157:0/56848999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f335c0f9790 0x7f335c10ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:49.219 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33618cb700 1 -- 172.21.15.157:0/56848999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f335c102d40 msgr2=0x7f335c108b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:49.220 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33618cb700 1 --2- 172.21.15.157:0/56848999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f335c102d40 0x7f335c108b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:49.220 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33618cb700 1 -- 172.21.15.157:0/56848999 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3354005040 con 0x7f335c0fa0a0 2021-10-08T19:44:49.220 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33628cd700 1 --2- 172.21.15.157:0/56848999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f335c102d40 0x7f335c108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:44:49.220 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f33618cb700 1 --2- 172.21.15.157:0/56848999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 0x7f335c10efa0 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 crypto rx=0x7f33500145a0 tx=0x7f3350009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:49.221 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350019070 con 0x7f335c0fa0a0 2021-10-08T19:44:49.221 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f3350007da0 con 0x7f335c0fa0a0 2021-10-08T19:44:49.221 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3350005040 con 0x7f335c0fa0a0 2021-10-08T19:44:49.221 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.212+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335001ed20 con 0x7f335c0fa0a0 2021-10-08T19:44:49.222 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.213+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c1098d0 con 0x7f335c0fa0a0 2021-10-08T19:44:49.222 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.213+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c05fc40 con 0x7f335c0fa0a0 2021-10-08T19:44:49.222 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.214+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f3350007920 con 0x7f335c0fa0a0 2021-10-08T19:44:49.222 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.214+0000 7f335affd700 1 --2- 172.21.15.157:0/56848999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33440634f0 0x7f33440659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:49.222 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.214+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(766..766 src has 1..766) v4 ==== 8017+0+0 (secure 0 0 0) 0x7f3350081660 con 0x7f335c0fa0a0 2021-10-08T19:44:49.223 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.214+0000 7f33620cc700 1 --2- 172.21.15.157:0/56848999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33440634f0 0x7f33440659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:49.223 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.214+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=767}) v3 -- 0x7f334406f000 con 0x7f335c0fa0a0 2021-10-08T19:44:49.223 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.215+0000 7f33620cc700 1 --2- 172.21.15.157:0/56848999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33440634f0 0x7f33440659a0 secure :-1 s=READY pgs=3323 cs=0 l=1 rev1=1 crypto rx=0x7f334c004fd0 tx=0x7f334c0048b0 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:49.224 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.218+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f3350053bc0 con 0x7f335c0fa0a0 2021-10-08T19:44:49.332 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:49 smithi157 ceph-mon[32847]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:49.333 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:49 smithi157 ceph-mon[32847]: pgmap v1279: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:49.333 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:49 smithi157 ceph-mon[42114]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:49.334 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:49 smithi157 ceph-mon[42114]: pgmap v1279: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:49.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:49 smithi196 ceph-mon[34258]: from='client.24443 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:49.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:49 smithi196 ceph-mon[34258]: pgmap v1279: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:49.383 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:49.383+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f335c10a070 con 0x7f335c0fa0a0 2021-10-08T19:44:50.060 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.057+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 <== mon.1 v2:172.21.15.157:3301/0 7 ==== osd_map(767..767 src has 1..767) v4 ==== 288+0+0 (secure 0 0 0) 0x7f335001e420 con 0x7f335c0fa0a0 2021-10-08T19:44:50.061 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.057+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=768}) v3 -- 0x7f334406f960 con 0x7f335c0fa0a0 2021-10-08T19:44:50.063 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.063+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 <== mon.1 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]=0 pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' removed v767) v1 ==== 248+0+0 (secure 0 0 0) 0x7f33500537b0 con 0x7f335c0fa0a0 2021-10-08T19:44:50.181 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.181+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f335c109fd0 con 0x7f335c0fa0a0 2021-10-08T19:44:50.186 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.182+0000 7f335affd700 1 -- 172.21.15.157:0/56848999 <== mon.1 v2:172.21.15.157:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]=0 pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' does not exist v767) v1 ==== 255+0+0 (secure 0 0 0) 0x7f3350053990 con 0x7f335c0fa0a0 2021-10-08T19:44:50.186 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33440634f0 msgr2=0x7f33440659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:50.187 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 --2- 172.21.15.157:0/56848999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33440634f0 0x7f33440659a0 secure :-1 s=READY pgs=3323 cs=0 l=1 rev1=1 crypto rx=0x7f334c004fd0 tx=0x7f334c0048b0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.187 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 msgr2=0x7f335c10efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:50.187 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 --2- 172.21.15.157:0/56848999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 0x7f335c10efa0 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 crypto rx=0x7f33500145a0 tx=0x7f3350009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:50.187 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 shutdown_connections 2021-10-08T19:44:50.188 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 --2- 172.21.15.157:0/56848999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f335c102d40 0x7f335c108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.189 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 --2- 172.21.15.157:0/56848999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f335c0f9790 0x7f335c10ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.189 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 --2- 172.21.15.157:0/56848999 >> v2:172.21.15.157:6800/1475557172 conn(0x7f33440634f0 0x7f33440659a0 unknown :-1 s=CLOSED pgs=3323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.190 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 --2- 172.21.15.157:0/56848999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f335c0fa0a0 0x7f335c10efa0 unknown :-1 s=CLOSED pgs=2737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.191 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 >> 172.21.15.157:0/56848999 conn(0x7f335c06e2d0 msgr2=0x7f335c0fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:50.191 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 shutdown_connections 2021-10-08T19:44:50.191 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.184+0000 7f3364330700 1 -- 172.21.15.157:0/56848999 wait complete. 2021-10-08T19:44:50.191 INFO:tasks.workunit.client.0.smithi157.stderr:pool '96ef6666-8683-4159-9a16-d5ae4e1d0495' does not exist 2021-10-08T19:44:50.197 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph osd pool delete 807b6f86-3833-41c4-ab00-99daf67b7e38 807b6f86-3833-41c4-ab00-99daf67b7e38 --yes-i-really-really-mean-it 2021-10-08T19:44:50.299 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 -- 172.21.15.157:0/1200097250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80fd5b0 msgr2=0x7f54e80fd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:50.300 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 --2- 172.21.15.157:0/1200097250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80fd5b0 0x7f54e80fd980 secure :-1 s=READY pgs=2738 cs=0 l=1 rev1=1 crypto rx=0x7f54d80046e0 tx=0x7f54d8009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:50.300 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 -- 172.21.15.157:0/1200097250 shutdown_connections 2021-10-08T19:44:50.300 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 --2- 172.21.15.157:0/1200097250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54e80f85a0 0x7f54e81043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.301 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 --2- 172.21.15.157:0/1200097250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80fd5b0 0x7f54e80fd980 unknown :-1 s=CLOSED pgs=2738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.301 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 --2- 172.21.15.157:0/1200097250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e80fdf50 0x7f54e80f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.301 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 -- 172.21.15.157:0/1200097250 >> 172.21.15.157:0/1200097250 conn(0x7f54e806cda0 msgr2=0x7f54e806d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:50.302 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 -- 172.21.15.157:0/1200097250 shutdown_connections 2021-10-08T19:44:50.302 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 -- 172.21.15.157:0/1200097250 wait complete. 2021-10-08T19:44:50.303 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 Processor -- start 2021-10-08T19:44:50.303 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 -- start start 2021-10-08T19:44:50.303 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80f85a0 0x7f54e810d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:50.304 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54e80fd5b0 0x7f54e810de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:50.304 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e80fdf50 0x7f54e81079c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:50.304 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8107f90 con 0x7f54e80fd5b0 2021-10-08T19:44:50.304 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8108100 con 0x7f54e80fdf50 2021-10-08T19:44:50.305 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54ed299700 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e81082c0 con 0x7f54e80f85a0 2021-10-08T19:44:50.305 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.296+0000 7f54e6ffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80f85a0 0x7f54e810d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:50.305 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54e6ffd700 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80f85a0 0x7f54e810d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:33104/0 (socket says 172.21.15.157:33104) 2021-10-08T19:44:50.305 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54dffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54e80fd5b0 0x7f54e810de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:50.305 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54e6ffd700 1 -- 172.21.15.157:0/4117893326 learned_addr learned my addr 172.21.15.157:0/4117893326 (peer_addr_for_me v2:172.21.15.157:0/0) 2021-10-08T19:44:50.306 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54e77fe700 1 --2- 172.21.15.157:0/4117893326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e80fdf50 0x7f54e81079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:50.306 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54e6ffd700 1 -- 172.21.15.157:0/4117893326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e80fdf50 msgr2=0x7f54e81079c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:50.307 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54e6ffd700 1 --2- 172.21.15.157:0/4117893326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e80fdf50 0x7f54e81079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.307 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54e6ffd700 1 -- 172.21.15.157:0/4117893326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54e80fd5b0 msgr2=0x7f54e810de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:50.307 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54e6ffd700 1 --2- 172.21.15.157:0/4117893326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54e80fd5b0 0x7f54e810de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:50.307 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54e6ffd700 1 -- 172.21.15.157:0/4117893326 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0009640 con 0x7f54e80f85a0 2021-10-08T19:44:50.307 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54e6ffd700 1 --2- 172.21.15.157:0/4117893326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80f85a0 0x7f54e810d8f0 secure :-1 s=READY pgs=2739 cs=0 l=1 rev1=1 crypto rx=0x7f54d8005010 tx=0x7f54d8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:50.308 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 <== mon.1 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8019070 con 0x7f54e80f85a0 2021-10-08T19:44:50.308 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 <== mon.1 v2:172.21.15.157:3301/0 2 ==== config(25 keys) v1 ==== 1033+0+0 (secure 0 0 0) 0x7f54d80095d0 con 0x7f54e80f85a0 2021-10-08T19:44:50.308 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d8005040 con 0x7f54e80f85a0 2021-10-08T19:44:50.308 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 <== mon.1 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d801ed00 con 0x7f54e80f85a0 2021-10-08T19:44:50.309 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.297+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e8108830 con 0x7f54e80f85a0 2021-10-08T19:44:50.309 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.298+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e8060900 con 0x7f54e80f85a0 2021-10-08T19:44:50.309 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.298+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 <== mon.1 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 21) v1 ==== 80828+0+0 (secure 0 0 0) 0x7f54d8007b30 con 0x7f54e80f85a0 2021-10-08T19:44:50.309 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.299+0000 7f54df7fe700 1 --2- 172.21.15.157:0/4117893326 >> v2:172.21.15.157:6800/1475557172 conn(0x7f54d40634f0 0x7f54d40659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:50.310 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.299+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 <== mon.1 v2:172.21.15.157:3301/0 5 ==== osd_map(767..767 src has 1..767) v4 ==== 7629+0+0 (secure 0 0 0) 0x7f54d80813b0 con 0x7f54e80f85a0 2021-10-08T19:44:50.310 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.299+0000 7f54dffff700 1 --2- 172.21.15.157:0/4117893326 >> v2:172.21.15.157:6800/1475557172 conn(0x7f54d40634f0 0x7f54d40659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:50.310 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.299+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=768}) v3 -- 0x7f54d406e7e0 con 0x7f54e80f85a0 2021-10-08T19:44:50.311 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.299+0000 7f54dffff700 1 --2- 172.21.15.157:0/4117893326 >> v2:172.21.15.157:6800/1475557172 conn(0x7f54d40634f0 0x7f54d40659a0 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f54e8109120 tx=0x7f54d000b040 comp rx=0 tx=0).ready entity=mgr.24490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:50.311 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.303+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 <== mon.1 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f54d801ee60 con 0x7f54e80f85a0 2021-10-08T19:44:50.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:50 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/56848999' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:50.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:50 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:50.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:50 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/56848999' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:50.331 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:50 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:50.332 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:50 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:50.142Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:50.332 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:50 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:50.142Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:50.332 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:50 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:50.142Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:44:50.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:50 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/56848999' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:50.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:50 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:50.495 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:50.494+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54e8108830 con 0x7f54e80f85a0 2021-10-08T19:44:51.059 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.059+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 <== mon.1 v2:172.21.15.157:3301/0 7 ==== osd_map(768..768 src has 1..768) v4 ==== 288+0+0 (secure 0 0 0) 0x7f54d801e420 con 0x7f54e80f85a0 2021-10-08T19:44:51.060 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.059+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=769}) v3 -- 0x7f54d406f100 con 0x7f54e80f85a0 2021-10-08T19:44:51.062 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.062+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 <== mon.1 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true}]=0 pool '807b6f86-3833-41c4-ab00-99daf67b7e38' removed v768) v1 ==== 248+0+0 (secure 0 0 0) 0x7f54e8108830 con 0x7f54e80f85a0 2021-10-08T19:44:51.074 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[42114]: pgmap v1280: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:51.075 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:44:51.075 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[42114]: osdmap e767: 8 total, 8 up, 8 in 2021-10-08T19:44:51.075 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/56848999' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.075 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.076 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[42114]: from='client.? 172.21.15.157:0/4117893326' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.076 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[42114]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.178 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.178+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54e8108830 con 0x7f54e80f85a0 2021-10-08T19:44:51.178 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.179+0000 7f54df7fe700 1 -- 172.21.15.157:0/4117893326 <== mon.1 v2:172.21.15.157:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true}]=0 pool '807b6f86-3833-41c4-ab00-99daf67b7e38' does not exist v768) v1 ==== 255+0+0 (secure 0 0 0) 0x7f54e8108830 con 0x7f54e80f85a0 2021-10-08T19:44:51.182 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.180+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 >> v2:172.21.15.157:6800/1475557172 conn(0x7f54d40634f0 msgr2=0x7f54d40659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:51.183 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.180+0000 7f54ed299700 1 --2- 172.21.15.157:0/4117893326 >> v2:172.21.15.157:6800/1475557172 conn(0x7f54d40634f0 0x7f54d40659a0 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f54e8109120 tx=0x7f54d000b040 comp rx=0 tx=0).stop 2021-10-08T19:44:51.183 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.180+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80f85a0 msgr2=0x7f54e810d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:51.183 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.180+0000 7f54ed299700 1 --2- 172.21.15.157:0/4117893326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80f85a0 0x7f54e810d8f0 secure :-1 s=READY pgs=2739 cs=0 l=1 rev1=1 crypto rx=0x7f54d8005010 tx=0x7f54d8009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:51.183 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.181+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 shutdown_connections 2021-10-08T19:44:51.184 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.181+0000 7f54ed299700 1 --2- 172.21.15.157:0/4117893326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e80fdf50 0x7f54e81079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:51.184 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.181+0000 7f54ed299700 1 --2- 172.21.15.157:0/4117893326 >> v2:172.21.15.157:6800/1475557172 conn(0x7f54d40634f0 0x7f54d40659a0 unknown :-1 s=CLOSED pgs=3324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:51.184 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.181+0000 7f54ed299700 1 --2- 172.21.15.157:0/4117893326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54e80f85a0 0x7f54e810d8f0 unknown :-1 s=CLOSED pgs=2739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:51.185 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.181+0000 7f54ed299700 1 --2- 172.21.15.157:0/4117893326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54e80fd5b0 0x7f54e810de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:51.185 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.181+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 >> 172.21.15.157:0/4117893326 conn(0x7f54e806cda0 msgr2=0x7f54e80f5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:51.185 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.181+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 shutdown_connections 2021-10-08T19:44:51.185 INFO:tasks.workunit.client.0.smithi157.stderr:2021-10-08T19:44:51.181+0000 7f54ed299700 1 -- 172.21.15.157:0/4117893326 wait complete. 2021-10-08T19:44:51.185 INFO:tasks.workunit.client.0.smithi157.stderr:pool '807b6f86-3833-41c4-ab00-99daf67b7e38' does not exist 2021-10-08T19:44:51.191 INFO:tasks.workunit.client.0.smithi157.stdout:OK 2021-10-08T19:44:51.192 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo OK 2021-10-08T19:44:51.193 INFO:teuthology.orchestra.run:Running command with timeout 3600 2021-10-08T19:44:51.193 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2021-10-08T19:44:51.262 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2021-10-08T19:44:51.263 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2021-10-08T19:44:51.322 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[32847]: pgmap v1280: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:51.323 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:44:51.323 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[32847]: osdmap e767: 8 total, 8 up, 8 in 2021-10-08T19:44:51.324 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/56848999' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.324 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.324 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[32847]: from='client.? 172.21.15.157:0/4117893326' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.325 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:51 smithi157 ceph-mon[32847]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.366 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:51 smithi196 ceph-mon[34258]: pgmap v1280: 188 pgs: 188 active+clean; 801 KiB data, 502 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:44:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:51 smithi196 ceph-mon[34258]: osdmap e767: 8 total, 8 up, 8 in 2021-10-08T19:44:51.367 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/56848999' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "pool2": "96ef6666-8683-4159-9a16-d5ae4e1d0495", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:51 smithi196 ceph-mon[34258]: from='client.? 172.21.15.157:0/4117893326' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.368 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:51 smithi196 ceph-mon[34258]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "807b6f86-3833-41c4-ab00-99daf67b7e38", "pool2": "807b6f86-3833-41c4-ab00-99daf67b7e38", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:44:51.562 DEBUG:teuthology.parallel:result is None 2021-10-08T19:44:51.563 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2021-10-08T19:44:51.631 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2021-10-08T19:44:51.632 DEBUG:teuthology.orchestra.run.smithi157:> rmdir -- /home/ubuntu/cephtest/mnt.0 2021-10-08T19:44:51.687 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2021-10-08T19:44:51.687 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2021-10-08T19:44:51.697 INFO:tasks.cephadm:Teardown begin 2021-10-08T19:44:51.698 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:44:51.759 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:44:51.809 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2021-10-08T19:44:51.809 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2021-10-08T19:44:51.826 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2021-10-08T19:44:51.877 INFO:tasks.cephadm:Stopping all daemons... 2021-10-08T19:44:51.878 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2021-10-08T19:44:51.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:44:52.329 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:51 smithi157 systemd[1]: Stopping Ceph mon.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:52.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:51 smithi157 bash[201271]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mon.a found: no such container 2021-10-08T19:44:52.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:52 smithi157 conmon[32824]: 2021-10-08T19:44:52.052+0000 7f6f8aa39700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:44:52.330 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:52 smithi157 conmon[32824]: 2021-10-08T19:44:52.052+0000 7f6f8aa39700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2021-10-08T19:44:52.827 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:52 smithi157 bash[201271]: ce1f928ac9f4694c781dfaf1c902a8311d36dcbc8e1883ce7a7f76d0971d9fa6 2021-10-08T19:44:52.828 INFO:journalctl@ceph.mon.a.smithi157.stdout:Oct 08 19:44:52 smithi157 bash[201271]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mon.a found: no such container 2021-10-08T19:44:53.597 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.a.service' 2021-10-08T19:44:53.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:44:53.643 INFO:tasks.cephadm.mon.a:Stopped mon.a 2021-10-08T19:44:53.643 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2021-10-08T19:44:53.644 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.c 2021-10-08T19:44:53.827 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:53 smithi157 systemd[1]: Stopping Ceph mon.c for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:53.828 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:53 smithi157 bash[201610]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mon.c found: no such container 2021-10-08T19:44:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:53.540Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:53.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:53.540Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:53.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:44:53 smithi157 conmon[87186]: level=error ts=2021-10-08T19:44:53.540Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.196:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.196 because it doesn't contain any IP SANs; Post https://172.21.15.157:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.157 because it doesn't contain any IP SANs" 2021-10-08T19:44:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:53 smithi157 conmon[42091]: 2021-10-08T19:44:53.869+0000 7f16a362e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:44:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:53 smithi157 conmon[42091]: 2021-10-08T19:44:53.869+0000 7f16a362e700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2021-10-08T19:44:54.577 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:54 smithi157 bash[201610]: ab5a87cca94f447e6a354aef1e9f8a3f18e3bf54bf2598524ee7ed819d33f56b 2021-10-08T19:44:54.578 INFO:journalctl@ceph.mon.c.smithi157.stdout:Oct 08 19:44:54 smithi157 bash[201610]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mon.c found: no such container 2021-10-08T19:44:55.043 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.c.service' 2021-10-08T19:44:55.081 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:44:55.082 INFO:tasks.cephadm.mon.b:Stopped mon.c 2021-10-08T19:44:55.083 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2021-10-08T19:44:55.083 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.b 2021-10-08T19:44:55.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:55 smithi196 systemd[1]: Stopping Ceph mon.b for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:55.371 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:55 smithi196 bash[120835]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mon.b found: no such container 2021-10-08T19:44:55.780 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:55 smithi196 conmon[34228]: 2021-10-08T19:44:55.455+0000 7f5eb607d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:44:55.782 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:55 smithi196 conmon[34228]: 2021-10-08T19:44:55.455+0000 7f5eb607d700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2021-10-08T19:44:55.782 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:55 smithi196 bash[120835]: 90c821eb6c5cf5534d78fa75fb4b8a3b8f0f6e71c21bdda73fee3df6dbd9b14e 2021-10-08T19:44:56.116 INFO:journalctl@ceph.mon.b.smithi196.stdout:Oct 08 19:44:55 smithi196 bash[120835]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mon.b found: no such container 2021-10-08T19:44:56.412 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mon.b.service' 2021-10-08T19:44:56.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:44:56.472 INFO:tasks.cephadm.mon.b:Stopped mon.b 2021-10-08T19:44:56.473 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2021-10-08T19:44:56.473 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:44:56.751 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:56 smithi157 systemd[1]: Stopping Ceph mgr.y for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:56.752 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:56 smithi157 bash[202680]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mgr.y found: no such container 2021-10-08T19:44:57.077 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:56 smithi157 conmon[33269]: 2021-10-08T19:44:56.750+0000 7f9b4d492700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:44:57.078 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 08 19:44:56 smithi157 conmon[33269]: 2021-10-08T19:44:56.750+0000 7f9b4d492700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2021-10-08T19:44:57.605 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.y.service' 2021-10-08T19:44:57.644 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:44:57.645 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2021-10-08T19:44:57.645 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2021-10-08T19:44:57.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.x 2021-10-08T19:44:58.116 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:44:57 smithi196 systemd[1]: Stopping Ceph mgr.x for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:58.117 INFO:journalctl@ceph.mgr.x.smithi196.stdout:Oct 08 19:44:57 smithi196 bash[121340]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-mgr.x found: no such container 2021-10-08T19:44:58.415 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@mgr.x.service' 2021-10-08T19:44:58.449 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:44:58.450 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2021-10-08T19:44:58.451 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2021-10-08T19:44:58.451 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.0 2021-10-08T19:44:58.828 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:44:58 smithi157 systemd[1]: Stopping Ceph osd.0 for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:44:58.828 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:44:58 smithi157 bash[202963]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:44:58.828 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:44:58 smithi157 conmon[47549]: 2021-10-08T19:44:58.645+0000 7efcfed6f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:44:58.829 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:44:58 smithi157 conmon[47549]: 2021-10-08T19:44:58.646+0000 7efcfed6f700 -1 osd.0 768 *** Got signal Terminated *** 2021-10-08T19:44:58.829 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:44:58 smithi157 conmon[47549]: 2021-10-08T19:44:58.646+0000 7efcfed6f700 -1 osd.0 768 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:44:59.577 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:44:59 smithi157 bash[202963]: fcada2a73d3b8bc99976b2d42d82a76ed699994d21741a488a899fe12bf937d7 2021-10-08T19:44:59.578 INFO:journalctl@ceph.osd.0.smithi157.stdout:Oct 08 19:44:59 smithi157 bash[202963]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.0 found: no such container 2021-10-08T19:45:00.329 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:00 smithi157 conmon[87186]: level=error ts=2021-10-08T19:45:00.143Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: dial tcp 172.21.15.196:8443: connect: connection refused" context_err="context deadline exceeded" 2021-10-08T19:45:00.329 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:00 smithi157 conmon[87186]: level=error ts=2021-10-08T19:45:00.143Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: dial tcp 172.21.15.157:8443: connect: connection refused" context_err="context deadline exceeded" 2021-10-08T19:45:00.329 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:00 smithi157 conmon[87186]: level=error ts=2021-10-08T19:45:00.143Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.157:8443/api/prometheus_receiver: dial tcp 172.21.15.157:8443: connect: connection refused; Post https://172.21.15.196:8443/api/prometheus_receiver: dial tcp 172.21.15.196:8443: connect: connection refused" 2021-10-08T19:45:00.542 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.0.service' 2021-10-08T19:45:00.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:00.581 INFO:tasks.cephadm.osd.0:Stopped osd.0 2021-10-08T19:45:00.582 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2021-10-08T19:45:00.582 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.1 2021-10-08T19:45:00.827 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:45:00 smithi157 systemd[1]: Stopping Ceph osd.1 for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:00.828 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:45:00 smithi157 bash[203443]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:45:01.327 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:45:00 smithi157 conmon[51806]: 2021-10-08T19:45:00.834+0000 7f9f40464700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:01.327 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:45:00 smithi157 conmon[51806]: 2021-10-08T19:45:00.834+0000 7f9f40464700 -1 osd.1 768 *** Got signal Terminated *** 2021-10-08T19:45:01.328 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:45:00 smithi157 conmon[51806]: 2021-10-08T19:45:00.834+0000 7f9f40464700 -1 osd.1 768 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:01.827 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:45:01 smithi157 bash[203443]: 9eb2748cf3d18bbaf796ca387646f0b200104447f470b06ebf092cb76711936d 2021-10-08T19:45:01.828 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 08 19:45:01 smithi157 bash[203443]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.1 found: no such container 2021-10-08T19:45:02.751 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.1.service' 2021-10-08T19:45:02.789 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:02.790 INFO:tasks.cephadm.osd.1:Stopped osd.1 2021-10-08T19:45:02.790 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2021-10-08T19:45:02.791 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.2 2021-10-08T19:45:03.010 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:45:02 smithi157 systemd[1]: Stopping Ceph osd.2 for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:03.012 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:45:02 smithi157 bash[203918]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:45:03.329 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:45:03 smithi157 conmon[56096]: 2021-10-08T19:45:03.008+0000 7f7a375f1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:03.329 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:45:03 smithi157 conmon[56096]: 2021-10-08T19:45:03.008+0000 7f7a375f1700 -1 osd.2 768 *** Got signal Terminated *** 2021-10-08T19:45:03.329 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:45:03 smithi157 conmon[56096]: 2021-10-08T19:45:03.008+0000 7f7a375f1700 -1 osd.2 768 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:03.330 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:45:03 smithi157 bash[203918]: 41a94803fec88318bc6311345de9fccdcfc5c36a279f306ce2fa3075eb50e31e 2021-10-08T19:45:03.827 INFO:journalctl@ceph.osd.2.smithi157.stdout:Oct 08 19:45:03 smithi157 bash[203918]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.2 found: no such container 2021-10-08T19:45:03.828 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:45:03.540Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.157:8443/api/prometheus_receiver: dial tcp 172.21.15.157:8443: connect: connection refused" context_err="context deadline exceeded" 2021-10-08T19:45:03.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:45:03.540Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.196:8443/api/prometheus_receiver: dial tcp 172.21.15.196:8443: connect: connection refused" context_err="context deadline exceeded" 2021-10-08T19:45:03.829 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:03 smithi157 conmon[87186]: level=error ts=2021-10-08T19:45:03.540Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.157:8443/api/prometheus_receiver: dial tcp 172.21.15.157:8443: connect: connection refused; Post https://172.21.15.196:8443/api/prometheus_receiver: dial tcp 172.21.15.196:8443: connect: connection refused" 2021-10-08T19:45:05.057 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.2.service' 2021-10-08T19:45:05.097 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:05.098 INFO:tasks.cephadm.osd.2:Stopped osd.2 2021-10-08T19:45:05.102 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2021-10-08T19:45:05.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.3 2021-10-08T19:45:05.316 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:45:05 smithi157 systemd[1]: Stopping Ceph osd.3 for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:05.317 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:45:05 smithi157 bash[204404]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:45:05.577 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:45:05 smithi157 conmon[59794]: 2021-10-08T19:45:05.316+0000 7f3ca84eb700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:05.577 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:45:05 smithi157 conmon[59794]: 2021-10-08T19:45:05.316+0000 7f3ca84eb700 -1 osd.3 768 *** Got signal Terminated *** 2021-10-08T19:45:05.578 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:45:05 smithi157 conmon[59794]: 2021-10-08T19:45:05.316+0000 7f3ca84eb700 -1 osd.3 768 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:05.578 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:45:05 smithi157 bash[204404]: 751152dbac5bbfadc030cd9a1b5ede2bccde0eea0142d38a7ba8ea3b9655bff6 2021-10-08T19:45:06.077 INFO:journalctl@ceph.osd.3.smithi157.stdout:Oct 08 19:45:05 smithi157 bash[204404]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.3 found: no such container 2021-10-08T19:45:07.350 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.3.service' 2021-10-08T19:45:07.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:07.389 INFO:tasks.cephadm.osd.3:Stopped osd.3 2021-10-08T19:45:07.389 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2021-10-08T19:45:07.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.4 2021-10-08T19:45:07.867 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:45:07 smithi196 systemd[1]: Stopping Ceph osd.4 for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:07.868 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:45:07 smithi196 bash[122554]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:45:07.868 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:45:07 smithi196 conmon[41793]: 2021-10-08T19:45:07.597+0000 7fed5735b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:07.868 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:45:07 smithi196 conmon[41793]: 2021-10-08T19:45:07.597+0000 7fed5735b700 -1 osd.4 768 *** Got signal Terminated *** 2021-10-08T19:45:07.868 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:45:07 smithi196 conmon[41793]: 2021-10-08T19:45:07.597+0000 7fed5735b700 -1 osd.4 768 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:08.621 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:45:08 smithi196 bash[122554]: eca89d6c340aafd4f0e1e6beff663fce04679e74b914141a6675bc35f1596ea7 2021-10-08T19:45:08.621 INFO:journalctl@ceph.osd.4.smithi196.stdout:Oct 08 19:45:08 smithi196 bash[122554]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.4 found: no such container 2021-10-08T19:45:09.639 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.4.service' 2021-10-08T19:45:09.679 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:09.680 INFO:tasks.cephadm.osd.4:Stopped osd.4 2021-10-08T19:45:09.681 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2021-10-08T19:45:09.681 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.5 2021-10-08T19:45:09.895 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:45:09 smithi196 systemd[1]: Stopping Ceph osd.5 for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:09.896 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:45:09 smithi196 bash[123031]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:45:10.289 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:45:09 smithi196 conmon[46000]: 2021-10-08T19:45:09.894+0000 7f3522295700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:10.289 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:45:09 smithi196 conmon[46000]: 2021-10-08T19:45:09.894+0000 7f3522295700 -1 osd.5 768 *** Got signal Terminated *** 2021-10-08T19:45:10.289 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:45:09 smithi196 conmon[46000]: 2021-10-08T19:45:09.894+0000 7f3522295700 -1 osd.5 768 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:10.290 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:45:10 smithi196 bash[123031]: aac44119660a3748a0906ec98935bfc6a218d068ffa5f64060fafc3a7fffcd76 2021-10-08T19:45:11.366 INFO:journalctl@ceph.osd.5.smithi196.stdout:Oct 08 19:45:10 smithi196 bash[123031]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.5 found: no such container 2021-10-08T19:45:11.920 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.5.service' 2021-10-08T19:45:11.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:11.958 INFO:tasks.cephadm.osd.5:Stopped osd.5 2021-10-08T19:45:11.958 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2021-10-08T19:45:11.959 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.6 2021-10-08T19:45:12.170 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:45:12 smithi196 systemd[1]: Stopping Ceph osd.6 for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:12.170 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:45:12 smithi196 bash[123518]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:45:12.564 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:45:12 smithi196 conmon[49684]: 2021-10-08T19:45:12.169+0000 7f74c03d6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:12.564 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:45:12 smithi196 conmon[49684]: 2021-10-08T19:45:12.169+0000 7f74c03d6700 -1 osd.6 768 *** Got signal Terminated *** 2021-10-08T19:45:12.565 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:45:12 smithi196 conmon[49684]: 2021-10-08T19:45:12.169+0000 7f74c03d6700 -1 osd.6 768 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:12.565 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:45:12 smithi196 bash[123518]: 3981742ae1539cdc4b775cf6ba40fc9aa0fcba58c12dd2a5c8e0805d317e2f64 2021-10-08T19:45:13.602 INFO:journalctl@ceph.osd.6.smithi196.stdout:Oct 08 19:45:12 smithi196 bash[123518]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.6 found: no such container 2021-10-08T19:45:14.200 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.6.service' 2021-10-08T19:45:14.237 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:14.237 INFO:tasks.cephadm.osd.6:Stopped osd.6 2021-10-08T19:45:14.238 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2021-10-08T19:45:14.238 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.7 2021-10-08T19:45:14.461 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:45:14 smithi196 systemd[1]: Stopping Ceph osd.7 for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:14.462 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:45:14 smithi196 bash[124005]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:45:14.855 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:45:14 smithi196 conmon[53867]: 2021-10-08T19:45:14.460+0000 7f650867d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:14.855 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:45:14 smithi196 conmon[53867]: 2021-10-08T19:45:14.460+0000 7f650867d700 -1 osd.7 768 *** Got signal Terminated *** 2021-10-08T19:45:14.856 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:45:14 smithi196 conmon[53867]: 2021-10-08T19:45:14.460+0000 7f650867d700 -1 osd.7 768 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-10-08T19:45:14.856 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:45:14 smithi196 bash[124005]: c8f25e7f68fb90caa8a11496625b99a078e98e91af42534dd3b3db61efcbfaa2 2021-10-08T19:45:14.857 INFO:journalctl@ceph.osd.7.smithi196.stdout:Oct 08 19:45:14 smithi196 bash[124005]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-osd.7 found: no such container 2021-10-08T19:45:16.403 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@osd.7.service' 2021-10-08T19:45:16.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:16.439 INFO:tasks.cephadm.osd.7:Stopped osd.7 2021-10-08T19:45:16.440 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2021-10-08T19:45:16.440 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@rgw.foo.a 2021-10-08T19:45:16.827 INFO:journalctl@ceph.rgw.foo.a.smithi157.stdout:Oct 08 19:45:16 smithi157 systemd[1]: Stopping Ceph rgw.foo.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:16.828 INFO:journalctl@ceph.rgw.foo.a.smithi157.stdout:Oct 08 19:45:16 smithi157 bash[204893]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-rgw.foo.a found: no such container 2021-10-08T19:45:16.828 INFO:journalctl@ceph.rgw.foo.a.smithi157.stdout:Oct 08 19:45:16 smithi157 conmon[64777]: 2021-10-08T19:45:16.631+0000 7f225969b700 -1 received signal: Terminated from /dev/init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:45:16.828 INFO:journalctl@ceph.rgw.foo.a.smithi157.stdout:Oct 08 19:45:16 smithi157 conmon[64777]: 2021-10-08T19:45:16.631+0000 7f22687ec400 -1 rgw dbstore: shutting down 2021-10-08T19:45:27.210 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@rgw.foo.a.service' 2021-10-08T19:45:27.259 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:27.259 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2021-10-08T19:45:27.260 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2021-10-08T19:45:27.261 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-906d7a14-286c-11ec-8c25-001a4aab830c@prometheus.a 2021-10-08T19:45:27.616 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 systemd[1]: Stopping Ceph prometheus.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:27.616 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 bash[125892]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-prometheus.a found: no such container 2021-10-08T19:45:28.112 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=warn ts=2021-10-08T19:45:27.766Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-10-08T19:45:28.112 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.766Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-10-08T19:45:28.112 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.766Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-10-08T19:45:28.113 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.766Z caller=main.go:583 msg="Stopping scrape manager..." 2021-10-08T19:45:28.113 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.766Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-10-08T19:45:28.113 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.766Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-10-08T19:45:28.113 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.766Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-10-08T19:45:28.114 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.766Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-10-08T19:45:28.114 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.766Z caller=main.go:577 msg="Scrape manager stopped" 2021-10-08T19:45:28.114 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.767Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-10-08T19:45:28.114 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.767Z caller=main.go:749 msg="Notifier manager stopped" 2021-10-08T19:45:28.114 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 conmon[66293]: level=info ts=2021-10-08T19:45:27.767Z caller=main.go:761 msg="See you next time!" 2021-10-08T19:45:28.115 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:27 smithi196 bash[125892]: b52cc33188995603fe494b0f4d5e717c25f76fc7f327a89dbc62fb6eb253513a 2021-10-08T19:45:28.115 INFO:journalctl@ceph.prometheus.a.smithi196.stdout:Oct 08 19:45:28 smithi196 bash[125892]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-prometheus.a found: no such container 2021-10-08T19:45:28.523 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-906d7a14-286c-11ec-8c25-001a4aab830c@prometheus.a.service' 2021-10-08T19:45:28.558 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-10-08T19:45:28.559 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2021-10-08T19:45:28.559 DEBUG:teuthology.orchestra.run.smithi157:> sudo cephadm rm-cluster --fsid 906d7a14-286c-11ec-8c25-001a4aab830c --force --keep-logs 2021-10-08T19:45:30.078 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:29 smithi157 systemd[1]: Stopping Ceph alertmanager.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:30.078 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:29 smithi157 bash[206856]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-alertmanager.a found: no such container 2021-10-08T19:45:30.078 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:29 smithi157 conmon[87186]: level=info ts=2021-10-08T19:45:29.891Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-10-08T19:45:30.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:30 smithi157 bash[206856]: fd1a02efea50c93b73bad84065bc790946121cdf4397aa6717517945b82e69fc 2021-10-08T19:45:30.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:30 smithi157 bash[206856]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-alertmanager.a found: no such container 2021-10-08T19:45:30.832 INFO:journalctl@ceph.alertmanager.a.smithi157.stdout:Oct 08 19:45:30 smithi157 systemd[1]: Stopped Ceph alertmanager.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:45:30.833 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:45:30 smithi157 systemd[1]: Stopping Ceph node-exporter.a for 906d7a14-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:45:30.833 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:45:30 smithi157 bash[207052]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-node-exporter.a found: no such container 2021-10-08T19:45:31.501 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:45:31 smithi157 bash[207052]: 53dd159a2fc1c9f15fa3c7f5826729262ea22ee7b50198c86b71fc4a33a45e42 2021-10-08T19:45:31.501 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:45:31 smithi157 systemd[1]: ceph-906d7a14-286c-11ec-8c25-001a4aab830c@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2021-10-08T19:45:31.501 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:45:31 smithi157 bash[207052]: Error: no container with name or ID ceph-906d7a14-286c-11ec-8c25-001a4aab830c-node-exporter.a found: no such container 2021-10-08T19:45:31.502 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:45:31 smithi157 systemd[1]: ceph-906d7a14-286c-11ec-8c25-001a4aab830c@node-exporter.a.service: Failed with result 'exit-code'. 2021-10-08T19:45:31.502 INFO:journalctl@ceph.node-exporter.a.smithi157.stdout:Oct 08 19:45:31 smithi157 systemd[1]: Stopped Ceph node-exporter.a for 906d7a14-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:45:31.502 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-10-08T19:45:31.512 DEBUG:teuthology.task.console_log:Killing console logger for smithi157 2021-10-08T19:45:31.513 DEBUG:teuthology.task.console_log:Killing console logger for smithi196 2021-10-08T19:45:31.513 DEBUG:teuthology.exit:Finished running handlers